Kidney cysts are very common. They do not usually cause pain. So the abdominal pain you felt is not likely to be from the kidney cyst.
No one knows why cysts form in otherwise healthy kidneys. But they only cause pain when there is blood or infection inside the cyst. The CT scan would show these abnormalities so no further testing is needed.