Jul 16 21:07:09.626101 ip-10-0-132-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 21:07:09.626110 ip-10-0-132-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 21:07:09.626117 ip-10-0-132-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 21:07:09.626350 ip-10-0-132-95 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 21:07:19.875750 ip-10-0-132-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 21:07:19.875769 ip-10-0-132-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c1834c1a544c4ea1a47ed92b06421f0c --
Jul 16 21:08:57.022382 ip-10-0-132-95 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 21:08:57.460596 ip-10-0-132-95 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:08:57.460596 ip-10-0-132-95 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 21:08:57.460596 ip-10-0-132-95 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:08:57.460596 ip-10-0-132-95 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 21:08:57.460596 ip-10-0-132-95 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:08:57.461706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.461607    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 21:08:57.468196 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468179    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.468196 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468194    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.468196 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468201    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468205    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468209    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468213    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468217    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468221    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468229    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468233    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468237    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468241    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468244    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468248    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468251    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468255    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468260    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468264    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468268    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468272    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468276    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468280    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468283    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.468387 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468287    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468291    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468295    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468299    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468303    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468307    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468311    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468317    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468324    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468329    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468333    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468338    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468343    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468348    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468353    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468358    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468365    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468370    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468374    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.469223 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468379    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468383    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468386    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468390    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468394    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468398    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468403    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468407    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468411    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468415    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468419    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468423    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468428    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468432    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468436    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468440    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468444    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468448    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468453    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.469872 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468457    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468461    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468469    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468473    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468478    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468482    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468488    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468493    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468498    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468502    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468506    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468510    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468568    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468621    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468629    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468636    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468640    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468645    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468650    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468654    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.470399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468658    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468663    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468667    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.468672    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470594    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470626    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470746    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470756    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470762    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470767    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470771    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470775    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470779    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470784    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470789    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470793    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470797    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.471083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.470801    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.471969 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471952    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.471969 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471968    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471973    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471978    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471982    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471985    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471989    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.471994    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472000    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472016    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472021    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472026    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472031    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472035    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472040    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472045    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472049    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472053    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472057    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472062    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472066    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.472083 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472070    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472074    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472078    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472082    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472103    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472108    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472112    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472116    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472120    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472124    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472128    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472132    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472136    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472140    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472145    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472149    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472153    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472158    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472162    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472166    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.472954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472170    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472174    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472178    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472182    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472186    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472190    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472194    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472198    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472202    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472206    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472210    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472213    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472221    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472228    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472236    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472242    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472246    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472250    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472254    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.473830 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472259    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472269    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472274    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472278    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472283    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472287    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472291    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472295    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472299    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472303    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472308    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472312    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472317    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472321    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472325    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472329    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472335    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472339    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472343    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.474733 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472347    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472352    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472356    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472360    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472364    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472368    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472372    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472376    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472381    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472385    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472390    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472394    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472398    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472403    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472407    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472411    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472415    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472419    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472423    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.472427    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.475368 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473049    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473057    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473062    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473066    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473071    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473077    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473082    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473105    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473110    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473114    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473118    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473122    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473126    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473130    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473134    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473138    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473142    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473147    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473151    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473155    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.475864 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473160    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473164    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473168    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473174    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473178    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473182    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473189    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473195    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473200    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473205    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473209    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473214    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473218    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473224    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473228    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473233    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473237    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473241    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.476429 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473247    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473252    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473257    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473262    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473266    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473271    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473275    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473280    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473284    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473289    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473293    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473297    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473301    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473305    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473311    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473315    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473319    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473323    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473328    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473332    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.477018 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473336    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473340    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473344    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473348    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473352    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473358    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473362    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473366    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473370    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473374    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473379    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473383    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473387    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473391    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473395    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473399    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473403    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473407    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473411    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473415    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.477615 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473419    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473423    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473427    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473431    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473435    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473439    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473444    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473448    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473453    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473457    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473461    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473466    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473470    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473474    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473478    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473482    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473487    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473491    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473495    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473500    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.478139 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.473503    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473607    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473617    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473627    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473634    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473640    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473645    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473652    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473659    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473664    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473669    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473674    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473680    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473685    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473689    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473694    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473698    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473703    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473708    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473714    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473718    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473723    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473728    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473734    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 21:08:57.478714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473742    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473747    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473752    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473758    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473762    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473767    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473772    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473777    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473781    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473787    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473792    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473797    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473802    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473806    2559 flags.go:64] FLAG: --enable-server="true"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473811    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473819    2559 flags.go:64] FLAG: --event-burst="100"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473825    2559 flags.go:64] FLAG: --event-qps="50"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473829    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473834    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473838    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473851    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473856    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473861    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473866    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473871    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 21:08:57.479309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473875    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473880    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473885    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473889    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473894    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473899    2559 flags.go:64] FLAG: --feature-gates=""
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473905    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473911    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473916    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473921    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473926    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473931    2559 flags.go:64] FLAG: --help="false"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473936    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473941    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473945    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473950    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473956    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473961    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473966    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473970    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473974    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473979    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473984    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473989    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 21:08:57.479970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473994    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.473999    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474003    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474008    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474012    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474017    2559 flags.go:64] FLAG: --lock-file=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474022    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474026    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474032    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474043    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474047    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474052    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474056    2559 flags.go:64] FLAG: --logging-format="text"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474063    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474068    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474073    2559 flags.go:64] FLAG: --manifest-url=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474078    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474107    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474113    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474120    2559 flags.go:64] FLAG: --max-pods="110"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474125    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474129    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474134    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474138    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474143    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 21:08:57.480587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474147    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474152    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474164    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474169    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474173    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474178    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474183    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474192    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474196    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474201    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474206    2559 flags.go:64] FLAG: --port="10250"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474211    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474215    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bcccc55be05fda4f"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474221    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474225    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474230    2559 flags.go:64] FLAG: --register-node="true"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474234    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474250    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474255    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474259    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474265    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474271    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474276    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474281    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474285    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 21:08:57.481236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474291    2559 flags.go:64] FLAG: --runonce="false"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474295    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474301    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474305    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474310    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474315    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474319    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474324    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474329    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474334    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474338    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474343    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474347    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474352    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474356    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474361    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474370    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474375    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474379    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474385    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474389    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474394    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474399    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474403    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474410    2559 flags.go:64] FLAG: --v="2"
Jul 16 21:08:57.481896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474416    2559 flags.go:64] FLAG: --version="false"
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474422    2559 flags.go:64] FLAG: --vmodule=""
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474430    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.474435    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474611    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474618    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474625    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474633    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474643    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474647    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474652    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474655    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474662    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474669    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474673    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474678    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474682    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474687    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474691    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474696    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.482549 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474700    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474705    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474709    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474713    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474717    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474721    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474726    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474729    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474733    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474737    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474741    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474748    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474752    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474756    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474762    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474766    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474770    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474774    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474779    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474783    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.483031 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474787    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474793    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474797    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474801    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474805    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474810    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474814    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474819    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474823    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474828    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474832    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474836    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474840    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474844    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474848    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474852    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474857    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474861    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474865    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474869    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.483528 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474874    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474878    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474882    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474889    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474894    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474898    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474904    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474908    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474912    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474917    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474921    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474925    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474929    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474934    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474939    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474943    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474947    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474951    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474955    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474959    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.484009 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474963    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474970    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474975    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474979    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474984    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474988    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474992    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.474996    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475000    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475004    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475009    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475013    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475017    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475021    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475026    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475031    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475036    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475040    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475045    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.484544 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475049    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475053    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475058    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.475062    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.475817    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483110    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483127    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483146    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483151    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483207    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483212    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483216    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483219    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483222    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.485019 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483225    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483227    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483230    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483233    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483237    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483241    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483244    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483247    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483249    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483252    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483255    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483257    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483260    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483262    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483265    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483267    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483270    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483272    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483275    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.485384 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483277    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483280    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483282    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483284    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483287    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483291    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483294    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483297    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483299    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483302    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483304    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483307    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483309    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483312    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483314    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483317    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483319    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483322    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483324    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483327    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.485896 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483329    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483331    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483334    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483338    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483342    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483344    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483347    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483349    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483352    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483354    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483357    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483359    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483361    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483364    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483366    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483369    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483371    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483375    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483378    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483380    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.486448 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483383    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483385    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483388    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483390    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483393    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483395    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483397    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483400    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483403    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483405    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483408    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483410    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483413    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483415    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483418    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483420    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483423    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483425    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483427    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483431    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.486923 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483434    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483437    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483439    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483442    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483445    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483448    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483451    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483454    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483456    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483460    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483463    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483466    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483469    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483471    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483474    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.487409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483479    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483608    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483613    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483616    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483619    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483622    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483625    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483630    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483633    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483636    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483639    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483641    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483644    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483646    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483649    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483651    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483654    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483656    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483658    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483661    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:08:57.487811 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483663    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483666    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483668    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483670    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483673    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483675    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483678    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483682    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483686    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483689    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483703    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483707    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483710    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483713    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483716    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483718    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483721    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483723    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483726    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:08:57.488301 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483728    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483731    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483734    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483736    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483739    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483741    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483743    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483746    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483748    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483750    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483753    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483755    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483758    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483760    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483762    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483765    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483767    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483770    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483772    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483775    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:08:57.488760 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483778    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483780    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483782    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483785    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483788    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483790    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483793    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483795    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483798    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483800    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483802    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483805    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483807    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483809    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483812    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483814    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483816    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483819    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483821    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483824    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:08:57.489248 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483826    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483829    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483831    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483834    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483836    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483838    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483841    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483844    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483847    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483850    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483853    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483856    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483858    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483861    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483863    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483866    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483869    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483871    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483874    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483876    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:08:57.489719 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:57.483878    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:08:57.490199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483883    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:08:57.490199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.483977    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 21:08:57.490199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.488270    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 21:08:57.490199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.489970    2559 server.go:1019] "Starting client certificate rotation"
Jul 16 21:08:57.490199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.490072    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:08:57.490775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.490762    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:08:57.492830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.492816    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:08:57.493938 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.493923    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:08:57.508896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.508876    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 16 21:08:57.511242 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.511227    2559 log.go:25] "Validated CRI v1 image API"
Jul 16 21:08:57.512924 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.512906    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 21:08:57.515500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.515481    2559 fs.go:135] Filesystem UUIDs: map[1dbaba88-e924-4a21-b451-67bd76be85cd:/dev/nvme0n1p4 2944e058-9737-4c40-b67a-18a9ec449168:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 16 21:08:57.515562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.515499    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 21:08:57.522667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.522564    2559 manager.go:216] Machine: {Timestamp:2026-07-16 21:08:57.521139854 +0000 UTC m=+0.371757226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100215 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a07424c5e27282e508925fe63953 SystemUUID:ec26a074-24c5-e272-82e5-08925fe63953 BootID:c1834c1a-544c-4ea1-a47e-d92b06421f0c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:5e:2b:a7:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:5e:2b:a7:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:ac:22:ad:a2:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 21:08:57.522667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.522662    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 21:08:57.522773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.522730    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 21:08:57.526165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.526142    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 21:08:57.526288 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.526169    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 21:08:57.527052 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.527042    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 21:08:57.527100 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.527054    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 21:08:57.527100 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.527061    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:08:57.527100 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.527075    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:08:57.528716 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.528701    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:08:57.528981 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.528970    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 21:08:57.533620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533609    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:08:57.533740 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533731    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 21:08:57.533775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533759    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 21:08:57.533775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533768    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 21:08:57.533827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533782    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 21:08:57.533827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533791    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 16 21:08:57.533827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.533806    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 21:08:57.534142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.534131    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:08:57.534198 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.534149    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:08:57.536580 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.536564    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 21:08:57.538726 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.538714    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 21:08:57.538774 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.538743    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 21:08:57.540241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540230    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540247    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540253    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540259    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540273    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540281    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 21:08:57.540287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540289    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 21:08:57.540559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540294    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 21:08:57.540559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540301    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 21:08:57.540559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540307    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 21:08:57.540559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540319    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 21:08:57.540559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.540325    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 21:08:57.541191 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.541181    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 21:08:57.541191 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.541190    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 21:08:57.544157 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.544144    2559 server.go:1268] "Started kubelet"
Jul 16 21:08:57.544239 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.544220    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 21:08:57.544289 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.544228    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 21:08:57.544336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.544302    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 21:08:57.544937 ip-10-0-132-95 systemd[1]: Started Kubernetes Kubelet.
Jul 16 21:08:57.548709 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.548684    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 21:08:57.548861 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.548832    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 21:08:57.548949 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.548850    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 21:08:57.549009 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.548983    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 21:08:57.549264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.549248    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 21:08:57.550400 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.550372    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 21:08:57.557105 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.555924    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-95.ec2.internal.18c2e15055bb79e5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-95.ec2.internal,UID:ip-10-0-132-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-95.ec2.internal,},FirstTimestamp:2026-07-16 21:08:57.544120805 +0000 UTC m=+0.394738173,LastTimestamp:2026-07-16 21:08:57.544120805 +0000 UTC m=+0.394738173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-95.ec2.internal,}"
Jul 16 21:08:57.558129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558082    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 21:08:57.558215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558105    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 21:08:57.558215 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.558203    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:57.558846 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558828    2559 factory.go:55] Registering systemd factory
Jul 16 21:08:57.558937 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558870    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558942    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558958    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.558942    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559109    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559114    2559 factory.go:153] Registering CRI-O factory
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559127    2559 factory.go:223] Registration of the crio container factory successfully
Jul 16 21:08:57.559165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559118    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 21:08:57.559474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559192    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 21:08:57.559474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559226    2559 factory.go:103] Registering Raw factory
Jul 16 21:08:57.559474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559239    2559 manager.go:1196] Started watching for new ooms in manager
Jul 16 21:08:57.559876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.559819    2559 manager.go:349] Starting recovery of all containers
Jul 16 21:08:57.564685 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.564656    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 21:08:57.564789 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.564766    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 21:08:57.566738 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.566712    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 21:08:57.571939 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.571926    2559 manager.go:354] Recovery completed
Jul 16 21:08:57.576563 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.576468    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.578145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578118    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.578211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578160    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.578211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578172    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.578642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578626    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 21:08:57.578642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578639    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 21:08:57.578776 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578653    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:08:57.578776 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.578677    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.579341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.579326    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.579413 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.579355    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.579413 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.579367    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.580827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.580814    2559 policy_none.go:49] "None policy: Start"
Jul 16 21:08:57.580883 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.580832    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 21:08:57.580883 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.580842    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 21:08:57.582804 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.582794    2559 policy_none.go:47] "Start"
Jul 16 21:08:57.584415 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.584330    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-95.ec2.internal.18c2e15057c2a642  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-95.ec2.internal,UID:ip-10-0-132-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-95.ec2.internal,},FirstTimestamp:2026-07-16 21:08:57.578145346 +0000 UTC m=+0.428762718,LastTimestamp:2026-07-16 21:08:57.578145346 +0000 UTC m=+0.428762718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-95.ec2.internal,}"
Jul 16 21:08:57.596985 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.596922    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-95.ec2.internal.18c2e15057c2f7dc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-95.ec2.internal,UID:ip-10-0-132-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-95.ec2.internal,},FirstTimestamp:2026-07-16 21:08:57.578166236 +0000 UTC m=+0.428783606,LastTimestamp:2026-07-16 21:08:57.578166236 +0000 UTC m=+0.428783606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-95.ec2.internal,}"
Jul 16 21:08:57.610602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.610425    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcx57"
Jul 16 21:08:57.611301 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.611232    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-95.ec2.internal.18c2e15057c3240c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-95.ec2.internal,UID:ip-10-0-132-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-95.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-95.ec2.internal,},FirstTimestamp:2026-07-16 21:08:57.578177548 +0000 UTC m=+0.428794917,LastTimestamp:2026-07-16 21:08:57.578177548 +0000 UTC m=+0.428794917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-95.ec2.internal,}"
Jul 16 21:08:57.620438 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.620421    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lcx57"
Jul 16 21:08:57.626465 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.626407    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-95.ec2.internal.18c2e15057c2a642\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-95.ec2.internal.18c2e15057c2a642  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-95.ec2.internal,UID:ip-10-0-132-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-95.ec2.internal,},FirstTimestamp:2026-07-16 21:08:57.578145346 +0000 UTC m=+0.428762718,LastTimestamp:2026-07-16 21:08:57.579340147 +0000 UTC m=+0.429957523,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-95.ec2.internal,}"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.628773    2559 manager.go:337] "Starting Device Plugin manager"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.628804    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.628816    2559 server.go:87] "Starting device plugin registration server"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.629038    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.629050    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.629161    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.629250    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.629261    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.629673    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 21:08:57.645768 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.629715    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:57.671765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.671746    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 21:08:57.671838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.671784    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 21:08:57.671838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.671802    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 21:08:57.671838 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.671834    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 21:08:57.674024 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.674007    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:08:57.729979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.729934    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.730651 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.730637    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.730726 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.730664    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.730726 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.730674    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.730726 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.730695    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.744947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.744926    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.745033 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.744949    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-95.ec2.internal\": node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:57.772876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.772855    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"]
Jul 16 21:08:57.772958 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.772906    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.774169 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.774156    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.774225 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.774182    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.774225 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.774197    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.776520 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.776507    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.776628 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.776615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.776665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.776645    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.777140 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777125    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.777222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777150    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.777222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777164    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.777222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777171    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.777222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777188    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.777222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.777197    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.779527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.779510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.779606 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.779540    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:08:57.780195 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.780177    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:08:57.780296 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.780211    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:08:57.780296 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.780225    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:08:57.798202 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.798181    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:57.811827 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.811807    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-95.ec2.internal\" not found" node="ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.816192 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.816176    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-95.ec2.internal\" not found" node="ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.860361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.860340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.860430 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.860363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.860430 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.860382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf30bda94c0cf296cb79742041db8530-config\") pod \"kube-apiserver-proxy-ip-10-0-132-95.ec2.internal\" (UID: \"cf30bda94c0cf296cb79742041db8530\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.899011 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:57.898991    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:57.961286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.961286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.961432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf30bda94c0cf296cb79742041db8530-config\") pod \"kube-apiserver-proxy-ip-10-0-132-95.ec2.internal\" (UID: \"cf30bda94c0cf296cb79742041db8530\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.961432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf30bda94c0cf296cb79742041db8530-config\") pod \"kube-apiserver-proxy-ip-10-0-132-95.ec2.internal\" (UID: \"cf30bda94c0cf296cb79742041db8530\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.961432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:57.961432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:57.961380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d95bd52df24e36ca670eaad3c1fa8280-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal\" (UID: \"d95bd52df24e36ca670eaad3c1fa8280\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:58.000143 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.000071    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.100656 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.100634    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.114815 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.114795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:58.120278 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.119808    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:58.200965 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.200930    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.301522 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.301441    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.401968 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.401943    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.489458 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.489422    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 21:08:58.489934 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.489572    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:08:58.502715 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.502697    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.602821 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:58.602752    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-95.ec2.internal\" not found"
Jul 16 21:08:58.626924 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.626895    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:03:57 +0000 UTC" deadline="2028-02-12 15:10:41.658982612 +0000 UTC"
Jul 16 21:08:58.626924 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.626918    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13818h1m43.032067303s"
Jul 16 21:08:58.675240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.675213    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:08:58.758728 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.758710    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:58.781253 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.781231    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:08:58.782651 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.782637    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal"
Jul 16 21:08:58.804576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.804557    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:08:58.884797 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:58.884766    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf30bda94c0cf296cb79742041db8530.slice/crio-0890c524284fdb5cc9d5ea2407ebd26bfbd54164fa1909c68fa0a6480ef60631 WatchSource:0}: Error finding container 0890c524284fdb5cc9d5ea2407ebd26bfbd54164fa1909c68fa0a6480ef60631: Status 404 returned error can't find the container with id 0890c524284fdb5cc9d5ea2407ebd26bfbd54164fa1909c68fa0a6480ef60631
Jul 16 21:08:58.885294 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:58.885272    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95bd52df24e36ca670eaad3c1fa8280.slice/crio-a50fbb738c9bbc7eac4a2a2b6c3f9bcfe254f8e5f24042ea293c4b9d75a23631 WatchSource:0}: Error finding container a50fbb738c9bbc7eac4a2a2b6c3f9bcfe254f8e5f24042ea293c4b9d75a23631: Status 404 returned error can't find the container with id a50fbb738c9bbc7eac4a2a2b6c3f9bcfe254f8e5f24042ea293c4b9d75a23631
Jul 16 21:08:58.889405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.889388    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:08:58.938159 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:58.938135    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:08:59.121181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.121155    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:08:59.535288 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.535202    2559 apiserver.go:52] "Watching apiserver"
Jul 16 21:08:59.546246 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.546223    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 21:08:59.546626 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.546602    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq","openshift-cluster-node-tuning-operator/tuned-qd6dl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal","openshift-multus/multus-6vdwm","openshift-multus/multus-additional-cni-plugins-bzmr7","openshift-dns/node-resolver-94mx7","openshift-image-registry/node-ca-9z7ph","openshift-multus/network-metrics-daemon-g5wp2","openshift-network-diagnostics/network-check-target-49q69","openshift-network-operator/iptables-alerter-s5msr","openshift-ovn-kubernetes/ovnkube-node-85pcp","kube-system/global-pull-secret-syncer-h6dvh","kube-system/konnectivity-agent-kdnw5"]
Jul 16 21:08:59.550643 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.550628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.553521 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.553497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.556443 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.556423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.558773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.558757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.558986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.558963    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 21:08:59.561137 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.561118    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.563481 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.563460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.564801 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.564785    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 21:08:59.565501 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.565483    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 21:08:59.565845 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.565830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.565911 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.565894    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:08:59.566731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.566713    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.567673 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.567649    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.567811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.567729    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 21:08:59.567811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.567800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v8bvx\""
Jul 16 21:08:59.568375 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568338    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.568375 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568356    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 21:08:59.568546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568405    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.568546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568411    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 21:08:59.568546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568466    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.568546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568356    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.568546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568346    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.568782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568701    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:08:59.568782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568716    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 21:08:59.568782 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.568763    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:08:59.568895 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568804    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.568895 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568834    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lpnb\""
Jul 16 21:08:59.568895 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.568885    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.569638 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569618    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.569743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.569743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.569743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-kubernetes\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.569911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-systemd\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.569911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rz57f\""
Jul 16 21:08:59.569911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fa01ee-376d-4245-99da-9a90e656996e-tmp-dir\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.569911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4b7t8\""
Jul 16 21:08:59.569911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569869    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rkl7z\""
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-kubelet\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-system-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.569927    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pfzrv\""
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-os-release\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cni-binary-copy\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-hostroot\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-conf\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.570133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-var-lib-kubelet\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-k8s-cni-cncf-io\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-bin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-lib-modules\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-tmp\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qdm\" (UniqueName: \"kubernetes.io/projected/40fa01ee-376d-4245-99da-9a90e656996e-kube-api-access-55qdm\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-multus\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-host\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-socket-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glf86\" (UniqueName: \"kubernetes.io/projected/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kube-api-access-glf86\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-conf-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-daemon-config\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-os-release\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.570694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysconfig\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-run\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptkj9\" (UniqueName: \"kubernetes.io/projected/c455762d-9cf4-4ae5-b705-af06b12ea8f0-kube-api-access-ptkj9\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-device-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cnibin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-socket-dir-parent\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-netns\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-tuned\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-sys-fs\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-multus-certs\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8lh\" (UniqueName: \"kubernetes.io/projected/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-kube-api-access-cx8lh\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cnibin\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrfl\" (UniqueName: \"kubernetes.io/projected/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-kube-api-access-xsrfl\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-modprobe-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.571653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-sys\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.572540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.570985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40fa01ee-376d-4245-99da-9a90e656996e-hosts-file\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.572540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.571009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-registration-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.572540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.571031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-etc-kubernetes\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.572540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.571047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.572540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.571613    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.575701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.575676    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 21:08:59.576433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.576415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.577106 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.577072    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.577281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.577266    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkc6t\""
Jul 16 21:08:59.579031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.579009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.579449 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.579121    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:08:59.581979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.581957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.582249 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.582230    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.582557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.582514    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 21:08:59.582557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.582536    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 21:08:59.582557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.582547    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 21:08:59.583297 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.583279    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 21:08:59.583396 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.583296    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 21:08:59.583396 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.583357    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hswhk\""
Jul 16 21:08:59.583541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.583440    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 21:08:59.587192 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.587170    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 21:08:59.587652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.587634    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kfslq\""
Jul 16 21:08:59.587753 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.587722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 21:08:59.593050 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.593031    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:08:59.632595 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.632568    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwhxw"
Jul 16 21:08:59.649935 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.649910    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwhxw"
Jul 16 21:08:59.660807 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.660785    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 21:08:59.672405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.672519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-sys-fs\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.672519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-multus-certs\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.672519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-multus-certs\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.672689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-sys-fs\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.672689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cnibin\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.672689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-script-lib\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.672689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.672689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/342911f4-80c9-4231-a515-689ac4198137-iptables-alerter-script\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.672925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-kubelet-config\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.672925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cnibin\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.672925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-dbus\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.672925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrfl\" (UniqueName: \"kubernetes.io/projected/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-kube-api-access-xsrfl\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.672976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-sys\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-registration-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-node-log\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-etc-kubernetes\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673153    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-sys\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673161    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-registration-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-kubelet\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-kubelet\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.673478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-os-release\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cni-binary-copy\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673603    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-os-release\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-systemd-units\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-log-socket\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342911f4-80c9-4231-a515-689ac4198137-host-slash\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-multus\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-multus\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glf86\" (UniqueName: \"kubernetes.io/projected/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kube-api-access-glf86\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-ovn\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673817    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-netd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b07dadad-44fe-448e-be3a-82ffcb256bcd-host\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-conf-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-os-release\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-etc-kubernetes\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.673982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysconfig\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-run\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674081    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-os-release\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cni-binary-copy\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-conf-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674163    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-run\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysconfig\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptkj9\" (UniqueName: \"kubernetes.io/projected/c455762d-9cf4-4ae5-b705-af06b12ea8f0-kube-api-access-ptkj9\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-bin\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-config\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cnibin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-tuned\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b208102-e9f9-4842-9285-1b03915a8a47-ovn-node-metrics-cert\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.674964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-cnibin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674735    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1335911-b6ee-424e-aa17-7354c74cb7df-konnectivity-ca\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k64sc\" (UniqueName: \"kubernetes.io/projected/34e967b0-1c1e-4bd3-857b-ab8b17896e58-kube-api-access-k64sc\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8lh\" (UniqueName: \"kubernetes.io/projected/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-kube-api-access-cx8lh\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.674992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-modprobe-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40fa01ee-376d-4245-99da-9a90e656996e-hosts-file\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b07dadad-44fe-448e-be3a-82ffcb256bcd-serviceca\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzvh\" (UniqueName: \"kubernetes.io/projected/b07dadad-44fe-448e-be3a-82ffcb256bcd-kube-api-access-rmzvh\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-kubernetes\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-systemd\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fa01ee-376d-4245-99da-9a90e656996e-tmp-dir\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-slash\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40fa01ee-376d-4245-99da-9a90e656996e-hosts-file\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-etc-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-systemd\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.675884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77k9g\" (UniqueName: \"kubernetes.io/projected/5b208102-e9f9-4842-9285-1b03915a8a47-kube-api-access-77k9g\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-kubernetes\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-modprobe-d\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-system-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-hostroot\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-conf\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-system-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-var-lib-kubelet\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-hostroot\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-var-lib-kubelet\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-k8s-cni-cncf-io\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-k8s-cni-cncf-io\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-bin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-lib-modules\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-var-lib-cni-bin\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-tmp\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qdm\" (UniqueName: \"kubernetes.io/projected/40fa01ee-376d-4245-99da-9a90e656996e-kube-api-access-55qdm\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.676694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-cni-dir\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40fa01ee-376d-4245-99da-9a90e656996e-tmp-dir\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-lib-modules\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-sysctl-conf\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-systemd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-host\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-socket-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1335911-b6ee-424e-aa17-7354c74cb7df-agent-certs\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c455762d-9cf4-4ae5-b705-af06b12ea8f0-host\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pd6\" (UniqueName: \"kubernetes.io/projected/342911f4-80c9-4231-a515-689ac4198137-kube-api-access-r4pd6\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-socket-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-daemon-config\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.675994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-device-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-kubelet\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-netns\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-var-lib-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-device-dir\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.677548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-env-overrides\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-socket-dir-parent\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-socket-dir-parent\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-netns\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-host-run-netns\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-multus-daemon-config\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.678376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.676726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal" event={"ID":"cf30bda94c0cf296cb79742041db8530","Type":"ContainerStarted","Data":"0890c524284fdb5cc9d5ea2407ebd26bfbd54164fa1909c68fa0a6480ef60631"}
Jul 16 21:08:59.678681 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.678656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-etc-tuned\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.678792 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.678715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c455762d-9cf4-4ae5-b705-af06b12ea8f0-tmp\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.679077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.679052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal" event={"ID":"d95bd52df24e36ca670eaad3c1fa8280","Type":"ContainerStarted","Data":"a50fbb738c9bbc7eac4a2a2b6c3f9bcfe254f8e5f24042ea293c4b9d75a23631"}
Jul 16 21:08:59.691463 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.691411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glf86\" (UniqueName: \"kubernetes.io/projected/ce8c5563-9244-4b03-90ad-7d5f3024b1e8-kube-api-access-glf86\") pod \"aws-ebs-csi-driver-node-4v6rq\" (UID: \"ce8c5563-9244-4b03-90ad-7d5f3024b1e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.691991 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.691964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptkj9\" (UniqueName: \"kubernetes.io/projected/c455762d-9cf4-4ae5-b705-af06b12ea8f0-kube-api-access-ptkj9\") pod \"tuned-qd6dl\" (UID: \"c455762d-9cf4-4ae5-b705-af06b12ea8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.694570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.694549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrfl\" (UniqueName: \"kubernetes.io/projected/0c05cdf1-90e6-4aef-88dc-a69726abc1c8-kube-api-access-xsrfl\") pod \"multus-additional-cni-plugins-bzmr7\" (UID: \"0c05cdf1-90e6-4aef-88dc-a69726abc1c8\") " pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.694674 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.694641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qdm\" (UniqueName: \"kubernetes.io/projected/40fa01ee-376d-4245-99da-9a90e656996e-kube-api-access-55qdm\") pod \"node-resolver-94mx7\" (UID: \"40fa01ee-376d-4245-99da-9a90e656996e\") " pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.695207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.695183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8lh\" (UniqueName: \"kubernetes.io/projected/1bcebb60-ac13-4a00-ae7b-3972d3eaef12-kube-api-access-cx8lh\") pod \"multus-6vdwm\" (UID: \"1bcebb60-ac13-4a00-ae7b-3972d3eaef12\") " pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.757314 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.757284    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:08:59.777077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:08:59.777077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-systemd-units\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-log-socket\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777240    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-systemd-units\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342911f4-80c9-4231-a515-689ac4198137-host-slash\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.777308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-ovn\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777276    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342911f4-80c9-4231-a515-689ac4198137-host-slash\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-netd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b07dadad-44fe-448e-be3a-82ffcb256bcd-host\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-log-socket\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-netd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-ovn\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-bin\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-cni-bin\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-config\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b07dadad-44fe-448e-be3a-82ffcb256bcd-host\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b208102-e9f9-4842-9285-1b03915a8a47-ovn-node-metrics-cert\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1335911-b6ee-424e-aa17-7354c74cb7df-konnectivity-ca\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k64sc\" (UniqueName: \"kubernetes.io/projected/34e967b0-1c1e-4bd3-857b-ab8b17896e58-kube-api-access-k64sc\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b07dadad-44fe-448e-be3a-82ffcb256bcd-serviceca\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.777581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzvh\" (UniqueName: \"kubernetes.io/projected/b07dadad-44fe-448e-be3a-82ffcb256bcd-kube-api-access-rmzvh\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-slash\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-etc-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77k9g\" (UniqueName: \"kubernetes.io/projected/5b208102-e9f9-4842-9285-1b03915a8a47-kube-api-access-77k9g\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-systemd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1335911-b6ee-424e-aa17-7354c74cb7df-agent-certs\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pd6\" (UniqueName: \"kubernetes.io/projected/342911f4-80c9-4231-a515-689ac4198137-kube-api-access-r4pd6\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-slash\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-kubelet\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-kubelet\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-netns\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-etc-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.777972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-var-lib-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-netns\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-env-overrides\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.778385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-script-lib\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/342911f4-80c9-4231-a515-689ac4198137-iptables-alerter-script\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-kubelet-config\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-dbus\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-var-lib-openvswitch\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-node-log\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-run-systemd\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-kubelet-config\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1335911-b6ee-424e-aa17-7354c74cb7df-konnectivity-ca\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778544    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-dbus\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-config\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-node-log\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b208102-e9f9-4842-9285-1b03915a8a47-host-run-ovn-kubernetes\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.779412 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.778673    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.778678    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.778773    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:00.278729763 +0000 UTC m=+3.129347140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.778794    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:00.278783061 +0000 UTC m=+3.129400418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-env-overrides\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b07dadad-44fe-448e-be3a-82ffcb256bcd-serviceca\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.778890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/342911f4-80c9-4231-a515-689ac4198137-iptables-alerter-script\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.780353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.779091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b208102-e9f9-4842-9285-1b03915a8a47-ovnkube-script-lib\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.780787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.780624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b208102-e9f9-4842-9285-1b03915a8a47-ovn-node-metrics-cert\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.782590 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.782570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1335911-b6ee-424e-aa17-7354c74cb7df-agent-certs\") pod \"konnectivity-agent-kdnw5\" (UID: \"c1335911-b6ee-424e-aa17-7354c74cb7df\") " pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.801795 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.801729    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:08:59.801795 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.801761    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:08:59.801795 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.801777    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:08:59.802007 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:08:59.801846    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:00.301827237 +0000 UTC m=+3.152444598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:08:59.811940 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.811886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pd6\" (UniqueName: \"kubernetes.io/projected/342911f4-80c9-4231-a515-689ac4198137-kube-api-access-r4pd6\") pod \"iptables-alerter-s5msr\" (UID: \"342911f4-80c9-4231-a515-689ac4198137\") " pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.813596 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.813571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k64sc\" (UniqueName: \"kubernetes.io/projected/34e967b0-1c1e-4bd3-857b-ab8b17896e58-kube-api-access-k64sc\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:08:59.819085 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.819015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzvh\" (UniqueName: \"kubernetes.io/projected/b07dadad-44fe-448e-be3a-82ffcb256bcd-kube-api-access-rmzvh\") pod \"node-ca-9z7ph\" (UID: \"b07dadad-44fe-448e-be3a-82ffcb256bcd\") " pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.821125 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.821103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77k9g\" (UniqueName: \"kubernetes.io/projected/5b208102-e9f9-4842-9285-1b03915a8a47-kube-api-access-77k9g\") pod \"ovnkube-node-85pcp\" (UID: \"5b208102-e9f9-4842-9285-1b03915a8a47\") " pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.859416 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.859387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6vdwm"
Jul 16 21:08:59.866649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.866627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzmr7"
Jul 16 21:08:59.873597 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.873565    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcebb60_ac13_4a00_ae7b_3972d3eaef12.slice/crio-e94c31e3d476464055cf854d05d3fbd14b2e56290112b264558b98a2f1cd64c3 WatchSource:0}: Error finding container e94c31e3d476464055cf854d05d3fbd14b2e56290112b264558b98a2f1cd64c3: Status 404 returned error can't find the container with id e94c31e3d476464055cf854d05d3fbd14b2e56290112b264558b98a2f1cd64c3
Jul 16 21:08:59.878366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.878348    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qd6dl"
Jul 16 21:08:59.879295 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.879273    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c05cdf1_90e6_4aef_88dc_a69726abc1c8.slice/crio-504d3cba69874274163c0dfe7575a58f4680d8f2cd44a5746cb6375f37b6dab9 WatchSource:0}: Error finding container 504d3cba69874274163c0dfe7575a58f4680d8f2cd44a5746cb6375f37b6dab9: Status 404 returned error can't find the container with id 504d3cba69874274163c0dfe7575a58f4680d8f2cd44a5746cb6375f37b6dab9
Jul 16 21:08:59.882270 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.881808    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-94mx7"
Jul 16 21:08:59.890641 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.890489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq"
Jul 16 21:08:59.890935 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.890911    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc455762d_9cf4_4ae5_b705_af06b12ea8f0.slice/crio-f768e330013535a8baeb1bd6801ab21f8e8202bb18d5183f4d6629eae7a0aec4 WatchSource:0}: Error finding container f768e330013535a8baeb1bd6801ab21f8e8202bb18d5183f4d6629eae7a0aec4: Status 404 returned error can't find the container with id f768e330013535a8baeb1bd6801ab21f8e8202bb18d5183f4d6629eae7a0aec4
Jul 16 21:08:59.895014 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.894988    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40fa01ee_376d_4245_99da_9a90e656996e.slice/crio-81de5dcfbc30d456e17e0433dd234c81012ec65a33981632fb6771ab44643818 WatchSource:0}: Error finding container 81de5dcfbc30d456e17e0433dd234c81012ec65a33981632fb6771ab44643818: Status 404 returned error can't find the container with id 81de5dcfbc30d456e17e0433dd234c81012ec65a33981632fb6771ab44643818
Jul 16 21:08:59.898320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.898298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9z7ph"
Jul 16 21:08:59.901536 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.901512    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8c5563_9244_4b03_90ad_7d5f3024b1e8.slice/crio-463e1c8a87d10219b10e7521563f3a20492130fb8fd00bf2d73878bc855a693b WatchSource:0}: Error finding container 463e1c8a87d10219b10e7521563f3a20492130fb8fd00bf2d73878bc855a693b: Status 404 returned error can't find the container with id 463e1c8a87d10219b10e7521563f3a20492130fb8fd00bf2d73878bc855a693b
Jul 16 21:08:59.905680 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.905660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5msr"
Jul 16 21:08:59.908782 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.908671    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07dadad_44fe_448e_be3a_82ffcb256bcd.slice/crio-ebcbb2426759565fb4f568bea85cee63d521f773a465331b0aecc73281b05fb1 WatchSource:0}: Error finding container ebcbb2426759565fb4f568bea85cee63d521f773a465331b0aecc73281b05fb1: Status 404 returned error can't find the container with id ebcbb2426759565fb4f568bea85cee63d521f773a465331b0aecc73281b05fb1
Jul 16 21:08:59.913530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.913510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:08:59.915954 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.915930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342911f4_80c9_4231_a515_689ac4198137.slice/crio-ccac39ddeb5c37f3a360073c244b3d87eab93dd89651970bd3a6fcca4de6b4e2 WatchSource:0}: Error finding container ccac39ddeb5c37f3a360073c244b3d87eab93dd89651970bd3a6fcca4de6b4e2: Status 404 returned error can't find the container with id ccac39ddeb5c37f3a360073c244b3d87eab93dd89651970bd3a6fcca4de6b4e2
Jul 16 21:08:59.918243 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:08:59.918182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:08:59.927579 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.927510    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b208102_e9f9_4842_9285_1b03915a8a47.slice/crio-3d4a932e6d58382cc9daba654b0ebf1a4957e596bfe0bc314f559176d7ef44f1 WatchSource:0}: Error finding container 3d4a932e6d58382cc9daba654b0ebf1a4957e596bfe0bc314f559176d7ef44f1: Status 404 returned error can't find the container with id 3d4a932e6d58382cc9daba654b0ebf1a4957e596bfe0bc314f559176d7ef44f1
Jul 16 21:08:59.930705 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:08:59.930665    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1335911_b6ee_424e_aa17_7354c74cb7df.slice/crio-9f0ca05fc8fcce6448f02467cdb0f2f62cab366e0ec945f03e8ae92b622431d1 WatchSource:0}: Error finding container 9f0ca05fc8fcce6448f02467cdb0f2f62cab366e0ec945f03e8ae92b622431d1: Status 404 returned error can't find the container with id 9f0ca05fc8fcce6448f02467cdb0f2f62cab366e0ec945f03e8ae92b622431d1
Jul 16 21:09:00.281820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.281786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:00.281820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.281821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:00.282080 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.281927    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:00.282080 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.281960    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:00.282080 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.281974    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:01.281960371 +0000 UTC m=+4.132577728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:00.282080 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.282037    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:01.28201892 +0000 UTC m=+4.132636292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:00.382740 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.382696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:00.382906 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.382886    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:00.382946 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.382912    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:00.382946 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.382923    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:00.383024 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.382979    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:01.382961117 +0000 UTC m=+4.233578487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:00.653241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.653106    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:03:59 +0000 UTC" deadline="2028-04-08 06:54:36.636305642 +0000 UTC"
Jul 16 21:09:00.653241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.653185    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15153h45m35.983125929s"
Jul 16 21:09:00.672625 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.672588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:00.672763 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:00.672722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:00.682973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.682922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6vdwm" event={"ID":"1bcebb60-ac13-4a00-ae7b-3972d3eaef12","Type":"ContainerStarted","Data":"e94c31e3d476464055cf854d05d3fbd14b2e56290112b264558b98a2f1cd64c3"}
Jul 16 21:09:00.684285 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.684260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdnw5" event={"ID":"c1335911-b6ee-424e-aa17-7354c74cb7df","Type":"ContainerStarted","Data":"9f0ca05fc8fcce6448f02467cdb0f2f62cab366e0ec945f03e8ae92b622431d1"}
Jul 16 21:09:00.685973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.685894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9z7ph" event={"ID":"b07dadad-44fe-448e-be3a-82ffcb256bcd","Type":"ContainerStarted","Data":"ebcbb2426759565fb4f568bea85cee63d521f773a465331b0aecc73281b05fb1"}
Jul 16 21:09:00.687247 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.687214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-94mx7" event={"ID":"40fa01ee-376d-4245-99da-9a90e656996e","Type":"ContainerStarted","Data":"81de5dcfbc30d456e17e0433dd234c81012ec65a33981632fb6771ab44643818"}
Jul 16 21:09:00.688447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.688418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerStarted","Data":"504d3cba69874274163c0dfe7575a58f4680d8f2cd44a5746cb6375f37b6dab9"}
Jul 16 21:09:00.689914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.689879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"3d4a932e6d58382cc9daba654b0ebf1a4957e596bfe0bc314f559176d7ef44f1"}
Jul 16 21:09:00.692155 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.692130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5msr" event={"ID":"342911f4-80c9-4231-a515-689ac4198137","Type":"ContainerStarted","Data":"ccac39ddeb5c37f3a360073c244b3d87eab93dd89651970bd3a6fcca4de6b4e2"}
Jul 16 21:09:00.693530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.693509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq" event={"ID":"ce8c5563-9244-4b03-90ad-7d5f3024b1e8","Type":"ContainerStarted","Data":"463e1c8a87d10219b10e7521563f3a20492130fb8fd00bf2d73878bc855a693b"}
Jul 16 21:09:00.694728 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:00.694705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qd6dl" event={"ID":"c455762d-9cf4-4ae5-b705-af06b12ea8f0","Type":"ContainerStarted","Data":"f768e330013535a8baeb1bd6801ab21f8e8202bb18d5183f4d6629eae7a0aec4"}
Jul 16 21:09:01.289955 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.289695    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:01.290168 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.289987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:01.290168 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.289936    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:01.290168 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.290136    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:01.290370 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.290141    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:03.290119687 +0000 UTC m=+6.140737053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:01.290370 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.290200    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:03.290183791 +0000 UTC m=+6.140801153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:01.391205 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.391144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:01.391369 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.391312    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:01.391369 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.391331    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:01.391369 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.391343    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:01.391527 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.391399    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:03.391381652 +0000 UTC m=+6.241999010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:01.654122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.654021    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:03:59 +0000 UTC" deadline="2028-03-10 19:46:10.048673844 +0000 UTC"
Jul 16 21:09:01.654122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.654058    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14470h37m8.394620574s"
Jul 16 21:09:01.673686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.673621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:01.673829 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.673788    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:01.673905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.673832    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:01.673957 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:01.673935    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:01.713460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:01.713427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal" event={"ID":"cf30bda94c0cf296cb79742041db8530","Type":"ContainerStarted","Data":"c5064892f305be416d412014773af92485b34ddb46ce9a959cf9a5bbc3d631c5"}
Jul 16 21:09:02.672216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:02.672183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:02.672724 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:02.672312    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:03.309001 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:03.308955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:03.309193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:03.309082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:03.309270 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.309219    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:03.309329 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.309278    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:07.309257838 +0000 UTC m=+10.159875199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:03.309675 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.309648    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:03.310067 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.310038    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:07.309721498 +0000 UTC m=+10.160338879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:03.410282 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:03.410249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:03.410436 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.410393    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:03.410436 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.410412    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:03.410436 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.410424    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:03.410604 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.410497    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:07.410458757 +0000 UTC m=+10.261076126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:03.673366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:03.673228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:03.673366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:03.673270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:03.673854 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.673401    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:03.673854 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:03.673771    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:04.672517 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:04.672484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:04.672691 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:04.672607    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:05.672198 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:05.672165    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:05.672652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:05.672172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:05.672652 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:05.672280    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:05.672652 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:05.672367    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:06.672317 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:06.672274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:06.672739 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:06.672433    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:07.342348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:07.342399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.342563    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.342623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:15.342604324 +0000 UTC m=+18.193221696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.343027    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:07.343125 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.343077    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:15.343060199 +0000 UTC m=+18.193677560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:07.443425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:07.443358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:07.443603 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.443538    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:07.443603 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.443562    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:07.443603 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.443574    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:07.443760 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.443632    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:15.443612001 +0000 UTC m=+18.294229369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:07.673957 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:07.673864    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:07.674361 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.673974    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:07.674456 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:07.674427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:07.674585 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:07.674538    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:08.672536 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:08.672499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:08.672708 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:08.672626    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:09.675575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:09.674902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:09.675575 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:09.675035    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:09.675575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:09.675435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:09.675575 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:09.675519    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:10.672185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:10.672148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:10.672320 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:10.672263    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:11.672464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:11.672433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:11.672922 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:11.672550    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:11.672922 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:11.672585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:11.672922 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:11.672674    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:12.672760 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:12.672728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:12.673211 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:12.672866    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:13.672487 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:13.672452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:13.672667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:13.672452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:13.672667 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:13.672589    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:13.672802 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:13.672659    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:14.672126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:14.672080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:14.672311 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:14.672193    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:15.405741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:15.405700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:15.406170 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:15.405746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:15.406170 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.405877    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:15.406170 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.405948    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:31.405932523 +0000 UTC m=+34.256549878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:15.406294 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.405885    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:15.406294 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.406260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:31.406248259 +0000 UTC m=+34.256865614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:15.507013 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:15.506975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:15.507193 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.507167    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:15.507193 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.507189    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:15.507287 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.507198    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:15.507287 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.507254    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:31.507239265 +0000 UTC m=+34.357856625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:15.674286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:15.674210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:15.674433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:15.674222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:15.674433 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.674332    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:15.674433 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:15.674421    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:16.673050 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:16.672975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:16.673501 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:16.673121    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:17.673737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:17.673705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:17.674358 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:17.673763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:17.674483 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:17.674382    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:17.674483 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:17.674452    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:18.673030 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:18.672998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:18.673230 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:18.673131    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:19.672340 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:19.672302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:19.672816 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:19.672451    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:19.672816 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:19.672504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:19.672816 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:19.672616    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:20.672495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.672166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:20.673196 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:20.672605    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:20.752987 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.752948    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdnw5" event={"ID":"c1335911-b6ee-424e-aa17-7354c74cb7df","Type":"ContainerStarted","Data":"73f9785ad30ee2970d0ce09a852dfad848ef2f142ae623f32c63cfa3354354ba"}
Jul 16 21:09:20.754500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.754467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9z7ph" event={"ID":"b07dadad-44fe-448e-be3a-82ffcb256bcd","Type":"ContainerStarted","Data":"c9b59d7fa5262fdfd17dcf01c9b14b3819e7644d3b4622114946c21467690095"}
Jul 16 21:09:20.756077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.756054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-94mx7" event={"ID":"40fa01ee-376d-4245-99da-9a90e656996e","Type":"ContainerStarted","Data":"6eceae6854c28970e5af4ec2be1228f1e7c0969f5adb80d6082c76ac97ecff74"}
Jul 16 21:09:20.757630 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.757605    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="4ebbbbb5dc1ac08a3721cc09ffa0da2bb913869ec319de263eb3aeaa341f8465" exitCode=0
Jul 16 21:09:20.757710 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.757688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"4ebbbbb5dc1ac08a3721cc09ffa0da2bb913869ec319de263eb3aeaa341f8465"}
Jul 16 21:09:20.759289 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.759263    2559 generic.go:356] "Generic (PLEG): container finished" podID="d95bd52df24e36ca670eaad3c1fa8280" containerID="261d5c5c1e7c20207c1bf75b7ad90ab6444981ac1575c2f367c29edb3cb40dfb" exitCode=0
Jul 16 21:09:20.759373 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.759348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal" event={"ID":"d95bd52df24e36ca670eaad3c1fa8280","Type":"ContainerDied","Data":"261d5c5c1e7c20207c1bf75b7ad90ab6444981ac1575c2f367c29edb3cb40dfb"}
Jul 16 21:09:20.762605 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.762582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"034069003d703140f49752c6bf90cebb6aad81c5aafb98e2b71a5c71ccd68d75"}
Jul 16 21:09:20.762703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.762644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"d77c6172b7b1bd1c04c363eb58679153f6cc070e880fe91b79dcba37a188d0d0"}
Jul 16 21:09:20.762703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.762683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"0a2c676e1867fd95b2b0d719ea6ecf72c1550c31be6a1c460bc7252c9690bb7e"}
Jul 16 21:09:20.762827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.762728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"b949b6fc795260d2b12469bd03ac95547e4ea275ea1b2e2242aef0eacb74ea78"}
Jul 16 21:09:20.764140 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.764116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq" event={"ID":"ce8c5563-9244-4b03-90ad-7d5f3024b1e8","Type":"ContainerStarted","Data":"ffa9b404c16d3ed6f0a022eea22e72795c6c459e1ed5db2e21823ebbdb9034ec"}
Jul 16 21:09:20.765527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.765507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qd6dl" event={"ID":"c455762d-9cf4-4ae5-b705-af06b12ea8f0","Type":"ContainerStarted","Data":"83fb487b59212e183f8d23f3c85361d2401e450aecc87fd9e9423a00b70112c4"}
Jul 16 21:09:20.766941 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.766922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6vdwm" event={"ID":"1bcebb60-ac13-4a00-ae7b-3972d3eaef12","Type":"ContainerStarted","Data":"1f85acb2951c8f11408f9597d57907fa5b943d0b9c13740243957c9918ceda70"}
Jul 16 21:09:20.789816 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.789761    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdnw5" podStartSLOduration=2.619976207 podStartE2EDuration="22.789746487s" totalImagesPullingTime="20.16977028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:20.789371152 +0000 UTC m=+23.639988528" watchObservedRunningTime="2026-07-16 21:09:20.789746487 +0000 UTC m=+23.640363864"
Jul 16 21:09:20.789939 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.789892    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-95.ec2.internal" podStartSLOduration=22.789883419 podStartE2EDuration="22.789883419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:01.746192691 +0000 UTC m=+4.596810072" watchObservedRunningTime="2026-07-16 21:09:20.789883419 +0000 UTC m=+23.640500797"
Jul 16 21:09:20.919883 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:20.919836    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6vdwm" podStartSLOduration=3.633261058 podStartE2EDuration="23.919818237s" totalImagesPullingTime="20.286557179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:20.919573615 +0000 UTC m=+23.770190993" watchObservedRunningTime="2026-07-16 21:09:20.919818237 +0000 UTC m=+23.770435616"
Jul 16 21:09:21.000452 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.000395    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qd6dl" podStartSLOduration=3.790142531 podStartE2EDuration="24.00037191s" totalImagesPullingTime="20.210229379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:20.966893126 +0000 UTC m=+23.817510502" watchObservedRunningTime="2026-07-16 21:09:21.00037191 +0000 UTC m=+23.850989288"
Jul 16 21:09:21.000826 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.000781    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-94mx7" podStartSLOduration=2.79236255 podStartE2EDuration="23.000770632s" totalImagesPullingTime="20.208408082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:21.000470044 +0000 UTC m=+23.851087423" watchObservedRunningTime="2026-07-16 21:09:21.000770632 +0000 UTC m=+23.851388010"
Jul 16 21:09:21.643156 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.643129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:09:21.643760 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.643741    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:09:21.672765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.672740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:21.673149 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:21.672855    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:21.673149 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.672912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:21.673149 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:21.673022    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:21.680040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.679991    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9z7ph" podStartSLOduration=3.488394261 podStartE2EDuration="23.679975663s" totalImagesPullingTime="20.191581402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:21.04043896 +0000 UTC m=+23.891056340" watchObservedRunningTime="2026-07-16 21:09:21.679975663 +0000 UTC m=+24.530593041"
Jul 16 21:09:21.765666 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.765640    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 21:09:21.770771 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.770745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal" event={"ID":"d95bd52df24e36ca670eaad3c1fa8280","Type":"ContainerStarted","Data":"d6adf2796137cf802c0c268b546fa0706ef41e9e8c5a028b7f2751b002034387"}
Jul 16 21:09:21.773588 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.773569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"ce8fe6f767e018c7da651c1529a7d2f344e566c9729fcb39e191e4422b30339c"}
Jul 16 21:09:21.773670 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.773626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"59a1b14ecbf24241d1ba801c298e4e530a96f6f7889a5365e72da4116922e291"}
Jul 16 21:09:21.774869 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.774850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5msr" event={"ID":"342911f4-80c9-4231-a515-689ac4198137","Type":"ContainerStarted","Data":"49858cebf387b2e2256f3b1bfc06543d7860a3f3278f268ad469cdbc8635922d"}
Jul 16 21:09:21.776734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.776712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq" event={"ID":"ce8c5563-9244-4b03-90ad-7d5f3024b1e8","Type":"ContainerStarted","Data":"eb75812ecaafd3db8e919922e15f9e28537e708f8e8d8d64a26527850d3ed881"}
Jul 16 21:09:21.776980 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.776962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:09:21.777436 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.777421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdnw5"
Jul 16 21:09:21.798327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.798292    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-95.ec2.internal" podStartSLOduration=23.798279432 podStartE2EDuration="23.798279432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:21.797976572 +0000 UTC m=+24.648593948" watchObservedRunningTime="2026-07-16 21:09:21.798279432 +0000 UTC m=+24.648896808"
Jul 16 21:09:21.849102 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:21.849058    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5msr" podStartSLOduration=3.664090931 podStartE2EDuration="23.849044525s" totalImagesPullingTime="20.184953594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:21.823043123 +0000 UTC m=+24.673660499" watchObservedRunningTime="2026-07-16 21:09:21.849044525 +0000 UTC m=+24.699662148"
Jul 16 21:09:22.641161 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:22.641038    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:09:21.76566182Z","UUID":"763e85e4-680a-4180-a75f-a8385f289741","Handler":null,"Name":"","Endpoint":""}
Jul 16 21:09:22.642843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:22.642818    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 21:09:22.642968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:22.642865    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 21:09:22.672017 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:22.671984    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:22.672152 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:22.672126    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:23.672333 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:23.672258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:23.672698 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:23.672258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:23.672698 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:23.672388    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:23.672698 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:23.672426    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:23.785321 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:23.785278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"1cd1c532d12423af88c1b654356411c1cca74953329491c8bd454aa577f04c43"}
Jul 16 21:09:23.787569 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:23.787542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq" event={"ID":"ce8c5563-9244-4b03-90ad-7d5f3024b1e8","Type":"ContainerStarted","Data":"76924381e073e93e83842dee5c3ee6be04887a8d2a3feb07a4a9bc5fafd72307"}
Jul 16 21:09:23.813319 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:23.813274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4v6rq" podStartSLOduration=2.846692042 podStartE2EDuration="25.813259703s" totalImagesPullingTime="22.966567661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:23.812117974 +0000 UTC m=+26.662735347" watchObservedRunningTime="2026-07-16 21:09:23.813259703 +0000 UTC m=+26.663877058"
Jul 16 21:09:24.672636 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:24.672465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:24.673001 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:24.672702    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:25.672659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.672572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:25.672659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.672618    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:25.673515 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:25.672709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:25.673515 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:25.672826    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:25.796229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.796186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" event={"ID":"5b208102-e9f9-4842-9285-1b03915a8a47","Type":"ContainerStarted","Data":"3b8e9160e7bc69de8ffd45b47c9a517c30da16be1c712df6a262d6279fc4a9e0"}
Jul 16 21:09:25.796500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.796476    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:25.813318 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.813295    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:25.908633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:25.908575    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp" podStartSLOduration=7.675073359 podStartE2EDuration="27.908556094s" totalImagesPullingTime="20.233482735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:25.858492754 +0000 UTC m=+28.709110135" watchObservedRunningTime="2026-07-16 21:09:25.908556094 +0000 UTC m=+28.759173471"
Jul 16 21:09:26.344665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:26.344629    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:26.672210 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:26.672123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:26.672379 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:26.672260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:26.801126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:26.800972    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:26.819281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:26.819257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:27.673506 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.673294    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:27.673653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.673394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:27.673653 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:27.673616    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:27.673767 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:27.673709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:27.802601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.802573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerStarted","Data":"4ad844b95034e7304a73fde9e704bc68fa8a5953210552e192d6497eb1538b11"}
Jul 16 21:09:27.943998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.943904    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6dvh"]
Jul 16 21:09:27.944158 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.944020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:27.944158 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:27.944141    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:27.945455 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.945431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49q69"]
Jul 16 21:09:27.945543 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.945517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:27.945629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:27.945609    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:27.950824 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.950804    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5wp2"]
Jul 16 21:09:27.950913 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:27.950893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:27.951028 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:27.951005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:28.806219 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:28.806188    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="4ad844b95034e7304a73fde9e704bc68fa8a5953210552e192d6497eb1538b11" exitCode=0
Jul 16 21:09:28.806582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:28.806274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"4ad844b95034e7304a73fde9e704bc68fa8a5953210552e192d6497eb1538b11"}
Jul 16 21:09:29.673111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:29.673063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:29.673264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:29.673063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:29.673264 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:29.673184    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:29.673264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:29.673200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:29.673429 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:29.673303    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:29.673429 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:29.673393    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:29.810933 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:29.810897    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="a935070306e4db0576d3e39ebdd23a204d97fed26bd13fda5e23951882282996" exitCode=0
Jul 16 21:09:29.811266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:29.810943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"a935070306e4db0576d3e39ebdd23a204d97fed26bd13fda5e23951882282996"}
Jul 16 21:09:30.815797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:30.815709    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="ee75b087581de1acc52ac9b255ca539f1f4c93aa33197b4ba5a905409d1afe13" exitCode=0
Jul 16 21:09:30.815797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:30.815775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"ee75b087581de1acc52ac9b255ca539f1f4c93aa33197b4ba5a905409d1afe13"}
Jul 16 21:09:31.424430 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.424257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:31.424590 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.424443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:31.424590 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.424393    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:31.424590 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.424545    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:31.424590 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.424549    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:03.424533556 +0000 UTC m=+66.275150911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:09:31.424707 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.424597    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret podName:b46b0a82-5f3f-4c50-96f4-289e7a0ee231 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:03.424585832 +0000 UTC m=+66.275203187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret") pod "global-pull-secret-syncer-h6dvh" (UID: "b46b0a82-5f3f-4c50-96f4-289e7a0ee231") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:09:31.525032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.525006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:31.525181 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.525140    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:09:31.525181 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.525152    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:09:31.525181 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.525161    2559 projected.go:196] Error preparing data for projected volume kube-api-access-tk7zs for pod openshift-network-diagnostics/network-check-target-49q69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:31.525287 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.525200    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs podName:783dd9d5-c298-4124-a923-a23ae44ce3c9 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:03.525188644 +0000 UTC m=+66.375805999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk7zs" (UniqueName: "kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs") pod "network-check-target-49q69" (UID: "783dd9d5-c298-4124-a923-a23ae44ce3c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:09:31.672986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.672954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:31.673174 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.672954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:31.673174 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.673116    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:31.673296 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.673216    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:31.673296 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:31.672966    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:31.673389 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:31.673316    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:33.672945 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.672908    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:33.673410 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.672948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:33.673410 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.672916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:33.673410 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:33.673037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wp2" podUID="34e967b0-1c1e-4bd3-857b-ab8b17896e58"
Jul 16 21:09:33.673410 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:33.673116    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6dvh" podUID="b46b0a82-5f3f-4c50-96f4-289e7a0ee231"
Jul 16 21:09:33.673410 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:33.673198    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49q69" podUID="783dd9d5-c298-4124-a923-a23ae44ce3c9"
Jul 16 21:09:33.910785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.910702    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-95.ec2.internal" event="NodeReady"
Jul 16 21:09:33.910940 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.910848    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 21:09:33.973484 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:33.973456    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"]
Jul 16 21:09:34.010412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.010371    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"]
Jul 16 21:09:34.010587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.010509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.014717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.014582    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 21:09:34.014717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.014603    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 21:09:34.014717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.014634    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 21:09:34.015504 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.015412    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 21:09:34.015657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.015636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 21:09:34.015747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.015717    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 21:09:34.019011 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.018989    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 21:09:34.024313 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.024289    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"]
Jul 16 21:09:34.024476 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.024456    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.027311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.027293    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 21:09:34.038337 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.038318    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:09:34.038459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.038441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.042198 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.042178    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 21:09:34.042303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.042201    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4974b\""
Jul 16 21:09:34.052450 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"]
Jul 16 21:09:34.052540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052455    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"]
Jul 16 21:09:34.052540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"]
Jul 16 21:09:34.052540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052495    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:09:34.052540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052516    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n6qsw"]
Jul 16 21:09:34.052660 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.052539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.056350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.056239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m22xl\""
Jul 16 21:09:34.056350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.056287    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 21:09:34.056548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.056352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 21:09:34.056795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.056779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 21:09:34.063513 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.063493    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 21:09:34.069838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.069821    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-skzl6"]
Jul 16 21:09:34.069941 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.069927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.073593 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.073577    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 21:09:34.073739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.073726    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmkvr\""
Jul 16 21:09:34.073811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.073738    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 21:09:34.073811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.073729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 21:09:34.095924 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.095908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skzl6"]
Jul 16 21:09:34.096006 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.095935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6qsw"]
Jul 16 21:09:34.096073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.096026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.099242 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.099227    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 21:09:34.099515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.099502    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s8t4\""
Jul 16 21:09:34.099680 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.099668    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 21:09:34.145261 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4rt\" (UniqueName: \"kubernetes.io/projected/13235d2d-6adb-42d9-af27-acc57d0c4417-kube-api-access-4b4rt\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-tmp\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9r8t\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-klusterlet-config\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbpjx\" (UniqueName: \"kubernetes.io/projected/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-kube-api-access-xbpjx\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6nbr\" (UniqueName: \"kubernetes.io/projected/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-kube-api-access-h6nbr\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.145959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.145959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/13235d2d-6adb-42d9-af27-acc57d0c4417-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.145959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.145758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.246470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4rt\" (UniqueName: \"kubernetes.io/projected/13235d2d-6adb-42d9-af27-acc57d0c4417-kube-api-access-4b4rt\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bf83322-6e29-4529-a041-aaf60393f9de-cert\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-tmp\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.246633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9r8t\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-klusterlet-config\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbpjx\" (UniqueName: \"kubernetes.io/projected/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-kube-api-access-xbpjx\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6nbr\" (UniqueName: \"kubernetes.io/projected/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-kube-api-access-h6nbr\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh75x\" (UniqueName: \"kubernetes.io/projected/9bf83322-6e29-4529-a041-aaf60393f9de-kube-api-access-sh75x\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.246929    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.246935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-tmp\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.246974 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.246947    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.247011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:09:34.746994784 +0000 UTC m=+37.597612159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/13235d2d-6adb-42d9-af27-acc57d0c4417-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-tmp-dir\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jvlj\" (UniqueName: \"kubernetes.io/projected/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-kube-api-access-6jvlj\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.247460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-config-volume\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.248005 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.248005 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.247890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.249513 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.248752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.249513 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.249460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/13235d2d-6adb-42d9-af27-acc57d0c4417-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.252447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.252447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.252609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.252967 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.253063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-hub\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.253063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.252995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.253210 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.253064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-klusterlet-config\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.253210 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.253118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/13235d2d-6adb-42d9-af27-acc57d0c4417-ca\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.273652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.273625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6nbr\" (UniqueName: \"kubernetes.io/projected/2f5f91c2-3bd2-45ad-861a-717e18ff02d9-kube-api-access-h6nbr\") pod \"managed-serviceaccount-addon-agent-55b9b468bb-rkq24\" (UID: \"2f5f91c2-3bd2-45ad-861a-717e18ff02d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.274551 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.274525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9r8t\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.275073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.275055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbpjx\" (UniqueName: \"kubernetes.io/projected/10941c3e-15b7-48b8-ac97-c5e77e2e7da5-kube-api-access-xbpjx\") pod \"klusterlet-addon-workmgr-547f4cdc84-jr9mg\" (UID: \"10941c3e-15b7-48b8-ac97-c5e77e2e7da5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.275192 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.275176    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.275245 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.275225    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b4rt\" (UniqueName: \"kubernetes.io/projected/13235d2d-6adb-42d9-af27-acc57d0c4417-kube-api-access-4b4rt\") pod \"cluster-proxy-proxy-agent-67f594cc6f-g2l2s\" (UID: \"13235d2d-6adb-42d9-af27-acc57d0c4417\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.348199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bf83322-6e29-4529-a041-aaf60393f9de-cert\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.348303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.348303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh75x\" (UniqueName: \"kubernetes.io/projected/9bf83322-6e29-4529-a041-aaf60393f9de-kube-api-access-sh75x\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.348303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-tmp-dir\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.348427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jvlj\" (UniqueName: \"kubernetes.io/projected/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-kube-api-access-6jvlj\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.348427 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.348386    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:34.348427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-config-volume\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.348543 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.348443    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:34.848426659 +0000 UTC m=+37.699044015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:34.348754 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-tmp-dir\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.348876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.348860    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-config-volume\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.350422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.350403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bf83322-6e29-4529-a041-aaf60393f9de-cert\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.353299 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.353280    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:09:34.361458 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.361435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh75x\" (UniqueName: \"kubernetes.io/projected/9bf83322-6e29-4529-a041-aaf60393f9de-kube-api-access-sh75x\") pod \"ingress-canary-n6qsw\" (UID: \"9bf83322-6e29-4529-a041-aaf60393f9de\") " pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.361570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.361457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jvlj\" (UniqueName: \"kubernetes.io/projected/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-kube-api-access-6jvlj\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.362339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.362315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:34.368515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.368475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"
Jul 16 21:09:34.392660 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.392646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6qsw"
Jul 16 21:09:34.559285 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.559255    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"]
Jul 16 21:09:34.560756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.560736    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"]
Jul 16 21:09:34.752434 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.752353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:34.753247 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.752510    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:34.753247 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.752528    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:34.753247 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.752589    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:09:35.752574251 +0000 UTC m=+38.603191605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:34.853528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:34.853489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:34.853716 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.853642    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:34.853716 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:34.853707    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:35.853684203 +0000 UTC m=+38.704301557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:35.673179 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.672929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:09:35.673657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.672929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:09:35.673657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.672968    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:09:35.676931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.676908    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:09:35.676931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.676920    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwmds\""
Jul 16 21:09:35.677126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.676925    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:09:35.678320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.678305    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:09:35.678403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.678355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljktf\""
Jul 16 21:09:35.678458 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.678414    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:09:35.762490 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.762458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:35.762841 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:35.762593    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:35.762841 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:35.762611    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:35.762841 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:35.762665    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:09:37.762649951 +0000 UTC m=+40.613267307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:35.863703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:35.863671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:35.863880 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:35.863848    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:35.863932 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:35.863920    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:37.86390339 +0000 UTC m=+40.714520750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:36.032503 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:09:36.032466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13235d2d_6adb_42d9_af27_acc57d0c4417.slice/crio-335b3b47589895e47d2719a479e0c5f22bc2d72b1a0c6bf57286ce6d6b713035 WatchSource:0}: Error finding container 335b3b47589895e47d2719a479e0c5f22bc2d72b1a0c6bf57286ce6d6b713035: Status 404 returned error can't find the container with id 335b3b47589895e47d2719a479e0c5f22bc2d72b1a0c6bf57286ce6d6b713035
Jul 16 21:09:36.033944 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:09:36.033915    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10941c3e_15b7_48b8_ac97_c5e77e2e7da5.slice/crio-86638c7aff25a5b8bff03594d02764324c490a40b07993d04a714af2ea36bcf6 WatchSource:0}: Error finding container 86638c7aff25a5b8bff03594d02764324c490a40b07993d04a714af2ea36bcf6: Status 404 returned error can't find the container with id 86638c7aff25a5b8bff03594d02764324c490a40b07993d04a714af2ea36bcf6
Jul 16 21:09:36.192509 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.192475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24"]
Jul 16 21:09:36.201199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.201183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6qsw"]
Jul 16 21:09:36.235029 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:09:36.234993    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f5f91c2_3bd2_45ad_861a_717e18ff02d9.slice/crio-bc11f7a4cb9bdf2f869f6d2ec89ac4bc8ef192b3783b3101a98b3bb3ab17ec64 WatchSource:0}: Error finding container bc11f7a4cb9bdf2f869f6d2ec89ac4bc8ef192b3783b3101a98b3bb3ab17ec64: Status 404 returned error can't find the container with id bc11f7a4cb9bdf2f869f6d2ec89ac4bc8ef192b3783b3101a98b3bb3ab17ec64
Jul 16 21:09:36.235693 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:09:36.235672    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf83322_6e29_4529_a041_aaf60393f9de.slice/crio-1c35092a296e86c778e52422174050c3448db34950da25b35a7748b079eb2f03 WatchSource:0}: Error finding container 1c35092a296e86c778e52422174050c3448db34950da25b35a7748b079eb2f03: Status 404 returned error can't find the container with id 1c35092a296e86c778e52422174050c3448db34950da25b35a7748b079eb2f03
Jul 16 21:09:36.832953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.832916    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="f920392778ed0c9748226eee9fa836c71b6423e27c05551e55f0e7faec5a97fc" exitCode=0
Jul 16 21:09:36.833462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.833033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"f920392778ed0c9748226eee9fa836c71b6423e27c05551e55f0e7faec5a97fc"}
Jul 16 21:09:36.834686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.834646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6qsw" event={"ID":"9bf83322-6e29-4529-a041-aaf60393f9de","Type":"ContainerStarted","Data":"1c35092a296e86c778e52422174050c3448db34950da25b35a7748b079eb2f03"}
Jul 16 21:09:36.835917 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.835891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg" event={"ID":"10941c3e-15b7-48b8-ac97-c5e77e2e7da5","Type":"ContainerStarted","Data":"86638c7aff25a5b8bff03594d02764324c490a40b07993d04a714af2ea36bcf6"}
Jul 16 21:09:36.837335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.837308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerStarted","Data":"335b3b47589895e47d2719a479e0c5f22bc2d72b1a0c6bf57286ce6d6b713035"}
Jul 16 21:09:36.838444 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:36.838418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24" event={"ID":"2f5f91c2-3bd2-45ad-861a-717e18ff02d9","Type":"ContainerStarted","Data":"bc11f7a4cb9bdf2f869f6d2ec89ac4bc8ef192b3783b3101a98b3bb3ab17ec64"}
Jul 16 21:09:37.784804 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:37.784764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:37.784988 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:37.784974    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:37.785043 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:37.784991    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:37.785118 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:37.785047    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:09:41.785028412 +0000 UTC m=+44.635645772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:37.849148 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:37.849074    2559 generic.go:356] "Generic (PLEG): container finished" podID="0c05cdf1-90e6-4aef-88dc-a69726abc1c8" containerID="6b2d7b1f47478f8ef05c18fcd3d6e327a9ddd8460e548644ba0f68c9b36ca6a1" exitCode=0
Jul 16 21:09:37.849582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:37.849125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerDied","Data":"6b2d7b1f47478f8ef05c18fcd3d6e327a9ddd8460e548644ba0f68c9b36ca6a1"}
Jul 16 21:09:37.885572 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:37.885543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:37.885826 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:37.885808    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:37.885894 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:37.885875    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:41.885855149 +0000 UTC m=+44.736472505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:38.279168 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:38.278894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:38.857598 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:38.857538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" event={"ID":"0c05cdf1-90e6-4aef-88dc-a69726abc1c8","Type":"ContainerStarted","Data":"6376663c4a4c5f5ce5931845b65c422e9a4e5eb346406a159f9134d287e4aaf9"}
Jul 16 21:09:40.449950 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:40.449912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:41.815464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:41.815425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:41.815909 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:41.815566    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:41.815909 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:41.815583    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:41.815909 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:41.815637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:09:49.815623033 +0000 UTC m=+52.666240387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:41.916660 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:41.916620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:41.916867 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:41.916848    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:41.916931 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:41.916905    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:09:49.916890525 +0000 UTC m=+52.767507880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:42.677196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:42.677161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:42.798035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:42.797990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:42.965423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:42.965334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:43.069665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:43.069571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:43.186309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:43.186273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:43.645944 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:43.645837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:43.739182 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:43.739152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.090264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.090234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.216909 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.216871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.563412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.563386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.664518 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.664484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.753977 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.753947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.865843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.865784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.875475 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.875451    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6qsw" event={"ID":"9bf83322-6e29-4529-a041-aaf60393f9de","Type":"ContainerStarted","Data":"2166baa821443f9ccb920a69cc0a718b353020292c24336e9d11cf7913e81363"}
Jul 16 21:09:44.876878 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.876853    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg" event={"ID":"10941c3e-15b7-48b8-ac97-c5e77e2e7da5","Type":"ContainerStarted","Data":"f0d1e8f4851c3cdc5705a9e0187f9d307eda0fbca704d9c45ff8e9647af5cf6d"}
Jul 16 21:09:44.877061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.876976    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:44.878892 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.878852    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg"
Jul 16 21:09:44.878989 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.878971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerStarted","Data":"87c9e2a5847e75fbb333d8b62da5d87e58894bc51c0c099c337e550689beac28"}
Jul 16 21:09:44.879049 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.879001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerStarted","Data":"a62bfc6e2ef299201a843aa340052c8643fed0a1074601ebf71f72d7bc353d53"}
Jul 16 21:09:44.879049 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.879017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerStarted","Data":"12d184458ecab54c9331177ca7744a0181d15b2ac710822b65632d9e1d0f1c33"}
Jul 16 21:09:44.880298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.880281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24" event={"ID":"2f5f91c2-3bd2-45ad-861a-717e18ff02d9","Type":"ContainerStarted","Data":"f3099a5e707e5a644a72d7078c17a4680961f717921dfe8dee698c77756d4ff6"}
Jul 16 21:09:44.899023 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.898984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzmr7" podStartSLOduration=13.790723319 podStartE2EDuration="47.89897282s" totalImagesPullingTime="34.108249501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:38.910185032 +0000 UTC m=+41.760802411" watchObservedRunningTime="2026-07-16 21:09:44.89897282 +0000 UTC m=+47.749590196"
Jul 16 21:09:44.899582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.899558    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n6qsw" podStartSLOduration=3.856147152 podStartE2EDuration="11.899552893s" totalImagesPullingTime="8.043405741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:44.897562876 +0000 UTC m=+47.748180252" watchObservedRunningTime="2026-07-16 21:09:44.899552893 +0000 UTC m=+47.750170260"
Jul 16 21:09:44.919527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.919491    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547f4cdc84-jr9mg" podStartSLOduration=38.661955301 podStartE2EDuration="46.919477917s" totalImagesPullingTime="8.257522616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:44.918484281 +0000 UTC m=+47.769101658" watchObservedRunningTime="2026-07-16 21:09:44.919477917 +0000 UTC m=+47.770095293"
Jul 16 21:09:44.939909 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.939857    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55b9b468bb-rkq24" podStartSLOduration=38.897112516 podStartE2EDuration="46.939841547s" totalImagesPullingTime="8.042729031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:44.938943909 +0000 UTC m=+47.789561286" watchObservedRunningTime="2026-07-16 21:09:44.939841547 +0000 UTC m=+47.790458904"
Jul 16 21:09:44.949791 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.949776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:44.969696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:44.969661    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" podStartSLOduration=38.697228289 podStartE2EDuration="46.969646851s" totalImagesPullingTime="8.272418562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:09:44.969444032 +0000 UTC m=+47.820061447" watchObservedRunningTime="2026-07-16 21:09:44.969646851 +0000 UTC m=+47.820264228"
Jul 16 21:09:45.332857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:45.332827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:45.449817 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:45.449786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:46.050943 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:46.050911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:46.150277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:46.150245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:46.452207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:46.452123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:46.542398 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:46.542367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:49.879339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:49.879303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:09:49.879702 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:49.879426    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:09:49.879702 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:49.879437    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:09:49.879702 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:49.879490    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:10:05.879477606 +0000 UTC m=+68.730094960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:09:49.980477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:49.980441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:09:49.980655 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:49.980608    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:09:49.980726 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:09:49.980680    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:05.980660678 +0000 UTC m=+68.831278053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:09:55.682130 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:55.682084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:58.819889 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:58.819849    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-85pcp"
Jul 16 21:09:59.015750 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:59.015719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:09:59.117152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:09:59.117059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:03.475606 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.475570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:10:03.475606 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.475608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:10:03.480346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.480326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:10:03.481240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.481221    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:10:03.485837 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:03.485820    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 21:10:03.485907 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:03.485885    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs podName:34e967b0-1c1e-4bd3-857b-ab8b17896e58 nodeName:}" failed. No retries permitted until 2026-07-16 21:11:07.485870199 +0000 UTC m=+130.336487555 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs") pod "network-metrics-daemon-g5wp2" (UID: "34e967b0-1c1e-4bd3-857b-ab8b17896e58") : secret "metrics-daemon-secret" not found
Jul 16 21:10:03.490078 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.490058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b46b0a82-5f3f-4c50-96f4-289e7a0ee231-original-pull-secret\") pod \"global-pull-secret-syncer-h6dvh\" (UID: \"b46b0a82-5f3f-4c50-96f4-289e7a0ee231\") " pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:10:03.576811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.576786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:10:03.593031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.592999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6dvh"
Jul 16 21:10:03.613990 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.613967    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:10:03.620751 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.620728    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:10:03.630050 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.630028    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7zs\" (UniqueName: \"kubernetes.io/projected/783dd9d5-c298-4124-a923-a23ae44ce3c9-kube-api-access-tk7zs\") pod \"network-check-target-49q69\" (UID: \"783dd9d5-c298-4124-a923-a23ae44ce3c9\") " pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:10:03.719182 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.719158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6dvh"]
Jul 16 21:10:03.721845 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:03.721821    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46b0a82_5f3f_4c50_96f4_289e7a0ee231.slice/crio-111059ec092df03df28b1979391d1dda82b9f1b9104c1d6f8991ce1237c3cf22 WatchSource:0}: Error finding container 111059ec092df03df28b1979391d1dda82b9f1b9104c1d6f8991ce1237c3cf22: Status 404 returned error can't find the container with id 111059ec092df03df28b1979391d1dda82b9f1b9104c1d6f8991ce1237c3cf22
Jul 16 21:10:03.888919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.888896    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwmds\""
Jul 16 21:10:03.895907 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.895890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:10:03.934760 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:03.934651    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6dvh" event={"ID":"b46b0a82-5f3f-4c50-96f4-289e7a0ee231","Type":"ContainerStarted","Data":"111059ec092df03df28b1979391d1dda82b9f1b9104c1d6f8991ce1237c3cf22"}
Jul 16 21:10:04.020715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:04.020634    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49q69"]
Jul 16 21:10:04.025265 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:04.025229    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783dd9d5_c298_4124_a923_a23ae44ce3c9.slice/crio-9027609d43ed3cb8aa0a4ed15fd52316aaf91985f9987aba4b9f6ad867e355b2 WatchSource:0}: Error finding container 9027609d43ed3cb8aa0a4ed15fd52316aaf91985f9987aba4b9f6ad867e355b2: Status 404 returned error can't find the container with id 9027609d43ed3cb8aa0a4ed15fd52316aaf91985f9987aba4b9f6ad867e355b2
Jul 16 21:10:04.373246 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:04.373171    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:04.478780 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:04.478755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:04.558396 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:04.558368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:04.939809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:04.939770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49q69" event={"ID":"783dd9d5-c298-4124-a923-a23ae44ce3c9","Type":"ContainerStarted","Data":"9027609d43ed3cb8aa0a4ed15fd52316aaf91985f9987aba4b9f6ad867e355b2"}
Jul 16 21:10:05.183957 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.183921    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"]
Jul 16 21:10:05.187717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.187693    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"
Jul 16 21:10:05.197566 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.197547    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8kbwq\""
Jul 16 21:10:05.199069 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.199050    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.199188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.199056    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.205968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.205937    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"]
Jul 16 21:10:05.288700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.288673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4x4r\" (UniqueName: \"kubernetes.io/projected/4058cd78-c208-4e9b-a81e-4b091d39bceb-kube-api-access-w4x4r\") pod \"volume-data-source-validator-78cf4c6f6-7g9db\" (UID: \"4058cd78-c208-4e9b-a81e-4b091d39bceb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"
Jul 16 21:10:05.330975 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.330944    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vbvfs"]
Jul 16 21:10:05.334565 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.334544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.343684 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.343661    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 21:10:05.344024 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.343993    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7td54\""
Jul 16 21:10:05.345849 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.345829    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.347519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.347500    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.351595 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.351574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 21:10:05.353646 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.353628    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 21:10:05.367581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.367560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vbvfs"]
Jul 16 21:10:05.389610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wjrk\" (UniqueName: \"kubernetes.io/projected/feefd622-acb8-49d2-bf3a-f1d94ec42d16-kube-api-access-8wjrk\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.389706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4x4r\" (UniqueName: \"kubernetes.io/projected/4058cd78-c208-4e9b-a81e-4b091d39bceb-kube-api-access-w4x4r\") pod \"volume-data-source-validator-78cf4c6f6-7g9db\" (UID: \"4058cd78-c208-4e9b-a81e-4b091d39bceb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"
Jul 16 21:10:05.389766 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feefd622-acb8-49d2-bf3a-f1d94ec42d16-serving-cert\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.389859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.389920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-tmp\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.389920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-snapshots\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.389920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.389902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-service-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.432745 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.432714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4x4r\" (UniqueName: \"kubernetes.io/projected/4058cd78-c208-4e9b-a81e-4b091d39bceb-kube-api-access-w4x4r\") pod \"volume-data-source-validator-78cf4c6f6-7g9db\" (UID: \"4058cd78-c208-4e9b-a81e-4b091d39bceb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"
Jul 16 21:10:05.460808 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.460740    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"]
Jul 16 21:10:05.464276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.464252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.473260 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.473239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 21:10:05.473409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.473382    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86df8464b4-fb7nr"]
Jul 16 21:10:05.473554 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.473535    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.473752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.473736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-58h4z\""
Jul 16 21:10:05.473961 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.473945    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 21:10:05.474196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.474174    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.476895 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.476875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.482027 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.481993    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 16 21:10:05.482412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.482267    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.482476 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.482462    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 16 21:10:05.482817 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.482796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-np4dm\""
Jul 16 21:10:05.483044 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.483029    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 16 21:10:05.483245 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.483223    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.483431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.483414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feefd622-acb8-49d2-bf3a-f1d94ec42d16-serving-cert\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-tmp\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-snapshots\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-service-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.491761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wjrk\" (UniqueName: \"kubernetes.io/projected/feefd622-acb8-49d2-bf3a-f1d94ec42d16-kube-api-access-8wjrk\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.492076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.491827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-tmp\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.493031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.492850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-service-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.493031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.493001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feefd622-acb8-49d2-bf3a-f1d94ec42d16-snapshots\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.493418 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.493395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feefd622-acb8-49d2-bf3a-f1d94ec42d16-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.495205 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.495187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"]
Jul 16 21:10:05.495743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.495701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feefd622-acb8-49d2-bf3a-f1d94ec42d16-serving-cert\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.498594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.498572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"
Jul 16 21:10:05.502914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.502833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:05.514607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.514548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86df8464b4-fb7nr"]
Jul 16 21:10:05.517158 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.517139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wjrk\" (UniqueName: \"kubernetes.io/projected/feefd622-acb8-49d2-bf3a-f1d94ec42d16-kube-api-access-8wjrk\") pod \"insights-operator-555d9d7885-vbvfs\" (UID: \"feefd622-acb8-49d2-bf3a-f1d94ec42d16\") " pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.530075 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.530014    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"]
Jul 16 21:10:05.533917 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.533897    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"]
Jul 16 21:10:05.534082 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.534063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.539274 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.539222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9mp2p"]
Jul 16 21:10:05.540189 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.539499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.542800 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.542780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.543997 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.543765    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 16 21:10:05.543997 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.543815    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.543997 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.543772    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.547611 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.547593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t4lgp\""
Jul 16 21:10:05.549894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.549462    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.549894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.549729    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.549894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.549767    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.551032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.550990    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 16 21:10:05.551032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.551015    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 21:10:05.551210 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.551152    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.554391 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.551655    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 21:10:05.554391 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.551903    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7r2jt\""
Jul 16 21:10:05.554391 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.552885    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rwb5g\""
Jul 16 21:10:05.554391 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.553159    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 16 21:10:05.560645 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.560019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"]
Jul 16 21:10:05.566944 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.564853    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"]
Jul 16 21:10:05.572029 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.571814    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9mp2p"]
Jul 16 21:10:05.572160 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.572105    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.591912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b78486-f6a7-428d-b8af-f00f3f2e403f-serving-cert\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.591972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ad221-26bc-4b94-b3a5-37477c598d1c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-stats-auth\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53ad221-26bc-4b94-b3a5-37477c598d1c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzzc5\" (UniqueName: \"kubernetes.io/projected/82ef6627-388a-4cc4-9445-6545744d96ea-kube-api-access-mzzc5\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46mc7\" (UniqueName: \"kubernetes.io/projected/746624e4-340d-43ba-a4ee-2f62de26e0d0-kube-api-access-46mc7\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6s7c\" (UniqueName: \"kubernetes.io/projected/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-kube-api-access-h6s7c\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-trusted-ca\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-config\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x58qd\" (UniqueName: \"kubernetes.io/projected/e2b78486-f6a7-428d-b8af-f00f3f2e403f-kube-api-access-x58qd\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-default-certificate\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.592649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.593382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jdt4\" (UniqueName: \"kubernetes.io/projected/a53ad221-26bc-4b94-b3a5-37477c598d1c-kube-api-access-5jdt4\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.593382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.593382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.592430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82ef6627-388a-4cc4-9445-6545744d96ea-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.607556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.607360    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"]
Jul 16 21:10:05.611610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.611513    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.615752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.615729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 16 21:10:05.616030 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.615994    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 16 21:10:05.616250 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.616230    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:05.616649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.616628    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 16 21:10:05.616886 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.616866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-khtzc\""
Jul 16 21:10:05.644483 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.644427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"]
Jul 16 21:10:05.645001 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.644756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vbvfs"
Jul 16 21:10:05.685229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.684832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db"]
Jul 16 21:10:05.689901 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:05.689873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4058cd78_c208_4e9b_a81e_4b091d39bceb.slice/crio-37634202cbedfe92ea8330c89751d035b181b9515ba81d4706a731ecee05c33d WatchSource:0}: Error finding container 37634202cbedfe92ea8330c89751d035b181b9515ba81d4706a731ecee05c33d: Status 404 returned error can't find the container with id 37634202cbedfe92ea8330c89751d035b181b9515ba81d4706a731ecee05c33d
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-trusted-ca\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-config\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58qd\" (UniqueName: \"kubernetes.io/projected/e2b78486-f6a7-428d-b8af-f00f3f2e403f-kube-api-access-x58qd\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-default-certificate\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-config\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jdt4\" (UniqueName: \"kubernetes.io/projected/a53ad221-26bc-4b94-b3a5-37477c598d1c-kube-api-access-5jdt4\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82ef6627-388a-4cc4-9445-6545744d96ea-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b78486-f6a7-428d-b8af-f00f3f2e403f-serving-cert\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ad221-26bc-4b94-b3a5-37477c598d1c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-stats-auth\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.695110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53ad221-26bc-4b94-b3a5-37477c598d1c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzzc5\" (UniqueName: \"kubernetes.io/projected/82ef6627-388a-4cc4-9445-6545744d96ea-kube-api-access-mzzc5\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.694926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46mc7\" (UniqueName: \"kubernetes.io/projected/746624e4-340d-43ba-a4ee-2f62de26e0d0-kube-api-access-46mc7\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.695008    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.695070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:06.195050321 +0000 UTC m=+69.045667684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.695688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53ad221-26bc-4b94-b3a5-37477c598d1c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.695751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.695781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6s7c\" (UniqueName: \"kubernetes.io/projected/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-kube-api-access-h6s7c\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.695812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlk5q\" (UniqueName: \"kubernetes.io/projected/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-kube-api-access-dlk5q\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.695906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-trusted-ca\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.695982    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:06.195963629 +0000 UTC m=+69.046581001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.696356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2b78486-f6a7-428d-b8af-f00f3f2e403f-config\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.696444    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.696486    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:06.196473043 +0000 UTC m=+69.047090427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:05.698403 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.696538    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:05.699197 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.696570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:06.196559569 +0000 UTC m=+69.047176929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:05.699197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.697221    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82ef6627-388a-4cc4-9445-6545744d96ea-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.699197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.698430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-stats-auth\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.699197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.698678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ad221-26bc-4b94-b3a5-37477c598d1c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.699197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.698715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2b78486-f6a7-428d-b8af-f00f3f2e403f-serving-cert\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.699479 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.699302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:05.699753 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.699713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-default-certificate\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.719202 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.718855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6s7c\" (UniqueName: \"kubernetes.io/projected/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-kube-api-access-h6s7c\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:05.719202 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.719111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jdt4\" (UniqueName: \"kubernetes.io/projected/a53ad221-26bc-4b94-b3a5-37477c598d1c-kube-api-access-5jdt4\") pod \"kube-storage-version-migrator-operator-7658d9b749-whrc7\" (UID: \"a53ad221-26bc-4b94-b3a5-37477c598d1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.719873 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.719841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58qd\" (UniqueName: \"kubernetes.io/projected/e2b78486-f6a7-428d-b8af-f00f3f2e403f-kube-api-access-x58qd\") pod \"console-operator-565b7b569d-9mp2p\" (UID: \"e2b78486-f6a7-428d-b8af-f00f3f2e403f\") " pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.719987 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.719958    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzzc5\" (UniqueName: \"kubernetes.io/projected/82ef6627-388a-4cc4-9445-6545744d96ea-kube-api-access-mzzc5\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:05.722405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.722365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46mc7\" (UniqueName: \"kubernetes.io/projected/746624e4-340d-43ba-a4ee-2f62de26e0d0-kube-api-access-46mc7\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:05.777552 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.777318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"
Jul 16 21:10:05.798344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.796547    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk5q\" (UniqueName: \"kubernetes.io/projected/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-kube-api-access-dlk5q\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.798344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.796621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.798344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.796648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-config\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.798344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.797334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-config\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.801569 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.801528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.808192 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.808145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlk5q\" (UniqueName: \"kubernetes.io/projected/5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc-kube-api-access-dlk5q\") pod \"service-ca-operator-5bcbc94c78-t6m69\" (UID: \"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.816159 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.816028    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vbvfs"]
Jul 16 21:10:05.822664 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:05.822636    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeefd622_acb8_49d2_bf3a_f1d94ec42d16.slice/crio-542db25f3ef5137f63dbaf9cb632b35c2152e9a26dd1773a7d063ad99afed576 WatchSource:0}: Error finding container 542db25f3ef5137f63dbaf9cb632b35c2152e9a26dd1773a7d063ad99afed576: Status 404 returned error can't find the container with id 542db25f3ef5137f63dbaf9cb632b35c2152e9a26dd1773a7d063ad99afed576
Jul 16 21:10:05.850768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.850717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:05.874145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.874053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:05.897875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.897845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:10:05.898078 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.898060    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:10:05.898195 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.898082    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66885f4994-d7z85: secret "image-registry-tls" not found
Jul 16 21:10:05.898269 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.898219    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls podName:1f805715-2ef2-4e42-9452-573a7d889c1b nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.898137039 +0000 UTC m=+100.748754418 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls") pod "image-registry-66885f4994-d7z85" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b") : secret "image-registry-tls" not found
Jul 16 21:10:05.923596 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.923395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"
Jul 16 21:10:05.947002 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.946962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db" event={"ID":"4058cd78-c208-4e9b-a81e-4b091d39bceb","Type":"ContainerStarted","Data":"37634202cbedfe92ea8330c89751d035b181b9515ba81d4706a731ecee05c33d"}
Jul 16 21:10:05.948403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.948373    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vbvfs" event={"ID":"feefd622-acb8-49d2-bf3a-f1d94ec42d16","Type":"ContainerStarted","Data":"542db25f3ef5137f63dbaf9cb632b35c2152e9a26dd1773a7d063ad99afed576"}
Jul 16 21:10:05.952152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.952031    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7"]
Jul 16 21:10:05.955866 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:05.955829    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53ad221_26bc_4b94_b3a5_37477c598d1c.slice/crio-63af7e72eb6936258b4052f2cbc0da6674b4096f0e698156923c371dd00e3712 WatchSource:0}: Error finding container 63af7e72eb6936258b4052f2cbc0da6674b4096f0e698156923c371dd00e3712: Status 404 returned error can't find the container with id 63af7e72eb6936258b4052f2cbc0da6674b4096f0e698156923c371dd00e3712
Jul 16 21:10:05.978779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.978748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:05.998644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:05.998615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:05.998805 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.998788    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:10:06.001526 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:05.998856    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls podName:6f1dc438-9f9c-48ed-84e6-e7340f2a3827 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.998836624 +0000 UTC m=+100.849453980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls") pod "dns-default-skzl6" (UID: "6f1dc438-9f9c-48ed-84e6-e7340f2a3827") : secret "dns-default-metrics-tls" not found
Jul 16 21:10:06.050559 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.050478    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9mp2p"]
Jul 16 21:10:06.055794 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:06.055761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b78486_f6a7_428d_b8af_f00f3f2e403f.slice/crio-cb208c5fee680ed4538d2e37b2a3b31bb90a3fbb6d266dc31725a075211dc819 WatchSource:0}: Error finding container cb208c5fee680ed4538d2e37b2a3b31bb90a3fbb6d266dc31725a075211dc819: Status 404 returned error can't find the container with id cb208c5fee680ed4538d2e37b2a3b31bb90a3fbb6d266dc31725a075211dc819
Jul 16 21:10:06.099959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.099932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69"]
Jul 16 21:10:06.102038 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:06.101885    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3d6c4d_1ed7_4433_a910_cf1e95dd07dc.slice/crio-d3f2bf87b0e2bb3f8beb2ab11f46ded1254efcab7e0fc30c0fe404958ead6773 WatchSource:0}: Error finding container d3f2bf87b0e2bb3f8beb2ab11f46ded1254efcab7e0fc30c0fe404958ead6773: Status 404 returned error can't find the container with id d3f2bf87b0e2bb3f8beb2ab11f46ded1254efcab7e0fc30c0fe404958ead6773
Jul 16 21:10:06.200057 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.200017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:06.200222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.200120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:06.200222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.200173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:06.200293 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.200222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:06.200362 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200348    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:06.200421 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200411    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:07.200392266 +0000 UTC m=+70.051009625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:06.200782 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200758    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:06.200887 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200809    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:07.200793674 +0000 UTC m=+70.051411029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:06.200887 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200859    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:07.200852369 +0000 UTC m=+70.051469724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:06.201004 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200910    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:06.201004 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:06.200931    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:07.200925137 +0000 UTC m=+70.051542491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:06.786054 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.785990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:06.899504 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.899429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:06.955309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.955230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69" event={"ID":"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc","Type":"ContainerStarted","Data":"d3f2bf87b0e2bb3f8beb2ab11f46ded1254efcab7e0fc30c0fe404958ead6773"}
Jul 16 21:10:06.957918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.957845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7" event={"ID":"a53ad221-26bc-4b94-b3a5-37477c598d1c","Type":"ContainerStarted","Data":"63af7e72eb6936258b4052f2cbc0da6674b4096f0e698156923c371dd00e3712"}
Jul 16 21:10:06.960777 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:06.960705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" event={"ID":"e2b78486-f6a7-428d-b8af-f00f3f2e403f","Type":"ContainerStarted","Data":"cb208c5fee680ed4538d2e37b2a3b31bb90a3fbb6d266dc31725a075211dc819"}
Jul 16 21:10:07.025489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.025457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:07.210369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.210266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:07.210369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.210341    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:07.210576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.210397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:07.210576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.210472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:07.210692 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.210606    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:07.210692 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.210672    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:09.210651546 +0000 UTC m=+72.061268906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:07.211213 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.211168    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:09.211149366 +0000 UTC m=+72.061766743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:07.211310 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.211258    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:07.211310 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.211296    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:09.211285051 +0000 UTC m=+72.061902415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:07.211417 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.211351    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:07.211417 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:07.211384    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:09.211372996 +0000 UTC m=+72.061990353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:07.728469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.728410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:07.816311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:07.815908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:08.676858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:08.676817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:09.227459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:09.227417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:09.227488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:09.227560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227597    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:09.227615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227658    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227664    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:13.227643946 +0000 UTC m=+76.078261302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227768    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:13.227750673 +0000 UTC m=+76.078368030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227769    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227785    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:13.227775957 +0000 UTC m=+76.078393313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:09.227914 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:09.227811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:13.227798475 +0000 UTC m=+76.078415834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:10.137890 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.137854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:10.166111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.166068    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"]
Jul 16 21:10:10.183820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.183788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"]
Jul 16 21:10:10.183994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.183907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"
Jul 16 21:10:10.188329 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.187429    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qrtvz\""
Jul 16 21:10:10.236116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.236063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkhf\" (UniqueName: \"kubernetes.io/projected/f50337d1-f510-4c65-ab73-53ef58079227-kube-api-access-tdkhf\") pod \"network-check-source-7bc5b6bf85-nmx8t\" (UID: \"f50337d1-f510-4c65-ab73-53ef58079227\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"
Jul 16 21:10:10.337512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.337465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkhf\" (UniqueName: \"kubernetes.io/projected/f50337d1-f510-4c65-ab73-53ef58079227-kube-api-access-tdkhf\") pod \"network-check-source-7bc5b6bf85-nmx8t\" (UID: \"f50337d1-f510-4c65-ab73-53ef58079227\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"
Jul 16 21:10:10.350495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.350469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkhf\" (UniqueName: \"kubernetes.io/projected/f50337d1-f510-4c65-ab73-53ef58079227-kube-api-access-tdkhf\") pod \"network-check-source-7bc5b6bf85-nmx8t\" (UID: \"f50337d1-f510-4c65-ab73-53ef58079227\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"
Jul 16 21:10:10.496244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:10.496209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"
Jul 16 21:10:12.906428 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.906342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t"]
Jul 16 21:10:12.908818 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:12.908791    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50337d1_f510_4c65_ab73_53ef58079227.slice/crio-b198cfd714e27c498d7f269406bf2faa0b4c7c92a27f9b134d78f5bc60777709 WatchSource:0}: Error finding container b198cfd714e27c498d7f269406bf2faa0b4c7c92a27f9b134d78f5bc60777709: Status 404 returned error can't find the container with id b198cfd714e27c498d7f269406bf2faa0b4c7c92a27f9b134d78f5bc60777709
Jul 16 21:10:12.983775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.983729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db" event={"ID":"4058cd78-c208-4e9b-a81e-4b091d39bceb","Type":"ContainerStarted","Data":"11b1de9632ab8114a3b2cb8e55d0b466f7aceec0d625175e9287ae5aae575690"}
Jul 16 21:10:12.985662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.985635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7" event={"ID":"a53ad221-26bc-4b94-b3a5-37477c598d1c","Type":"ContainerStarted","Data":"c4e9648e2b6968d3c80b6e95b887dcadd07277535508d5cf1c741219e544dd79"}
Jul 16 21:10:12.987465 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.987429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" event={"ID":"e2b78486-f6a7-428d-b8af-f00f3f2e403f","Type":"ContainerStarted","Data":"add342fbca7abca1c4a16ff1e9f513296a59f9e9a0c451c86ad25a0334a7f7f3"}
Jul 16 21:10:12.987875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.987845    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:12.988858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.988827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t" event={"ID":"f50337d1-f510-4c65-ab73-53ef58079227","Type":"ContainerStarted","Data":"b198cfd714e27c498d7f269406bf2faa0b4c7c92a27f9b134d78f5bc60777709"}
Jul 16 21:10:12.989181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.989035    2559 patch_prober.go:28] interesting pod/console-operator-565b7b569d-9mp2p container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 16 21:10:12.989181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.989106    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podUID="e2b78486-f6a7-428d-b8af-f00f3f2e403f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 16 21:10:12.990500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.990478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49q69" event={"ID":"783dd9d5-c298-4124-a923-a23ae44ce3c9","Type":"ContainerStarted","Data":"75d896a7ee135b6e8e48692b9988222ef786e185e3bf73cc3f62642bc036f9dd"}
Jul 16 21:10:12.990620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:12.990605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:10:13.022675 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.022634    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7g9db" podStartSLOduration=0.935726213 podStartE2EDuration="8.022619939s" totalImagesPullingTime="7.086893726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:13.021409264 +0000 UTC m=+75.872026640" watchObservedRunningTime="2026-07-16 21:10:13.022619939 +0000 UTC m=+75.873237294"
Jul 16 21:10:13.062568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.062350    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podStartSLOduration=1.341886899 podStartE2EDuration="8.062333844s" totalImagesPullingTime="6.720446945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:13.06152457 +0000 UTC m=+75.912141948" watchObservedRunningTime="2026-07-16 21:10:13.062333844 +0000 UTC m=+75.912951221"
Jul 16 21:10:13.123182 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.122635    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-49q69" podStartSLOduration=66.37088658 podStartE2EDuration="1m15.122616961s" totalImagesPullingTime="8.751730381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:13.090155969 +0000 UTC m=+75.940773345" watchObservedRunningTime="2026-07-16 21:10:13.122616961 +0000 UTC m=+75.973234339"
Jul 16 21:10:13.123842 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.123802    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7" podStartSLOduration=1.30362556 podStartE2EDuration="8.12378752s" totalImagesPullingTime="6.82016196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:13.122795194 +0000 UTC m=+75.973412565" watchObservedRunningTime="2026-07-16 21:10:13.12378752 +0000 UTC m=+75.974404898"
Jul 16 21:10:13.209759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.209663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:13.263522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.263495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:13.263629 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.263555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:13.263629 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.263606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:13.263736 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263667    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:21.263646479 +0000 UTC m=+84.114263841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:13.263736 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263726    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263731    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263777    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:21.263760863 +0000 UTC m=+84.114378265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.263723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263785    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263799    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:21.263783268 +0000 UTC m=+84.114400645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:13.263848 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:13.263821    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:21.26381198 +0000 UTC m=+84.114429340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:13.299923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.299819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:13.997158 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.997123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69" event={"ID":"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc","Type":"ContainerStarted","Data":"e86439e6573b50b9ad40ea8b2e0418cd21fc570014c6dd114b2432c50c6bb214"}
Jul 16 21:10:13.998840 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:13.998808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t" event={"ID":"f50337d1-f510-4c65-ab73-53ef58079227","Type":"ContainerStarted","Data":"1efd1f9a0e1fd7e6b053dc1babcab07919205f2a2da91a617dd6c8af55d29612"}
Jul 16 21:10:14.000470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.000442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6dvh" event={"ID":"b46b0a82-5f3f-4c50-96f4-289e7a0ee231","Type":"ContainerStarted","Data":"a1a8cfbaa36d7d07c43277dd12e5395320b4b51adfdf03d50d9bee60cfb99304"}
Jul 16 21:10:14.002061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.002035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vbvfs" event={"ID":"feefd622-acb8-49d2-bf3a-f1d94ec42d16","Type":"ContainerStarted","Data":"9cfba2eed43d461b1826500f4800d1829678d43e8ecfcf5bca4052797d5ccb9e"}
Jul 16 21:10:14.003712 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.003695    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/0.log"
Jul 16 21:10:14.003818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.003729    2559 generic.go:356] "Generic (PLEG): container finished" podID="e2b78486-f6a7-428d-b8af-f00f3f2e403f" containerID="add342fbca7abca1c4a16ff1e9f513296a59f9e9a0c451c86ad25a0334a7f7f3" exitCode=255
Jul 16 21:10:14.003818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.003787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" event={"ID":"e2b78486-f6a7-428d-b8af-f00f3f2e403f","Type":"ContainerDied","Data":"add342fbca7abca1c4a16ff1e9f513296a59f9e9a0c451c86ad25a0334a7f7f3"}
Jul 16 21:10:14.004258 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.003991    2559 scope.go:117] "RemoveContainer" containerID="add342fbca7abca1c4a16ff1e9f513296a59f9e9a0c451c86ad25a0334a7f7f3"
Jul 16 21:10:14.036583 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.033281    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69" podStartSLOduration=1.973626227 podStartE2EDuration="9.033262327s" totalImagesPullingTime="7.0596361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:14.03085586 +0000 UTC m=+76.881473240" watchObservedRunningTime="2026-07-16 21:10:14.033262327 +0000 UTC m=+76.883879709"
Jul 16 21:10:14.107654 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.107608    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h6dvh" podStartSLOduration=67.052318789 podStartE2EDuration="1m16.107588328s" totalImagesPullingTime="9.055269539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:14.105409183 +0000 UTC m=+76.956026563" watchObservedRunningTime="2026-07-16 21:10:14.107588328 +0000 UTC m=+76.958205707"
Jul 16 21:10:14.107879 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.107848    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nmx8t" podStartSLOduration=4.107837016 podStartE2EDuration="4.107837016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:14.067280972 +0000 UTC m=+76.917898351" watchObservedRunningTime="2026-07-16 21:10:14.107837016 +0000 UTC m=+76.958454388"
Jul 16 21:10:14.151016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.150970    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-vbvfs" podStartSLOduration=2.197225982 podStartE2EDuration="9.150951054s" totalImagesPullingTime="6.953725072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:14.149409431 +0000 UTC m=+77.000026800" watchObservedRunningTime="2026-07-16 21:10:14.150951054 +0000 UTC m=+77.001568431"
Jul 16 21:10:14.626432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.626398    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zfzhj"]
Jul 16 21:10:14.653247 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.653216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.654321 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.654253    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zfzhj"]
Jul 16 21:10:14.657148 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.657126    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 21:10:14.657308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.657287    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-glgkx\""
Jul 16 21:10:14.657363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.657128    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 21:10:14.701793 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.701765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:14.777877 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.777842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af58baf-edfa-4c49-9839-a4970c127d4a-data-volume\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.778023 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.777908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.778023 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.777945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fdl\" (UniqueName: \"kubernetes.io/projected/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-api-access-t9fdl\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.778023 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.777981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.778220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.778049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af58baf-edfa-4c49-9839-a4970c127d4a-crio-socket\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.823165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.823131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:14.879204 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fdl\" (UniqueName: \"kubernetes.io/projected/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-api-access-t9fdl\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879335 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:14.879246    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:14.879335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879335 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:14.879299    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.379284715 +0000 UTC m=+78.229902071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:14.879550 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af58baf-edfa-4c49-9839-a4970c127d4a-crio-socket\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879550 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af58baf-edfa-4c49-9839-a4970c127d4a-crio-socket\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879550 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:14.879369    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:14.879550 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:14.879486    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.379473385 +0000 UTC m=+78.230090742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:14.879550 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af58baf-edfa-4c49-9839-a4970c127d4a-data-volume\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.879790 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.879687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af58baf-edfa-4c49-9839-a4970c127d4a-data-volume\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:14.894872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:14.894847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fdl\" (UniqueName: \"kubernetes.io/projected/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-api-access-t9fdl\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:15.009438 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.009411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:10:15.009903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.009885    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/0.log"
Jul 16 21:10:15.009984 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.009927    2559 generic.go:356] "Generic (PLEG): container finished" podID="e2b78486-f6a7-428d-b8af-f00f3f2e403f" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073" exitCode=255
Jul 16 21:10:15.010045 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.010008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" event={"ID":"e2b78486-f6a7-428d-b8af-f00f3f2e403f","Type":"ContainerDied","Data":"195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"}
Jul 16 21:10:15.010119 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.010082    2559 scope.go:117] "RemoveContainer" containerID="add342fbca7abca1c4a16ff1e9f513296a59f9e9a0c451c86ad25a0334a7f7f3"
Jul 16 21:10:15.010308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.010291    2559 scope.go:117] "RemoveContainer" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"
Jul 16 21:10:15.010494 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.010471    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9mp2p_openshift-console-operator(e2b78486-f6a7-428d-b8af-f00f3f2e403f)\"" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podUID="e2b78486-f6a7-428d-b8af-f00f3f2e403f"
Jul 16 21:10:15.201974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.201888    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"]
Jul 16 21:10:15.243140 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.243109    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"]
Jul 16 21:10:15.243305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.243212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.249756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.249565    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nq9ws\""
Jul 16 21:10:15.249756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.249577    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 21:10:15.249870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.249830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 21:10:15.334280 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.334251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:15.384459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.384416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.384459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.384453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:15.384653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.384573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.384653 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.384634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:15.384653 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.384645    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:15.384837 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.384728    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:15.384837 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.384728    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:16.384708339 +0000 UTC m=+79.235325713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:15.384837 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.384780    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:16.384765856 +0000 UTC m=+79.235383211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:15.460981 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.460915    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:15.485994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.485966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.486252 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.486227    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 21:10:15.486336 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.486323    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert podName:b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd nodeName:}" failed. No retries permitted until 2026-07-16 21:10:15.986295406 +0000 UTC m=+78.836912779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jhxd9" (UID: "b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd") : secret "networking-console-plugin-cert" not found
Jul 16 21:10:15.486411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.486371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.487000 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.486982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.613290 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.613260    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-94mx7_40fa01ee-376d-4245-99da-9a90e656996e/dns-node-resolver/0.log"
Jul 16 21:10:15.636083 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.636049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:15.656612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.656579    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"]
Jul 16 21:10:15.673858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.673836    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"
Jul 16 21:10:15.682891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.682871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k98pc\""
Jul 16 21:10:15.683257 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.683240    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 21:10:15.683359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.683337    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 21:10:15.683805 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.683785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"]
Jul 16 21:10:15.774617 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.774590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:15.788362 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.788342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdjn\" (UniqueName: \"kubernetes.io/projected/ba4658ff-14d1-47e9-b58e-44c9d851b640-kube-api-access-cpdjn\") pod \"migrator-7cc9c7ffd7-hvktf\" (UID: \"ba4658ff-14d1-47e9-b58e-44c9d851b640\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"
Jul 16 21:10:15.874655 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.874633    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:15.887526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.887495    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:15.889510 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.889493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdjn\" (UniqueName: \"kubernetes.io/projected/ba4658ff-14d1-47e9-b58e-44c9d851b640-kube-api-access-cpdjn\") pod \"migrator-7cc9c7ffd7-hvktf\" (UID: \"ba4658ff-14d1-47e9-b58e-44c9d851b640\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"
Jul 16 21:10:15.900447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.900430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdjn\" (UniqueName: \"kubernetes.io/projected/ba4658ff-14d1-47e9-b58e-44c9d851b640-kube-api-access-cpdjn\") pod \"migrator-7cc9c7ffd7-hvktf\" (UID: \"ba4658ff-14d1-47e9-b58e-44c9d851b640\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"
Jul 16 21:10:15.983159 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.983135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"
Jul 16 21:10:15.990644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:15.990616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:15.990759 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.990743    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 21:10:15.990825 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:15.990811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert podName:b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd nodeName:}" failed. No retries permitted until 2026-07-16 21:10:16.990792981 +0000 UTC m=+79.841410351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jhxd9" (UID: "b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd") : secret "networking-console-plugin-cert" not found
Jul 16 21:10:16.015027 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.015005    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:10:16.015446 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.015430    2559 scope.go:117] "RemoveContainer" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"
Jul 16 21:10:16.015629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.015608    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9mp2p_openshift-console-operator(e2b78486-f6a7-428d-b8af-f00f3f2e403f)\"" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podUID="e2b78486-f6a7-428d-b8af-f00f3f2e403f"
Jul 16 21:10:16.138776 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.138754    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf"]
Jul 16 21:10:16.140119 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:16.140075    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4658ff_14d1_47e9_b58e_44c9d851b640.slice/crio-2f429f9aac216918ba086ffcb62c9ce0538ad82ffefc8773c15a245282ca16c0 WatchSource:0}: Error finding container 2f429f9aac216918ba086ffcb62c9ce0538ad82ffefc8773c15a245282ca16c0: Status 404 returned error can't find the container with id 2f429f9aac216918ba086ffcb62c9ce0538ad82ffefc8773c15a245282ca16c0
Jul 16 21:10:16.394531 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.394460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:16.394667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.394533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:16.394667 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.394593    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:16.394667 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.394661    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.394645322 +0000 UTC m=+81.245262676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:16.394784 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.394671    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:16.394784 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.394717    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.394700738 +0000 UTC m=+81.245318117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:16.482426 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.482379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:16.592735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.592717    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9z7ph_b07dadad-44fe-448e-be3a-82ffcb256bcd/node-ca/0.log"
Jul 16 21:10:16.596328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.596303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:16.710041 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.708894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:16.999524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:16.999487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:16.999787 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.999652    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 21:10:16.999787 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:16.999727    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert podName:b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd nodeName:}" failed. No retries permitted until 2026-07-16 21:10:18.999710895 +0000 UTC m=+81.850328268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jhxd9" (UID: "b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd") : secret "networking-console-plugin-cert" not found
Jul 16 21:10:17.020578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:17.020548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf" event={"ID":"ba4658ff-14d1-47e9-b58e-44c9d851b640","Type":"ContainerStarted","Data":"2f429f9aac216918ba086ffcb62c9ce0538ad82ffefc8773c15a245282ca16c0"}
Jul 16 21:10:17.020967 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:17.020841    2559 scope.go:117] "RemoveContainer" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"
Jul 16 21:10:17.021029 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:17.021001    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9mp2p_openshift-console-operator(e2b78486-f6a7-428d-b8af-f00f3f2e403f)\"" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podUID="e2b78486-f6a7-428d-b8af-f00f3f2e403f"
Jul 16 21:10:17.391529 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:17.391435    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6qsw_9bf83322-6e29-4529-a041-aaf60393f9de/serve-healthcheck-canary/0.log"
Jul 16 21:10:17.686033 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:17.685950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:17.772938 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:17.772906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:18.024388 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:18.024367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf" event={"ID":"ba4658ff-14d1-47e9-b58e-44c9d851b640","Type":"ContainerStarted","Data":"0ffa8dc040ee93c842f67eeb62473cb4cff0c10c2563978692ad834658c5b5f1"}
Jul 16 21:10:18.371408 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:18.371372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:18.415467 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:18.415434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:18.415629 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:18.415500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:18.415629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:18.415553    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:18.415629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:18.415594    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:18.415629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:18.415614    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:22.415598841 +0000 UTC m=+85.266216195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:18.415629 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:18.415631    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:22.415620203 +0000 UTC m=+85.266237559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:19.020579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:19.020469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:19.020749 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:19.020584    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 21:10:19.020749 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:19.020642    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert podName:b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd nodeName:}" failed. No retries permitted until 2026-07-16 21:10:23.020628728 +0000 UTC m=+85.871246083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jhxd9" (UID: "b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd") : secret "networking-console-plugin-cert" not found
Jul 16 21:10:19.029564 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:19.029537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf" event={"ID":"ba4658ff-14d1-47e9-b58e-44c9d851b640","Type":"ContainerStarted","Data":"a0925b4a766518636ba611b416c4e6f73853c1cb2dad2cbfa68acf09deaeed4f"}
Jul 16 21:10:20.955891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:20.955858    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:21.120376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:21.120336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:21.340228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:21.340199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:21.340421 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:21.340250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:21.340421 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:21.340290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:21.340421 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:21.340328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:21.340421 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340371    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:21.340421 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340421    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 21:10:21.340674 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340445    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 21:10:21.340674 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340447    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls podName:82ef6627-388a-4cc4-9445-6545744d96ea nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.340427184 +0000 UTC m=+100.191044559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tgkl" (UID: "82ef6627-388a-4cc4-9445-6545744d96ea") : secret "cluster-monitoring-operator-tls" not found
Jul 16 21:10:21.340674 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340498    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.34048205 +0000 UTC m=+100.191099405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : configmap references non-existent config key: service-ca.crt
Jul 16 21:10:21.340674 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs podName:de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.340504806 +0000 UTC m=+100.191122164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs") pod "router-default-86df8464b4-fb7nr" (UID: "de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1") : secret "router-metrics-certs-default" not found
Jul 16 21:10:21.340674 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:21.340527    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls podName:746624e4-340d-43ba-a4ee-2f62de26e0d0 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:37.340521295 +0000 UTC m=+100.191138650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-whwtc" (UID: "746624e4-340d-43ba-a4ee-2f62de26e0d0") : secret "samples-operator-tls" not found
Jul 16 21:10:22.449887 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:22.449853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:22.450336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:22.449930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:22.450336 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:22.449972    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:10:22.450336 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:22.450034    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:30.450020869 +0000 UTC m=+93.300638224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : configmap "kube-rbac-proxy" not found
Jul 16 21:10:22.450336 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:22.450112    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:22.450336 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:22.450178    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:30.4501605 +0000 UTC m=+93.300777863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:22.988172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:22.988138    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:22.988536 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:22.988518    2559 scope.go:117] "RemoveContainer" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"
Jul 16 21:10:22.988708 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:22.988687    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9mp2p_openshift-console-operator(e2b78486-f6a7-428d-b8af-f00f3f2e403f)\"" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" podUID="e2b78486-f6a7-428d-b8af-f00f3f2e403f"
Jul 16 21:10:23.054896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.054870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:23.055030 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:23.055010    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 21:10:23.055070 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:23.055065    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert podName:b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd nodeName:}" failed. No retries permitted until 2026-07-16 21:10:31.055050427 +0000 UTC m=+93.905667782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jhxd9" (UID: "b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd") : secret "networking-console-plugin-cert" not found
Jul 16 21:10:23.120974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.120941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.237109 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.237063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.336397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.336325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.483252 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.483214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.599682 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.599604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.726329 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.726293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:23.824157 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:23.824127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:24.215079 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:24.215048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:24.310342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:24.310312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:24.617402 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:24.617310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:25.211736 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:25.211698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:25.429700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:25.429665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:25.660561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:25.660532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:26.021278 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:26.021247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:26.602511 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:26.602477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.024567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.024539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.167249 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.167218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.277213 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.277130    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.421212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.421183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.684707 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.684638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:27.988070 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:27.988035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:28.106537 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:28.106507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:28.836106 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:28.836070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:29.228162 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:29.228129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:29.459133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:29.459085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:29.672789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:29.672709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:29.813673 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:29.813636    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:30.248699 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:30.248665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:30.522794 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:30.522702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:30.522946 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:30.522828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:30.522946 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:30.522847    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:30.522946 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:30.522910    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls podName:8af58baf-edfa-4c49-9839-a4970c127d4a nodeName:}" failed. No retries permitted until 2026-07-16 21:10:46.522889488 +0000 UTC m=+109.373506844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zfzhj" (UID: "8af58baf-edfa-4c49-9839-a4970c127d4a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:10:30.523353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:30.523334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af58baf-edfa-4c49-9839-a4970c127d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:31.040045 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.040012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:31.127816 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.127789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:31.130238 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.130211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jhxd9\" (UID: \"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:31.152165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.152149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"
Jul 16 21:10:31.243810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.243769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:31.295718 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.295633    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hvktf" podStartSLOduration=14.631208411 podStartE2EDuration="16.295616899s" totalImagesPullingTime="1.664408488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:19.051697291 +0000 UTC m=+81.902314667" watchObservedRunningTime="2026-07-16 21:10:31.295616899 +0000 UTC m=+94.146234276"
Jul 16 21:10:31.296161 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.296144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9"]
Jul 16 21:10:31.298647 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:31.298625    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cfa9ff_8f43_4367_a6d2_bcc8122e8bfd.slice/crio-319773ad017f46489bbd90434f5ee6497bbbfc0e57bad048d1edb16f1f958a9e WatchSource:0}: Error finding container 319773ad017f46489bbd90434f5ee6497bbbfc0e57bad048d1edb16f1f958a9e: Status 404 returned error can't find the container with id 319773ad017f46489bbd90434f5ee6497bbbfc0e57bad048d1edb16f1f958a9e
Jul 16 21:10:31.490353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.490295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:31.627073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.626994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:31.831277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:31.831246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:32.073507 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:32.073475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9" event={"ID":"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd","Type":"ContainerStarted","Data":"319773ad017f46489bbd90434f5ee6497bbbfc0e57bad048d1edb16f1f958a9e"}
Jul 16 21:10:33.008724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:33.008684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:33.201770 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:33.201728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:33.415441 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:33.415362    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:33.601594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:33.601560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:33.810058 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:33.810028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:34.081649 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:34.081575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9" event={"ID":"b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd","Type":"ContainerStarted","Data":"98ada2087bf3873a2bdf48795efe8aa173804de65bc7837d296eb9a64c565a06"}
Jul 16 21:10:34.115178 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:34.115132    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jhxd9" podStartSLOduration=17.391854838 podStartE2EDuration="19.115116819s" totalImagesPullingTime="1.723261981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:34.114167763 +0000 UTC m=+96.964785140" watchObservedRunningTime="2026-07-16 21:10:34.115116819 +0000 UTC m=+96.965734189"
Jul 16 21:10:37.382454 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.382420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:37.382809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.382474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:37.382809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.382508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:37.382809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.382536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:37.383194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.383167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-service-ca-bundle\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:37.385022 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.384988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82ef6627-388a-4cc4-9445-6545744d96ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tgkl\" (UID: \"82ef6627-388a-4cc4-9445-6545744d96ea\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:37.385236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.385214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1-metrics-certs\") pod \"router-default-86df8464b4-fb7nr\" (UID: \"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1\") " pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:37.385283 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.385219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/746624e4-340d-43ba-a4ee-2f62de26e0d0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-whwtc\" (UID: \"746624e4-340d-43ba-a4ee-2f62de26e0d0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:37.587619 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.587585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:37.650117 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.650057    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"
Jul 16 21:10:37.658907 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.658884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"
Jul 16 21:10:37.675421 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.675398    2559 scope.go:117] "RemoveContainer" containerID="195d040bc3453cbba775d34d441120de2f778ae2267c8b68e13639318fc3f073"
Jul 16 21:10:37.766015 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:37.765986    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3e5d1d_6f5a_42cb_a88d_a8d31896c3c1.slice/crio-3da57adf89dc5ae98cbabdc3350713874b70ede6949b0518e93dba5de8bf754d WatchSource:0}: Error finding container 3da57adf89dc5ae98cbabdc3350713874b70ede6949b0518e93dba5de8bf754d: Status 404 returned error can't find the container with id 3da57adf89dc5ae98cbabdc3350713874b70ede6949b0518e93dba5de8bf754d
Jul 16 21:10:37.768432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.768409    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86df8464b4-fb7nr"]
Jul 16 21:10:37.834288 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.834262    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc"]
Jul 16 21:10:37.852737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.852480    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl"]
Jul 16 21:10:37.855507 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:37.855464    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ef6627_388a_4cc4_9445_6545744d96ea.slice/crio-cc632123218470f7be9b6bab876300ee7e9f34d413d2951323962eeb05316302 WatchSource:0}: Error finding container cc632123218470f7be9b6bab876300ee7e9f34d413d2951323962eeb05316302: Status 404 returned error can't find the container with id cc632123218470f7be9b6bab876300ee7e9f34d413d2951323962eeb05316302
Jul 16 21:10:37.988060 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.988025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:10:37.990398 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:37.990371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"image-registry-66885f4994-d7z85\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") " pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:10:38.089265 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.089224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:38.091670 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.091647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f1dc438-9f9c-48ed-84e6-e7340f2a3827-metrics-tls\") pod \"dns-default-skzl6\" (UID: \"6f1dc438-9f9c-48ed-84e6-e7340f2a3827\") " pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:38.098812 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.098795    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:10:38.098917 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.098871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p" event={"ID":"e2b78486-f6a7-428d-b8af-f00f3f2e403f","Type":"ContainerStarted","Data":"6bcfa2b49b2c59760b479aa9db0e55d130017570d289df4682a70e8b292f08e2"}
Jul 16 21:10:38.099281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.099233    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:38.100730 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.100712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc" event={"ID":"746624e4-340d-43ba-a4ee-2f62de26e0d0","Type":"ContainerStarted","Data":"c354736f8dad66095cbe24c8138ea33b384e3e013b97b8e3a0eec1b3f37fc062"}
Jul 16 21:10:38.102118 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.102046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86df8464b4-fb7nr" event={"ID":"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1","Type":"ContainerStarted","Data":"ba4161cbe20b2df5587c2da4179e9289adcc711b021cd59903571a0d1d7f6850"}
Jul 16 21:10:38.102118 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.102084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86df8464b4-fb7nr" event={"ID":"de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1","Type":"ContainerStarted","Data":"3da57adf89dc5ae98cbabdc3350713874b70ede6949b0518e93dba5de8bf754d"}
Jul 16 21:10:38.103133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.103114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl" event={"ID":"82ef6627-388a-4cc4-9445-6545744d96ea","Type":"ContainerStarted","Data":"cc632123218470f7be9b6bab876300ee7e9f34d413d2951323962eeb05316302"}
Jul 16 21:10:38.193022 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.192977    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86df8464b4-fb7nr" podStartSLOduration=33.192957636 podStartE2EDuration="33.192957636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:38.191862028 +0000 UTC m=+101.042479417" watchObservedRunningTime="2026-07-16 21:10:38.192957636 +0000 UTC m=+101.043575013"
Jul 16 21:10:38.279581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.279547    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-9mp2p"
Jul 16 21:10:38.290896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.290866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m22xl\""
Jul 16 21:10:38.298111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.298064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:10:38.310277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.310218    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s8t4\""
Jul 16 21:10:38.314353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.314182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:38.485370 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.485346    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:10:38.487816 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:38.487783    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f805715_2ef2_4e42_9452_573a7d889c1b.slice/crio-9a478ae91b4b0bea740956550dce3d132a14171c7c3f827941b4caabfc0437cc WatchSource:0}: Error finding container 9a478ae91b4b0bea740956550dce3d132a14171c7c3f827941b4caabfc0437cc: Status 404 returned error can't find the container with id 9a478ae91b4b0bea740956550dce3d132a14171c7c3f827941b4caabfc0437cc
Jul 16 21:10:38.499835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.499813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skzl6"]
Jul 16 21:10:38.506255 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:38.506228    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1dc438_9f9c_48ed_84e6_e7340f2a3827.slice/crio-30b78590af2a995940ab955190d2be88cf56fdcaf48040cd11a490411edd97b8 WatchSource:0}: Error finding container 30b78590af2a995940ab955190d2be88cf56fdcaf48040cd11a490411edd97b8: Status 404 returned error can't find the container with id 30b78590af2a995940ab955190d2be88cf56fdcaf48040cd11a490411edd97b8
Jul 16 21:10:38.561960 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.561934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:38.588084 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.588058    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:38.591295 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:38.591275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:39.109240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.109194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skzl6" event={"ID":"6f1dc438-9f9c-48ed-84e6-e7340f2a3827","Type":"ContainerStarted","Data":"30b78590af2a995940ab955190d2be88cf56fdcaf48040cd11a490411edd97b8"}
Jul 16 21:10:39.111267 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.111238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66885f4994-d7z85" event={"ID":"1f805715-2ef2-4e42-9452-573a7d889c1b","Type":"ContainerStarted","Data":"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"}
Jul 16 21:10:39.111405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.111291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66885f4994-d7z85" event={"ID":"1f805715-2ef2-4e42-9452-573a7d889c1b","Type":"ContainerStarted","Data":"9a478ae91b4b0bea740956550dce3d132a14171c7c3f827941b4caabfc0437cc"}
Jul 16 21:10:39.112305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.111786    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:10:39.112305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.111829    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:39.112846 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.112823    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86df8464b4-fb7nr"
Jul 16 21:10:39.212605 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.212572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:39.361555 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.361411    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66885f4994-d7z85" podStartSLOduration=100.361387292 podStartE2EDuration="1m40.361387292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:39.314270072 +0000 UTC m=+102.164887452" watchObservedRunningTime="2026-07-16 21:10:39.361387292 +0000 UTC m=+102.212004669"
Jul 16 21:10:39.450786 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.450695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:39.743482 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.743420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:39.941655 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:39.941621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:40.115341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:40.115263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:40.256607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:40.256558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:40.427984 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:40.427902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:41.596362 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:41.596328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:41.738511 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:41.738479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:42.651812 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:42.651698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:42.759785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:42.759751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:42.865821 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:42.865789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:43.024404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.024367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:43.127575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.127542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl" event={"ID":"82ef6627-388a-4cc4-9445-6545744d96ea","Type":"ContainerStarted","Data":"3edb4719201536870b6ced3156e737e5fe1925f4e000c5a4f89bd37688875596"}
Jul 16 21:10:43.129482 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.129450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc" event={"ID":"746624e4-340d-43ba-a4ee-2f62de26e0d0","Type":"ContainerStarted","Data":"6999698db5486eeab6c66f111a12a2772e2e010bda7cbb38ad6d2c99abe0afa3"}
Jul 16 21:10:43.129616 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.129504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc" event={"ID":"746624e4-340d-43ba-a4ee-2f62de26e0d0","Type":"ContainerStarted","Data":"856bcca5443654eaf8245c032d9c8a2cd22484d5c876f5d871c5d48de09d6562"}
Jul 16 21:10:43.131218 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.131198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skzl6" event={"ID":"6f1dc438-9f9c-48ed-84e6-e7340f2a3827","Type":"ContainerStarted","Data":"829eb94126926bc764edece93a93856cfedfda69102f1e36a9d7073915c9b3f5"}
Jul 16 21:10:43.131322 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.131235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skzl6" event={"ID":"6f1dc438-9f9c-48ed-84e6-e7340f2a3827","Type":"ContainerStarted","Data":"a6437e023e5fa492f3a228ed23d2f765e31c4a8ccf7fd743d5d9bb775b2572b6"}
Jul 16 21:10:43.131393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.131374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:43.155674 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.155627    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tgkl" podStartSLOduration=33.948388235 podStartE2EDuration="38.155613145s" totalImagesPullingTime="4.20722491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:43.155303197 +0000 UTC m=+106.005920575" watchObservedRunningTime="2026-07-16 21:10:43.155613145 +0000 UTC m=+106.006230524"
Jul 16 21:10:43.181195 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.181152    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-whwtc" podStartSLOduration=33.996009259 podStartE2EDuration="38.181138773s" totalImagesPullingTime="4.185129514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:43.180639708 +0000 UTC m=+106.031257089" watchObservedRunningTime="2026-07-16 21:10:43.181138773 +0000 UTC m=+106.031756149"
Jul 16 21:10:43.233399 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.233357    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-skzl6" podStartSLOduration=66.671902623 podStartE2EDuration="1m10.233341622s" totalImagesPullingTime="3.561438999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:43.232675033 +0000 UTC m=+106.083292411" watchObservedRunningTime="2026-07-16 21:10:43.233341622 +0000 UTC m=+106.083958998"
Jul 16 21:10:43.397731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.397659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:43.926942 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:43.926912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:44.006394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:44.006366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-49q69"
Jul 16 21:10:44.077402 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:44.077374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:44.957791 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:44.957759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:45.094013 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:45.093982    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:45.916716 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:45.916678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:46.083303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.083271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:46.357638 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.357603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:46.562131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.562074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:46.564486 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.564469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af58baf-edfa-4c49-9839-a4970c127d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zfzhj\" (UID: \"8af58baf-edfa-4c49-9839-a4970c127d4a\") " pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:46.764576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.764555    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zfzhj"
Jul 16 21:10:46.950640 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:46.950607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zfzhj"]
Jul 16 21:10:46.954785 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:46.954756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af58baf_edfa_4c49_9839_a4970c127d4a.slice/crio-4c97f48e8de8fb43a40f06175dadeff20f3b37d9bb242666516135f18b2078f6 WatchSource:0}: Error finding container 4c97f48e8de8fb43a40f06175dadeff20f3b37d9bb242666516135f18b2078f6: Status 404 returned error can't find the container with id 4c97f48e8de8fb43a40f06175dadeff20f3b37d9bb242666516135f18b2078f6
Jul 16 21:10:47.144560 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:47.144495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zfzhj" event={"ID":"8af58baf-edfa-4c49-9839-a4970c127d4a","Type":"ContainerStarted","Data":"4c97f48e8de8fb43a40f06175dadeff20f3b37d9bb242666516135f18b2078f6"}
Jul 16 21:10:50.397474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:50.397435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:52.165049 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.165022    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zfzhj" event={"ID":"8af58baf-edfa-4c49-9839-a4970c127d4a","Type":"ContainerStarted","Data":"70ed554c8ae1a7f0f9ab2f10470d61c5bdcae9e5d8f0feacaa0180aedd863308"}
Jul 16 21:10:52.274803 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.274755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:52.588034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.588003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:52.718431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.718392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:52.842184 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.842110    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5f22q"]
Jul 16 21:10:52.847844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.847821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.854549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.854519    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5vfpq\""
Jul 16 21:10:52.855875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.855845    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 21:10:52.855875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.855843    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 21:10:52.856052 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.855883    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 21:10:52.856052 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.855884    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 21:10:52.918325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-wtmp\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbmr4\" (UniqueName: \"kubernetes.io/projected/54329bdc-551a-4e65-9b31-1e231281af26-kube-api-access-jbmr4\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-textfile\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-root\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-sys\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:52.918603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:52.918532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-metrics-client-ca\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.019853 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.019813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.019876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-textfile\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.019910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-root\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.019936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.019989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-sys\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020024    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-metrics-client-ca\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-wtmp\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbmr4\" (UniqueName: \"kubernetes.io/projected/54329bdc-551a-4e65-9b31-1e231281af26-kube-api-access-jbmr4\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-root\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-sys\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-textfile\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020690 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:53.020651    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 21:10:53.020740 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:10:53.020692    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls podName:54329bdc-551a-4e65-9b31-1e231281af26 nodeName:}" failed. No retries permitted until 2026-07-16 21:10:53.520679754 +0000 UTC m=+116.371297110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls") pod "node-exporter-5f22q" (UID: "54329bdc-551a-4e65-9b31-1e231281af26") : secret "node-exporter-tls" not found
Jul 16 21:10:53.020795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-wtmp\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.020977 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.020923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-accelerators-collector-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.021298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.021258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54329bdc-551a-4e65-9b31-1e231281af26-metrics-client-ca\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.024194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.024169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.032927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.032907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbmr4\" (UniqueName: \"kubernetes.io/projected/54329bdc-551a-4e65-9b31-1e231281af26-kube-api-access-jbmr4\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.034615 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.034567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:53.138835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.137930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-skzl6"
Jul 16 21:10:53.437849 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.437769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:53.524744 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.524706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.527449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.527422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54329bdc-551a-4e65-9b31-1e231281af26-node-exporter-tls\") pod \"node-exporter-5f22q\" (UID: \"54329bdc-551a-4e65-9b31-1e231281af26\") " pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.560449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.560403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:53.758053 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.758024    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5f22q"
Jul 16 21:10:53.771224 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:10:53.770936    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54329bdc_551a_4e65_9b31_1e231281af26.slice/crio-f4520c8b3cdd20440449664e6cc4069fe72ecd34c3888f0d99f8506d35dec38c WatchSource:0}: Error finding container f4520c8b3cdd20440449664e6cc4069fe72ecd34c3888f0d99f8506d35dec38c: Status 404 returned error can't find the container with id f4520c8b3cdd20440449664e6cc4069fe72ecd34c3888f0d99f8506d35dec38c
Jul 16 21:10:53.802656 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.802622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:53.998084 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:53.998053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:54.089406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:54.089320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:54.176574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:54.176542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f22q" event={"ID":"54329bdc-551a-4e65-9b31-1e231281af26","Type":"ContainerStarted","Data":"f4520c8b3cdd20440449664e6cc4069fe72ecd34c3888f0d99f8506d35dec38c"}
Jul 16 21:10:54.355027 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:54.354944    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" podUID="13235d2d-6adb-42d9-af27-acc57d0c4417" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 21:10:55.419413 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:55.419361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:55.520921 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:55.520870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:55.621221 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:55.621181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:55.760831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:55.760794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:56.147031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:56.146952    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:56.990276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:56.990236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:57.192018 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.191974    2559 generic.go:356] "Generic (PLEG): container finished" podID="54329bdc-551a-4e65-9b31-1e231281af26" containerID="5c71f2551e2a62bc88aadaac86d94b879cc9dcef264711f35f7fc39d8b2c6a64" exitCode=0
Jul 16 21:10:57.192216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.192038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f22q" event={"ID":"54329bdc-551a-4e65-9b31-1e231281af26","Type":"ContainerDied","Data":"5c71f2551e2a62bc88aadaac86d94b879cc9dcef264711f35f7fc39d8b2c6a64"}
Jul 16 21:10:57.194084 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.194056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zfzhj" event={"ID":"8af58baf-edfa-4c49-9839-a4970c127d4a","Type":"ContainerStarted","Data":"99200f2ea5dd53d2fcbc2260a911d31862b56e472a33ea3207176e764fa5b74e"}
Jul 16 21:10:57.261594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.261573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:57.334602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.334573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:57.703427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:57.703308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:58.200336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:58.200300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f22q" event={"ID":"54329bdc-551a-4e65-9b31-1e231281af26","Type":"ContainerStarted","Data":"cd19451b47b5b1ab5ff6f52e747a8ead4e2f91ed2f4b093eb22083d48a5ff852"}
Jul 16 21:10:58.200780 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:58.200366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5f22q" event={"ID":"54329bdc-551a-4e65-9b31-1e231281af26","Type":"ContainerStarted","Data":"13fb966c01345cf02f5aef58aff2e72a575694a40ee21d0ac54f5349c605bb53"}
Jul 16 21:10:58.228077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:58.228027    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5f22q" podStartSLOduration=3.623836113 podStartE2EDuration="6.228006664s" totalImagesPullingTime="2.534673756s" totalInitContainerRuntime="69.496795ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:10:58.225267001 +0000 UTC m=+121.075884378" watchObservedRunningTime="2026-07-16 21:10:58.228006664 +0000 UTC m=+121.078624043"
Jul 16 21:10:58.890384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:58.890349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:59.052960 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:59.052916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:10:59.160741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:10:59.160664    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:00.209985 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:00.209901    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zfzhj" event={"ID":"8af58baf-edfa-4c49-9839-a4970c127d4a","Type":"ContainerStarted","Data":"5187b71d490d3f72a32fde078ec8d2bea1d23192273271c4d52e16e1931a67f7"}
Jul 16 21:11:00.230949 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:00.230904    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zfzhj" podStartSLOduration=33.534451473 podStartE2EDuration="46.230884384s" totalImagesPullingTime="12.696432911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:10:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:00.229163293 +0000 UTC m=+123.079780671" watchObservedRunningTime="2026-07-16 21:11:00.230884384 +0000 UTC m=+123.081501763"
Jul 16 21:11:00.415775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:00.415737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:00.523442 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:00.523390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:01.124864 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.124832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:11:01.415145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.415045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:01.483887 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.483859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:01.740034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.740000    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:11:01.868526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.868490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:01.951647 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:01.951619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:03.412741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:03.412705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:03.482899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:03.482872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:04.354957 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:04.354918    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" podUID="13235d2d-6adb-42d9-af27-acc57d0c4417" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 21:11:04.436396 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:04.436365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:04.535565 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:04.535534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:05.573692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:05.573655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:05.656131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:05.656071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:07.043626 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.043590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:07.548319 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.548278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:07.550193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.550176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:11:07.552642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.552624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34e967b0-1c1e-4bd3-857b-ab8b17896e58-metrics-certs\") pod \"network-metrics-daemon-g5wp2\" (UID: \"34e967b0-1c1e-4bd3-857b-ab8b17896e58\") " pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:11:07.647764 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.647736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:07.755931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.755907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:07.801440 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.801385    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljktf\""
Jul 16 21:11:07.809388 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.809371    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wp2"
Jul 16 21:11:07.948725 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:07.948702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5wp2"]
Jul 16 21:11:07.950900 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:11:07.950861    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e967b0_1c1e_4bd3_857b_ab8b17896e58.slice/crio-b1ba3c931ed17c6e73f1d2a02b33a63a7f2a8003ee17f79100c5273f57c2acdf WatchSource:0}: Error finding container b1ba3c931ed17c6e73f1d2a02b33a63a7f2a8003ee17f79100c5273f57c2acdf: Status 404 returned error can't find the container with id b1ba3c931ed17c6e73f1d2a02b33a63a7f2a8003ee17f79100c5273f57c2acdf
Jul 16 21:11:08.245582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:08.245550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wp2" event={"ID":"34e967b0-1c1e-4bd3-857b-ab8b17896e58","Type":"ContainerStarted","Data":"b1ba3c931ed17c6e73f1d2a02b33a63a7f2a8003ee17f79100c5273f57c2acdf"}
Jul 16 21:11:09.140192 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.140117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:09.251047 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.251015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wp2" event={"ID":"34e967b0-1c1e-4bd3-857b-ab8b17896e58","Type":"ContainerStarted","Data":"e68370325800accf59d4bb2353ab9be26f0838242102855dbe060e899c944ca7"}
Jul 16 21:11:09.251416 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.251066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wp2" event={"ID":"34e967b0-1c1e-4bd3-857b-ab8b17896e58","Type":"ContainerStarted","Data":"56669411163fdb071d6a5cf622b649827683dc83821b48fd81b655f4ae603a9f"}
Jul 16 21:11:09.273356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.273314    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g5wp2" podStartSLOduration=130.386434562 podStartE2EDuration="2m11.273299314s" totalImagesPullingTime="886.864752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:11:09.271590351 +0000 UTC m=+132.122207730" watchObservedRunningTime="2026-07-16 21:11:09.273299314 +0000 UTC m=+132.123916724"
Jul 16 21:11:09.276790 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.276766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:09.381697 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.381672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:09.477052 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.477022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:09.579296 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.579273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:09.848763 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:09.848687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:10.122334 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:10.122258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:11.205385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:11.205351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:11.305407 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:11.305374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:12.980603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:12.980563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:13.080282 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:13.080252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:14.354569 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.354529    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" podUID="13235d2d-6adb-42d9-af27-acc57d0c4417" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 21:11:14.354941 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.354597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s"
Jul 16 21:11:14.355082 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.355053    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"87c9e2a5847e75fbb333d8b62da5d87e58894bc51c0c099c337e550689beac28"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 16 21:11:14.355156 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.355124    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" podUID="13235d2d-6adb-42d9-af27-acc57d0c4417" containerName="service-proxy" containerID="cri-o://87c9e2a5847e75fbb333d8b62da5d87e58894bc51c0c099c337e550689beac28" gracePeriod=30
Jul 16 21:11:14.682774 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.682668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:14.866793 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:14.866755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:15.279206 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:15.279171    2559 generic.go:356] "Generic (PLEG): container finished" podID="13235d2d-6adb-42d9-af27-acc57d0c4417" containerID="87c9e2a5847e75fbb333d8b62da5d87e58894bc51c0c099c337e550689beac28" exitCode=2
Jul 16 21:11:15.279409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:15.279244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerDied","Data":"87c9e2a5847e75fbb333d8b62da5d87e58894bc51c0c099c337e550689beac28"}
Jul 16 21:11:15.279409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:15.279288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67f594cc6f-g2l2s" event={"ID":"13235d2d-6adb-42d9-af27-acc57d0c4417","Type":"ContainerStarted","Data":"836221b14e31bdde3816dd38ae13e3cb72236c15af942494dde407448bccffd4"}
Jul 16 21:11:20.186268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:20.186229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:20.324952 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:20.324916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:20.484576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:20.484547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:24.122645 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:24.122611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:24.190316 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:24.190283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:26.764379 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:26.764335    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66885f4994-d7z85" podUID="1f805715-2ef2-4e42-9452-573a7d889c1b" containerName="registry" containerID="cri-o://d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd" gracePeriod=30
Jul 16 21:11:27.023554 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.023496    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:11:27.092431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092456    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092478    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9r8t\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092501    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092574 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092636    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca\") pod \"1f805715-2ef2-4e42-9452-573a7d889c1b\" (UID: \"1f805715-2ef2-4e42-9452-573a7d889c1b\") "
Jul 16 21:11:27.092909 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.092878    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:27.093580 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.093251    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:11:27.095044 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.095017    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:27.095229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.095129    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:27.095415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.095393    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t" (OuterVolumeSpecName: "kube-api-access-h9r8t") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "kube-api-access-h9r8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:27.095473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.095406    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:11:27.095820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.095800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:11:27.101562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.101535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1f805715-2ef2-4e42-9452-573a7d889c1b" (UID: "1f805715-2ef2-4e42-9452-573a7d889c1b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:11:27.193364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193337    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-tls\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193359    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-trusted-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193370    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-image-registry-private-configuration\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193382    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f805715-2ef2-4e42-9452-573a7d889c1b-registry-certificates\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193391    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f805715-2ef2-4e42-9452-573a7d889c1b-installation-pull-secrets\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193401    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9r8t\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-kube-api-access-h9r8t\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193409    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f805715-2ef2-4e42-9452-573a7d889c1b-ca-trust-extracted\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.193496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.193417    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f805715-2ef2-4e42-9452-573a7d889c1b-bound-sa-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:11:27.325343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.325257    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f805715-2ef2-4e42-9452-573a7d889c1b" containerID="d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd" exitCode=0
Jul 16 21:11:27.325343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.325302    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66885f4994-d7z85"
Jul 16 21:11:27.325343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.325312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66885f4994-d7z85" event={"ID":"1f805715-2ef2-4e42-9452-573a7d889c1b","Type":"ContainerDied","Data":"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"}
Jul 16 21:11:27.325602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.325395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66885f4994-d7z85" event={"ID":"1f805715-2ef2-4e42-9452-573a7d889c1b","Type":"ContainerDied","Data":"9a478ae91b4b0bea740956550dce3d132a14171c7c3f827941b4caabfc0437cc"}
Jul 16 21:11:27.325602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.325428    2559 scope.go:117] "RemoveContainer" containerID="d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"
Jul 16 21:11:27.334735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.334718    2559 scope.go:117] "RemoveContainer" containerID="d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"
Jul 16 21:11:27.334995 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:11:27.334975    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd\": container with ID starting with d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd not found: ID does not exist" containerID="d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"
Jul 16 21:11:27.335048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.335004    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd"} err="failed to get container status \"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd\": rpc error: code = NotFound desc = could not find container \"d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd\": container with ID starting with d3646261e64aa14f387be30c1fdff3aa8e60cc885141d24f4edcc9758830a9dd not found: ID does not exist"
Jul 16 21:11:27.348233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.348213    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:11:27.353842 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.353819    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66885f4994-d7z85"]
Jul 16 21:11:27.677234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:27.677162    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f805715-2ef2-4e42-9452-573a7d889c1b" path="/var/lib/kubelet/pods/1f805715-2ef2-4e42-9452-573a7d889c1b/volumes"
Jul 16 21:11:29.334203 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:29.334175    2559 generic.go:356] "Generic (PLEG): container finished" podID="5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc" containerID="e86439e6573b50b9ad40ea8b2e0418cd21fc570014c6dd114b2432c50c6bb214" exitCode=0
Jul 16 21:11:29.334567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:29.334229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69" event={"ID":"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc","Type":"ContainerDied","Data":"e86439e6573b50b9ad40ea8b2e0418cd21fc570014c6dd114b2432c50c6bb214"}
Jul 16 21:11:29.334567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:29.334514    2559 scope.go:117] "RemoveContainer" containerID="e86439e6573b50b9ad40ea8b2e0418cd21fc570014c6dd114b2432c50c6bb214"
Jul 16 21:11:30.340399 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:30.340365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-t6m69" event={"ID":"5d3d6c4d-1ed7-4433-a910-cf1e95dd07dc","Type":"ContainerStarted","Data":"628719932a8ed36eb79ab706ffe4d042d8667d8ee5e37b7b2c791aa8df96c25e"}
Jul 16 21:11:30.341825 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:30.341804    2559 generic.go:356] "Generic (PLEG): container finished" podID="a53ad221-26bc-4b94-b3a5-37477c598d1c" containerID="c4e9648e2b6968d3c80b6e95b887dcadd07277535508d5cf1c741219e544dd79" exitCode=0
Jul 16 21:11:30.341917 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:30.341849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7" event={"ID":"a53ad221-26bc-4b94-b3a5-37477c598d1c","Type":"ContainerDied","Data":"c4e9648e2b6968d3c80b6e95b887dcadd07277535508d5cf1c741219e544dd79"}
Jul 16 21:11:30.342073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:30.342061    2559 scope.go:117] "RemoveContainer" containerID="c4e9648e2b6968d3c80b6e95b887dcadd07277535508d5cf1c741219e544dd79"
Jul 16 21:11:31.348352 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:31.348322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-whrc7" event={"ID":"a53ad221-26bc-4b94-b3a5-37477c598d1c","Type":"ContainerStarted","Data":"e41f1f528b81711ee665ffc08c57fbbf738b3ab84d44e8b17b7651722834a91c"}
Jul 16 21:11:39.115638 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:39.115603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:39.186692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:39.186665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:11:44.397452 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:44.397367    2559 generic.go:356] "Generic (PLEG): container finished" podID="feefd622-acb8-49d2-bf3a-f1d94ec42d16" containerID="9cfba2eed43d461b1826500f4800d1829678d43e8ecfcf5bca4052797d5ccb9e" exitCode=0
Jul 16 21:11:44.397789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:44.397444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vbvfs" event={"ID":"feefd622-acb8-49d2-bf3a-f1d94ec42d16","Type":"ContainerDied","Data":"9cfba2eed43d461b1826500f4800d1829678d43e8ecfcf5bca4052797d5ccb9e"}
Jul 16 21:11:44.397789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:44.397731    2559 scope.go:117] "RemoveContainer" containerID="9cfba2eed43d461b1826500f4800d1829678d43e8ecfcf5bca4052797d5ccb9e"
Jul 16 21:11:45.403434 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:11:45.403402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vbvfs" event={"ID":"feefd622-acb8-49d2-bf3a-f1d94ec42d16","Type":"ContainerStarted","Data":"06a49c97c6cd5bcbcc425e93621492d978584e2671589b90eb34edb1703914d1"}
Jul 16 21:12:11.989947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:11.989901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:12.089608 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:12.089562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:22.197260 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:22.197210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:22.278570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:22.278542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:33.617714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:33.617676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:33.718515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:33.718484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:12:44.619600 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:12:44.619559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:15.676777 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:15.676725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:15.732745 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:15.732717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:27.143960 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:27.143852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:27.245376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:27.245340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:38.571061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:38.571024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:38.675002 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:38.674969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:38.828124 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:38.828001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:38.890462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:38.890437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:39.074290 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:39.074258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:39.128853 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:39.128770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:49.642841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:49.642803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:49.743188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:49.743157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:49.803556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:49.803495    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:54.116617 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:54.116574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:54.212357 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:54.212317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:54.312571 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:54.312542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:13:57.562669 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:57.562643    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:13:57.571105 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:57.571064    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:13:57.577125 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:13:57.577085    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 21:14:26.960367 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:14:26.960329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:14:59.867325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:14:59.867289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:01.149076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:01.149036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:24.440408 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:24.440374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:24.546739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:24.546710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:27.383299 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:27.383266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:27.564802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:27.564764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:31.748014 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:31.747976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:32.003298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:32.003186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:33.919172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:33.919139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:34.267900 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:34.267867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:35.084470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:35.084435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:35.296333 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:35.296301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:36.887160 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:36.887128    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:37.363525 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:37.363496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:43.743328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:43.743287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:46.079041 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:46.078998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:46.275201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:46.275167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:52.258326 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:52.258283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:52.410059 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:52.410016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:54.307426 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:54.307390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:15:59.983830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:15:59.983794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:00.193403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:00.193368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:12.505766 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:12.505728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:12.776530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:12.776428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:13.011538 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:13.011504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:14.988651 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:14.988606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:15.134147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.134111    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"]
Jul 16 21:16:15.134426 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.134414    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f805715-2ef2-4e42-9452-573a7d889c1b" containerName="registry"
Jul 16 21:16:15.134470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.134427    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f805715-2ef2-4e42-9452-573a7d889c1b" containerName="registry"
Jul 16 21:16:15.134503 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.134493    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f805715-2ef2-4e42-9452-573a7d889c1b" containerName="registry"
Jul 16 21:16:15.137449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.137434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.167788 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.167749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 21:16:15.167928 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.167797    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 21:16:15.167928 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.167824    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-drfg4\""
Jul 16 21:16:15.169635 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.169619    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 21:16:15.169844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.169814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 21:16:15.211325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.211298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"]
Jul 16 21:16:15.226198 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.226177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.226328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.226206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.226328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.226258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.226328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.226283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjj6\" (UniqueName: \"kubernetes.io/projected/080ce4a3-77ff-4416-8c02-5881e8ab73cf-kube-api-access-fsjj6\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.226328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.226303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.258447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.258384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:15.327188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.327343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjj6\" (UniqueName: \"kubernetes.io/projected/080ce4a3-77ff-4416-8c02-5881e8ab73cf-kube-api-access-fsjj6\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.327343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.327455 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.327455 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.327724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.327701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-manifests\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.329535 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.329513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080ce4a3-77ff-4416-8c02-5881e8ab73cf-tmp\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.329731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.329713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.329774 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.329740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ce4a3-77ff-4416-8c02-5881e8ab73cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.345900 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.345875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjj6\" (UniqueName: \"kubernetes.io/projected/080ce4a3-77ff-4416-8c02-5881e8ab73cf-kube-api-access-fsjj6\") pod \"opendatahub-operator-controller-manager-9f7d7dc89-67429\" (UID: \"080ce4a3-77ff-4416-8c02-5881e8ab73cf\") " pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.446962 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.446940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:15.606082 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.606049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"]
Jul 16 21:16:15.611804 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:15.611780    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080ce4a3_77ff_4416_8c02_5881e8ab73cf.slice/crio-c378ea6d0e42237437a027e9050d50678229622b1142a219cb7dc7f2a85dffc3 WatchSource:0}: Error finding container c378ea6d0e42237437a027e9050d50678229622b1142a219cb7dc7f2a85dffc3: Status 404 returned error can't find the container with id c378ea6d0e42237437a027e9050d50678229622b1142a219cb7dc7f2a85dffc3
Jul 16 21:16:15.613595 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.613576    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:16:15.654298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.654272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:15.876957 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:15.876854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:16.080942 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:16.080908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:16.291902 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:16.291867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:16.410345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:16.410309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429" event={"ID":"080ce4a3-77ff-4416-8c02-5881e8ab73cf","Type":"ContainerStarted","Data":"c378ea6d0e42237437a027e9050d50678229622b1142a219cb7dc7f2a85dffc3"}
Jul 16 21:16:16.562472 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:16.562349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:16.818462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:16.818325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:19.426114 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:19.426056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429" event={"ID":"080ce4a3-77ff-4416-8c02-5881e8ab73cf","Type":"ContainerStarted","Data":"f7135ca420fe8165e81d9a5e3b9246a3d1804b906584f46482855728d3339af2"}
Jul 16 21:16:20.431836 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:20.431805    2559 generic.go:356] "Generic (PLEG): container finished" podID="080ce4a3-77ff-4416-8c02-5881e8ab73cf" containerID="f7135ca420fe8165e81d9a5e3b9246a3d1804b906584f46482855728d3339af2" exitCode=0
Jul 16 21:16:20.432322 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:20.431864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429" event={"ID":"080ce4a3-77ff-4416-8c02-5881e8ab73cf","Type":"ContainerDied","Data":"f7135ca420fe8165e81d9a5e3b9246a3d1804b906584f46482855728d3339af2"}
Jul 16 21:16:21.438043 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:21.437960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429" event={"ID":"080ce4a3-77ff-4416-8c02-5881e8ab73cf","Type":"ContainerStarted","Data":"548e7c046362e07deca0289336ede51ce1439cecf4eb1bda23a04098816a92bb"}
Jul 16 21:16:21.438446 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:21.438118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:21.521470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:21.521403    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429" podStartSLOduration=1.887465525 podStartE2EDuration="6.52138489s" totalImagesPullingTime="3.641217803s" totalInitContainerRuntime="992.701562ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:21.520197161 +0000 UTC m=+444.370814537" watchObservedRunningTime="2026-07-16 21:16:21.52138489 +0000 UTC m=+444.372002267"
Jul 16 21:16:23.949115 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:23.949062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:24.499529 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:24.499488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:26.484220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:26.484184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:26.661457 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:26.661424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:32.444522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:32.444488    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9f7d7dc89-67429"
Jul 16 21:16:36.184147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:36.184109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:36.525277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:36.525238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:37.975288 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:37.975252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:38.145059 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.145024    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"]
Jul 16 21:16:38.159537 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.159505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.165413 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.165391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 21:16:38.187410 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.187382    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 21:16:38.197890 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.197867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"]
Jul 16 21:16:38.243227 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.243148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:38.322989 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.322965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.323165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.323022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.323165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.323040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbcq\" (UniqueName: \"kubernetes.io/projected/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-kube-api-access-pbbcq\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.424046 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.424015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.424252 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.424075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.424252 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.424123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbcq\" (UniqueName: \"kubernetes.io/projected/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-kube-api-access-pbbcq\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.426528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.426497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tmp\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.426902 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.426884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-tls-certs\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.514369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.514293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbcq\" (UniqueName: \"kubernetes.io/projected/973c89bc-cf96-4a0b-bb29-857ae01a5fa3-kube-api-access-pbbcq\") pod \"kube-auth-proxy-5b9fcf8c8b-r6rzf\" (UID: \"973c89bc-cf96-4a0b-bb29-857ae01a5fa3\") " pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.712659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.712617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:38.721704 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.721670    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpzkd"]
Jul 16 21:16:38.726217 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.726196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.733761 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:16:38.731586    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-7998c67dc4-zpzkd\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="e1097aa9-6060-405e-9385-029608f42e47" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.733761 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:16:38.731603    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret"
Jul 16 21:16:38.733761 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:16:38.731686    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-59xr7\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-59xr7\"" type="*v1.Secret"
Jul 16 21:16:38.769657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.769589    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"
Jul 16 21:16:38.826903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.826871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8vh5\" (UniqueName: \"kubernetes.io/projected/e1097aa9-6060-405e-9385-029608f42e47-kube-api-access-j8vh5\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.827039 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.826959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1097aa9-6060-405e-9385-029608f42e47-cert\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.918498 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.918458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpzkd"]
Jul 16 21:16:38.928406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.928378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8vh5\" (UniqueName: \"kubernetes.io/projected/e1097aa9-6060-405e-9385-029608f42e47-kube-api-access-j8vh5\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.928538 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.928439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1097aa9-6060-405e-9385-029608f42e47-cert\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:38.978781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:38.978743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8vh5\" (UniqueName: \"kubernetes.io/projected/e1097aa9-6060-405e-9385-029608f42e47-kube-api-access-j8vh5\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:39.019290 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.019257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf"]
Jul 16 21:16:39.030743 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:39.030713    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973c89bc_cf96_4a0b_bb29_857ae01a5fa3.slice/crio-ef04346c1f88d1bdde672bfbfc03a8ad82a567092355479854c799a652674bfd WatchSource:0}: Error finding container ef04346c1f88d1bdde672bfbfc03a8ad82a567092355479854c799a652674bfd: Status 404 returned error can't find the container with id ef04346c1f88d1bdde672bfbfc03a8ad82a567092355479854c799a652674bfd
Jul 16 21:16:39.042843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.042822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:39.316268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.316184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:39.511974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.511937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf" event={"ID":"973c89bc-cf96-4a0b-bb29-857ae01a5fa3","Type":"ContainerStarted","Data":"ef04346c1f88d1bdde672bfbfc03a8ad82a567092355479854c799a652674bfd"}
Jul 16 21:16:39.651343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.651263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:39.772225 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.772196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 21:16:39.781268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:39.781239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1097aa9-6060-405e-9385-029608f42e47-cert\") pod \"odh-model-controller-7998c67dc4-zpzkd\" (UID: \"e1097aa9-6060-405e-9385-029608f42e47\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:40.103747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:40.103711    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-59xr7\""
Jul 16 21:16:40.111253 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:40.111213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:40.309734 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:40.309705    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1097aa9_6060_405e_9385_029608f42e47.slice/crio-af2b9698c37efcf07635c794e96e33aa51ebc0705f03ef5e92846d7a6c207d9f WatchSource:0}: Error finding container af2b9698c37efcf07635c794e96e33aa51ebc0705f03ef5e92846d7a6c207d9f: Status 404 returned error can't find the container with id af2b9698c37efcf07635c794e96e33aa51ebc0705f03ef5e92846d7a6c207d9f
Jul 16 21:16:40.312838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:40.312819    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpzkd"]
Jul 16 21:16:40.518084 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:40.518050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd" event={"ID":"e1097aa9-6060-405e-9385-029608f42e47","Type":"ContainerStarted","Data":"af2b9698c37efcf07635c794e96e33aa51ebc0705f03ef5e92846d7a6c207d9f"}
Jul 16 21:16:40.778576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:40.778403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:41.071286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.071208    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mrln7"]
Jul 16 21:16:41.075160 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.075139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.079049 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.079024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9rh6c\""
Jul 16 21:16:41.080442 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.080422    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 21:16:41.117706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.117619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mrln7"]
Jul 16 21:16:41.145051 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.145019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9925eeb3-b356-4787-94c9-93ca461d2f3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.145232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.145069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdslt\" (UniqueName: \"kubernetes.io/projected/9925eeb3-b356-4787-94c9-93ca461d2f3a-kube-api-access-sdslt\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.198699 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.198669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:41.246353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.246311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9925eeb3-b356-4787-94c9-93ca461d2f3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.246353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.246357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdslt\" (UniqueName: \"kubernetes.io/projected/9925eeb3-b356-4787-94c9-93ca461d2f3a-kube-api-access-sdslt\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.249266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.249238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9925eeb3-b356-4787-94c9-93ca461d2f3a-tls-certs\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.281511 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.281472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdslt\" (UniqueName: \"kubernetes.io/projected/9925eeb3-b356-4787-94c9-93ca461d2f3a-kube-api-access-sdslt\") pod \"model-serving-api-54d89bd5fc-mrln7\" (UID: \"9925eeb3-b356-4787-94c9-93ca461d2f3a\") " pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.388386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.388300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:41.818695 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:41.818668    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mrln7"]
Jul 16 21:16:41.820538 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:41.820512    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9925eeb3_b356_4787_94c9_93ca461d2f3a.slice/crio-49936797d81e2af8338816749bf78df591c7fb77010ff67a608e10d2435ca3c3 WatchSource:0}: Error finding container 49936797d81e2af8338816749bf78df591c7fb77010ff67a608e10d2435ca3c3: Status 404 returned error can't find the container with id 49936797d81e2af8338816749bf78df591c7fb77010ff67a608e10d2435ca3c3
Jul 16 21:16:42.533980 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:42.533900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7" event={"ID":"9925eeb3-b356-4787-94c9-93ca461d2f3a","Type":"ContainerStarted","Data":"49936797d81e2af8338816749bf78df591c7fb77010ff67a608e10d2435ca3c3"}
Jul 16 21:16:42.535942 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:42.535908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf" event={"ID":"973c89bc-cf96-4a0b-bb29-857ae01a5fa3","Type":"ContainerStarted","Data":"2a4e7ffda0ec12632c9720d676283edc6acea3838fc9eed199e66c883825049d"}
Jul 16 21:16:42.592404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:42.591784    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b9fcf8c8b-r6rzf" podStartSLOduration=2.000259369 podStartE2EDuration="4.591758645s" totalImagesPullingTime="2.591499276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:42.591194985 +0000 UTC m=+465.441812365" watchObservedRunningTime="2026-07-16 21:16:42.591758645 +0000 UTC m=+465.442376022"
Jul 16 21:16:42.970995 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:42.970955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:43.043335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.043301    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:16:43.053940 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.053911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.063039 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.063017    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 21:16:43.063207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.063055    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 21:16:43.063207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.063015    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 21:16:43.063359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.063339    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 21:16:43.063418 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.063369    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2x9gh\""
Jul 16 21:16:43.066200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm9mn\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.066469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.066405    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.086837 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.086808    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:16:43.167973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.167425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.167973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.167492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.167973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.167559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.167973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.167619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.167973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.167911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.168387 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.168312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm9mn\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.168387 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.168364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.168694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.168563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.175147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.171659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.175147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.173387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.175404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.175358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.179616 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.179591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.194876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.194850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.201393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.201371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm9mn\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn\") pod \"istiod-openshift-gateway-7574459656-jb97h\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:43.332259 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.332136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:43.367155 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:43.366902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:44.525659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.525632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:16:44.527080 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:44.527049    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675ed9d_a069_4333_acc4_79b6c13769c6.slice/crio-624f13bdbab9d11cf478811b63086833a60d8156f021ded413a9f6fbd3e888a3 WatchSource:0}: Error finding container 624f13bdbab9d11cf478811b63086833a60d8156f021ded413a9f6fbd3e888a3: Status 404 returned error can't find the container with id 624f13bdbab9d11cf478811b63086833a60d8156f021ded413a9f6fbd3e888a3
Jul 16 21:16:44.546915 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.546888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" event={"ID":"a675ed9d-a069-4333-acc4-79b6c13769c6","Type":"ContainerStarted","Data":"624f13bdbab9d11cf478811b63086833a60d8156f021ded413a9f6fbd3e888a3"}
Jul 16 21:16:44.548607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.548580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd" event={"ID":"e1097aa9-6060-405e-9385-029608f42e47","Type":"ContainerStarted","Data":"6c8d2a20ec06b95340a84b5da4aa3188c8a0e8cd8e1c6c0ae466f3bc81af2ac9"}
Jul 16 21:16:44.548692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.548654    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:44.550025 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.550006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7" event={"ID":"9925eeb3-b356-4787-94c9-93ca461d2f3a","Type":"ContainerStarted","Data":"f33524f31c6653bdfe03baa857f10904ab4f6b380b3d1868a65c1b6f6727876e"}
Jul 16 21:16:44.550169 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.550154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:44.626693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.626606    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd" podStartSLOduration=2.6093294289999998 podStartE2EDuration="6.626592051s" totalImagesPullingTime="4.017262622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:44.621117295 +0000 UTC m=+467.471734664" watchObservedRunningTime="2026-07-16 21:16:44.626592051 +0000 UTC m=+467.477209428"
Jul 16 21:16:44.718086 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:44.718042    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7" podStartSLOduration=2.211011736 podStartE2EDuration="4.718029336s" totalImagesPullingTime="2.5070176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:44.714582664 +0000 UTC m=+467.565200041" watchObservedRunningTime="2026-07-16 21:16:44.718029336 +0000 UTC m=+467.568646712"
Jul 16 21:16:46.680623 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:46.680583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:47.237771 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:47.237732    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:16:47.237893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:47.237799    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:16:47.572122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:47.572023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" event={"ID":"a675ed9d-a069-4333-acc4-79b6c13769c6","Type":"ContainerStarted","Data":"45031113a2c3dcc78fc736cd1468af2cc5d9b83c52b408c1feefd67587a314fe"}
Jul 16 21:16:47.572271 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:47.572138    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:47.738333 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:47.738276    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" podStartSLOduration=3.029886902 podStartE2EDuration="5.738257707s" totalImagesPullingTime="2.708370805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:47.736540359 +0000 UTC m=+470.587157738" watchObservedRunningTime="2026-07-16 21:16:47.738257707 +0000 UTC m=+470.588875086"
Jul 16 21:16:48.129064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:48.129023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:48.345607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:48.345574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:48.580473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:48.580435    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jb97h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 21:16:48.580711 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:48.580499    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 21:16:50.080317 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:50.080280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:50.219236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:50.219201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:50.566527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:50.566489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:51.580131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:51.580082    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:54.520579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.520542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:54.761063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.761031    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"]
Jul 16 21:16:54.764501 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.764478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.774072 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.774048    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wpfmc\""
Jul 16 21:16:54.774182 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.774108    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 21:16:54.808138 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.808114    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"]
Jul 16 21:16:54.811295 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.811278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.814644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.814622    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 21:16:54.814923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.814899    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bf9sx\""
Jul 16 21:16:54.834979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.834961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"]
Jul 16 21:16:54.845200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.845158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"]
Jul 16 21:16:54.871067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.871040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28j4\" (UniqueName: \"kubernetes.io/projected/65882d68-bb2e-428a-868b-88e4c5136521-kube-api-access-k28j4\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.871194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.871085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktdm\" (UniqueName: \"kubernetes.io/projected/465d0663-dc75-4268-9b25-4e3c42f8ae27-kube-api-access-8ktdm\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.871241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.871196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65882d68-bb2e-428a-868b-88e4c5136521-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.871281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.871257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/465d0663-dc75-4268-9b25-4e3c42f8ae27-cert\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.903188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.903158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:54.971647 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.971621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65882d68-bb2e-428a-868b-88e4c5136521-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.971765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.971664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/465d0663-dc75-4268-9b25-4e3c42f8ae27-cert\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.971765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.971689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k28j4\" (UniqueName: \"kubernetes.io/projected/65882d68-bb2e-428a-868b-88e4c5136521-kube-api-access-k28j4\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.971765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.971743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktdm\" (UniqueName: \"kubernetes.io/projected/465d0663-dc75-4268-9b25-4e3c42f8ae27-kube-api-access-8ktdm\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.974428 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.974406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/465d0663-dc75-4268-9b25-4e3c42f8ae27-cert\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.974619 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.974604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65882d68-bb2e-428a-868b-88e4c5136521-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:54.990145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.990115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktdm\" (UniqueName: \"kubernetes.io/projected/465d0663-dc75-4268-9b25-4e3c42f8ae27-kube-api-access-8ktdm\") pod \"kserve-controller-manager-d6f4b65b8-szjzk\" (UID: \"465d0663-dc75-4268-9b25-4e3c42f8ae27\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:54.994357 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:54.994331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28j4\" (UniqueName: \"kubernetes.io/projected/65882d68-bb2e-428a-868b-88e4c5136521-kube-api-access-k28j4\") pod \"llmisvc-controller-manager-777c6bd7d5-j865c\" (UID: \"65882d68-bb2e-428a-868b-88e4c5136521\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:55.074905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.074831    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:55.082790 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.082755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:55.120905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.120880    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:16:55.247782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.247760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"]
Jul 16 21:16:55.249775 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:55.249747    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465d0663_dc75_4268_9b25_4e3c42f8ae27.slice/crio-d48743accfc83a1edb5f031ef02fce1452431d57f671248ff3f4ff2245ae9403 WatchSource:0}: Error finding container d48743accfc83a1edb5f031ef02fce1452431d57f671248ff3f4ff2245ae9403: Status 404 returned error can't find the container with id d48743accfc83a1edb5f031ef02fce1452431d57f671248ff3f4ff2245ae9403
Jul 16 21:16:55.306208 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.306040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"]
Jul 16 21:16:55.308523 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:16:55.308497    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65882d68_bb2e_428a_868b_88e4c5136521.slice/crio-fe7fae945b56dc89113def7e2881d195dbccbc25b32b8ec3dc00086dc5bc4b25 WatchSource:0}: Error finding container fe7fae945b56dc89113def7e2881d195dbccbc25b32b8ec3dc00086dc5bc4b25: Status 404 returned error can't find the container with id fe7fae945b56dc89113def7e2881d195dbccbc25b32b8ec3dc00086dc5bc4b25
Jul 16 21:16:55.558980 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.558952    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zpzkd"
Jul 16 21:16:55.561431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.561410    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-mrln7"
Jul 16 21:16:55.610754 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.610722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c" event={"ID":"65882d68-bb2e-428a-868b-88e4c5136521","Type":"ContainerStarted","Data":"fe7fae945b56dc89113def7e2881d195dbccbc25b32b8ec3dc00086dc5bc4b25"}
Jul 16 21:16:55.611905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:55.611877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk" event={"ID":"465d0663-dc75-4268-9b25-4e3c42f8ae27","Type":"ContainerStarted","Data":"d48743accfc83a1edb5f031ef02fce1452431d57f671248ff3f4ff2245ae9403"}
Jul 16 21:16:57.938320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:57.938184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:58.137747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:58.137684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:58.369108 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:58.369050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:16:58.631868 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:58.631774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk" event={"ID":"465d0663-dc75-4268-9b25-4e3c42f8ae27","Type":"ContainerStarted","Data":"d2da8ed1293206f86d0a231344ec9f62bc1e5f6f25c53e7688b196d5082f4446"}
Jul 16 21:16:58.631868 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:58.631847    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:16:58.677779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:58.677715    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk" podStartSLOduration=1.668777681 podStartE2EDuration="4.677700371s" totalImagesPullingTime="3.00892269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:58.677193008 +0000 UTC m=+481.527810402" watchObservedRunningTime="2026-07-16 21:16:58.677700371 +0000 UTC m=+481.528317747"
Jul 16 21:16:59.445382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.445355    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:16:59.445821 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.445533    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerName="discovery" containerID="cri-o://45031113a2c3dcc78fc736cd1468af2cc5d9b83c52b408c1feefd67587a314fe" gracePeriod=30
Jul 16 21:16:59.638384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.638356    2559 generic.go:356] "Generic (PLEG): container finished" podID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerID="45031113a2c3dcc78fc736cd1468af2cc5d9b83c52b408c1feefd67587a314fe" exitCode=0
Jul 16 21:16:59.638521 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.638428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" event={"ID":"a675ed9d-a069-4333-acc4-79b6c13769c6","Type":"ContainerDied","Data":"45031113a2c3dcc78fc736cd1468af2cc5d9b83c52b408c1feefd67587a314fe"}
Jul 16 21:16:59.640063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.640036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c" event={"ID":"65882d68-bb2e-428a-868b-88e4c5136521","Type":"ContainerStarted","Data":"c7ce1d3d0009019566967c356cca7e8f71ec10ffb72f958f277d7aa166fefe43"}
Jul 16 21:16:59.691526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.691483    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c" podStartSLOduration=2.049220976 podStartE2EDuration="5.691460831s" totalImagesPullingTime="3.642239855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:16:59.690509619 +0000 UTC m=+482.541126995" watchObservedRunningTime="2026-07-16 21:16:59.691460831 +0000 UTC m=+482.542078207"
Jul 16 21:16:59.698348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.698301    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:16:59.813703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813677    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813735    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813805    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813834    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813866    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm9mn\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.813908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.813896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs\") pod \"a675ed9d-a069-4333-acc4-79b6c13769c6\" (UID: \"a675ed9d-a069-4333-acc4-79b6c13769c6\") "
Jul 16 21:16:59.814290 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.814256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:16:59.816889 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.816856    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts" (OuterVolumeSpecName: "cacerts") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:16:59.817010 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.816896    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:16:59.817010 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.816908    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:16:59.817010 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.816911    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:16:59.817010 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.816932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs" (OuterVolumeSpecName: "local-certs") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:16:59.817172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.817005    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn" (OuterVolumeSpecName: "kube-api-access-hm9mn") pod "a675ed9d-a069-4333-acc4-79b6c13769c6" (UID: "a675ed9d-a069-4333-acc4-79b6c13769c6"). InnerVolumeSpecName "kube-api-access-hm9mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:16:59.915354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915318    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a675ed9d-a069-4333-acc4-79b6c13769c6-local-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915350    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-cacerts\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915358    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915367    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-dns-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915376    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-csr-ca-configmap\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915385    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a675ed9d-a069-4333-acc4-79b6c13769c6-istio-kubeconfig\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:16:59.915576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:16:59.915393    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm9mn\" (UniqueName: \"kubernetes.io/projected/a675ed9d-a069-4333-acc4-79b6c13769c6-kube-api-access-hm9mn\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:17:00.645069 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.645035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"
Jul 16 21:17:00.645473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.645080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jb97h" event={"ID":"a675ed9d-a069-4333-acc4-79b6c13769c6","Type":"ContainerDied","Data":"624f13bdbab9d11cf478811b63086833a60d8156f021ded413a9f6fbd3e888a3"}
Jul 16 21:17:00.645473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.645159    2559 scope.go:117] "RemoveContainer" containerID="45031113a2c3dcc78fc736cd1468af2cc5d9b83c52b408c1feefd67587a314fe"
Jul 16 21:17:00.645473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.645319    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:17:00.802894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.802869    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:17:00.841783 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:00.841760    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jb97h"]
Jul 16 21:17:01.677381 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:01.677352    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" path="/var/lib/kubelet/pods/a675ed9d-a069-4333-acc4-79b6c13769c6/volumes"
Jul 16 21:17:29.566266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:29.566236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:29.645487 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:29.645458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-szjzk"
Jul 16 21:17:31.653956 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:31.653930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j865c"
Jul 16 21:17:37.572477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.572432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:37.730201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.730170    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:37.730495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.730482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerName="discovery"
Jul 16 21:17:37.730495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.730495    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerName="discovery"
Jul 16 21:17:37.730602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.730549    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a675ed9d-a069-4333-acc4-79b6c13769c6" containerName="discovery"
Jul 16 21:17:37.733417 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.733393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:37.738200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.738181    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 21:17:37.739583 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.739565    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 21:17:37.739697 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.739596    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wq5w6\""
Jul 16 21:17:37.772048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.772025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:37.775289 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.775254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:37.820063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.820025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sls7\" (UniqueName: \"kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7\") pod \"kuadrant-operator-catalog-bqljc\" (UID: \"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a\") " pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:37.921226 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.921197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sls7\" (UniqueName: \"kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7\") pod \"kuadrant-operator-catalog-bqljc\" (UID: \"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a\") " pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:37.936882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:37.936852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sls7\" (UniqueName: \"kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7\") pod \"kuadrant-operator-catalog-bqljc\" (UID: \"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a\") " pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:38.043490 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.043403    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:38.056049 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.056024    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:38.089345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.089306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:38.211596 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.211521    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:38.213999 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:17:38.213971    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d173d0_4d3f_46a8_aea8_b6d4f5ad3c0a.slice/crio-7b16195ce00d54ef2c7034e0cfe73fdff8a02ab535144bc97e06847230f10632 WatchSource:0}: Error finding container 7b16195ce00d54ef2c7034e0cfe73fdff8a02ab535144bc97e06847230f10632: Status 404 returned error can't find the container with id 7b16195ce00d54ef2c7034e0cfe73fdff8a02ab535144bc97e06847230f10632
Jul 16 21:17:38.292894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.292868    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-22xcg"]
Jul 16 21:17:38.296847 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.296798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:38.316175 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.316144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-22xcg"]
Jul 16 21:17:38.324434 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.324414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97sp5\" (UniqueName: \"kubernetes.io/projected/14854a67-b48e-4372-b715-694ad9544c06-kube-api-access-97sp5\") pod \"kuadrant-operator-catalog-22xcg\" (UID: \"14854a67-b48e-4372-b715-694ad9544c06\") " pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:38.425432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.425402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97sp5\" (UniqueName: \"kubernetes.io/projected/14854a67-b48e-4372-b715-694ad9544c06-kube-api-access-97sp5\") pod \"kuadrant-operator-catalog-22xcg\" (UID: \"14854a67-b48e-4372-b715-694ad9544c06\") " pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:38.440969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.440935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97sp5\" (UniqueName: \"kubernetes.io/projected/14854a67-b48e-4372-b715-694ad9544c06-kube-api-access-97sp5\") pod \"kuadrant-operator-catalog-22xcg\" (UID: \"14854a67-b48e-4372-b715-694ad9544c06\") " pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:38.605823 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.605738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:38.785511 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.785483    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-22xcg"]
Jul 16 21:17:38.805306 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:17:38.805279    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14854a67_b48e_4372_b715_694ad9544c06.slice/crio-fc2a05561b8ac14495729ae2764be683d356578e7a3924dbb49c89efe67f110e WatchSource:0}: Error finding container fc2a05561b8ac14495729ae2764be683d356578e7a3924dbb49c89efe67f110e: Status 404 returned error can't find the container with id fc2a05561b8ac14495729ae2764be683d356578e7a3924dbb49c89efe67f110e
Jul 16 21:17:38.810381 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:38.810358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" event={"ID":"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a","Type":"ContainerStarted","Data":"7b16195ce00d54ef2c7034e0cfe73fdff8a02ab535144bc97e06847230f10632"}
Jul 16 21:17:39.817818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:39.817781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-22xcg" event={"ID":"14854a67-b48e-4372-b715-694ad9544c06","Type":"ContainerStarted","Data":"fc2a05561b8ac14495729ae2764be683d356578e7a3924dbb49c89efe67f110e"}
Jul 16 21:17:40.258622 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.258575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:40.371508 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.371467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:17:40.824529 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.824423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" event={"ID":"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a","Type":"ContainerStarted","Data":"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"}
Jul 16 21:17:40.824529 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.824469    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" podUID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" containerName="registry-server" containerID="cri-o://941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9" gracePeriod=2
Jul 16 21:17:40.825918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.825896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-22xcg" event={"ID":"14854a67-b48e-4372-b715-694ad9544c06","Type":"ContainerStarted","Data":"88b23602f79116b397fbfe1e1b48d8ccd2152ac7f5327f201ea51e6affc918ed"}
Jul 16 21:17:40.860422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.860384    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" podStartSLOduration=1.6214371779999999 podStartE2EDuration="3.860369692s" totalImagesPullingTime="2.238932514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:17:40.858846384 +0000 UTC m=+523.709463761" watchObservedRunningTime="2026-07-16 21:17:40.860369692 +0000 UTC m=+523.710987069"
Jul 16 21:17:40.895130 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:40.895074    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-22xcg" podStartSLOduration=1.244725735 podStartE2EDuration="2.895061729s" totalImagesPullingTime="1.650335994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:17:40.894621955 +0000 UTC m=+523.745239332" watchObservedRunningTime="2026-07-16 21:17:40.895061729 +0000 UTC m=+523.745679107"
Jul 16 21:17:41.071268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.071246    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:41.143127 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.143043    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sls7\" (UniqueName: \"kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7\") pod \"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a\" (UID: \"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a\") "
Jul 16 21:17:41.145285 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.145256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7" (OuterVolumeSpecName: "kube-api-access-2sls7") pod "b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" (UID: "b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a"). InnerVolumeSpecName "kube-api-access-2sls7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:17:41.243713 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.243686    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sls7\" (UniqueName: \"kubernetes.io/projected/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a-kube-api-access-2sls7\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:17:41.831908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.831815    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" containerID="941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9" exitCode=0
Jul 16 21:17:41.831908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.831861    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bqljc"
Jul 16 21:17:41.832431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.831899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" event={"ID":"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a","Type":"ContainerDied","Data":"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"}
Jul 16 21:17:41.832431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.831946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bqljc" event={"ID":"b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a","Type":"ContainerDied","Data":"7b16195ce00d54ef2c7034e0cfe73fdff8a02ab535144bc97e06847230f10632"}
Jul 16 21:17:41.832431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.831978    2559 scope.go:117] "RemoveContainer" containerID="941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"
Jul 16 21:17:41.843397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.843373    2559 scope.go:117] "RemoveContainer" containerID="941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"
Jul 16 21:17:41.843642 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:17:41.843624    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9\": container with ID starting with 941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9 not found: ID does not exist" containerID="941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"
Jul 16 21:17:41.843692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.843650    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9"} err="failed to get container status \"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9\": rpc error: code = NotFound desc = could not find container \"941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9\": container with ID starting with 941569367c456aaac79a6d8035d7b87c1de335313b9cf3efaa3b9489fc45bca9 not found: ID does not exist"
Jul 16 21:17:41.873033 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.873006    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:41.882759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:41.882728    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bqljc"]
Jul 16 21:17:43.677863 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:43.677827    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" path="/var/lib/kubelet/pods/b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a/volumes"
Jul 16 21:17:48.606272 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:48.606238    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:48.606664 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:48.606291    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:48.629034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:48.629008    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:17:48.885365 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:17:48.885296    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-22xcg"
Jul 16 21:18:01.424381 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:01.424343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:01.991269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:01.991230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:05.502825 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.502791    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"]
Jul 16 21:18:05.503347 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.503328    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" containerName="registry-server"
Jul 16 21:18:05.503433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.503350    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" containerName="registry-server"
Jul 16 21:18:05.503490 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.503462    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d173d0-4d3f-46a8-aea8-b6d4f5ad3c0a" containerName="registry-server"
Jul 16 21:18:05.511828 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.511802    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:05.515190 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.515169    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-57kkx\""
Jul 16 21:18:05.547948 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.547914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"]
Jul 16 21:18:05.647431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.647390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rstn2\" (UniqueName: \"kubernetes.io/projected/73f2979a-6d7a-4a8e-9221-fd54af3e15e3-kube-api-access-rstn2\") pod \"authorino-operator-75cc8d5cb7-jcj7s\" (UID: \"73f2979a-6d7a-4a8e-9221-fd54af3e15e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:05.748069 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.748043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rstn2\" (UniqueName: \"kubernetes.io/projected/73f2979a-6d7a-4a8e-9221-fd54af3e15e3-kube-api-access-rstn2\") pod \"authorino-operator-75cc8d5cb7-jcj7s\" (UID: \"73f2979a-6d7a-4a8e-9221-fd54af3e15e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:05.779229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.779158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rstn2\" (UniqueName: \"kubernetes.io/projected/73f2979a-6d7a-4a8e-9221-fd54af3e15e3-kube-api-access-rstn2\") pod \"authorino-operator-75cc8d5cb7-jcj7s\" (UID: \"73f2979a-6d7a-4a8e-9221-fd54af3e15e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:05.822221 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.822196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:05.988281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:05.988261    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"]
Jul 16 21:18:05.990765 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:05.990734    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f2979a_6d7a_4a8e_9221_fd54af3e15e3.slice/crio-b3aa38ab56c941e07175f258dc81dca26f182d40311a040f6a82a3ab7fb1e4bd WatchSource:0}: Error finding container b3aa38ab56c941e07175f258dc81dca26f182d40311a040f6a82a3ab7fb1e4bd: Status 404 returned error can't find the container with id b3aa38ab56c941e07175f258dc81dca26f182d40311a040f6a82a3ab7fb1e4bd
Jul 16 21:18:06.538392 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:06.538357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:06.947711 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:06.947628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s" event={"ID":"73f2979a-6d7a-4a8e-9221-fd54af3e15e3","Type":"ContainerStarted","Data":"b3aa38ab56c941e07175f258dc81dca26f182d40311a040f6a82a3ab7fb1e4bd"}
Jul 16 21:18:08.592447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:08.592394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:08.958508 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:08.958471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s" event={"ID":"73f2979a-6d7a-4a8e-9221-fd54af3e15e3","Type":"ContainerStarted","Data":"29c018162a51d8843eedd0757d07d6a831e2f4f6eb8e174d6eaf869ec1091018"}
Jul 16 21:18:08.958662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:08.958568    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:08.974507 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:08.974481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:09.051711 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:09.051660    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s" podStartSLOduration=1.6951385289999998 podStartE2EDuration="4.051646332s" totalImagesPullingTime="2.356507803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:09.051328386 +0000 UTC m=+551.901945763" watchObservedRunningTime="2026-07-16 21:18:09.051646332 +0000 UTC m=+551.902263709"
Jul 16 21:18:10.932987 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:10.932958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:12.086107 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.086067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:12.432575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.432487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:12.655969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.655926    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"]
Jul 16 21:18:12.659522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.659497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.666792 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.666774    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7vxp\""
Jul 16 21:18:12.811331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.811305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vh45\" (UniqueName: \"kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.811469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.811411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.898384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.898359    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"]
Jul 16 21:18:12.912149 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.912116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vh45\" (UniqueName: \"kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.912286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.912212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.912544 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.912525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.929961 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.929929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vh45\" (UniqueName: \"kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:12.969581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:12.969558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:13.130968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:13.130940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"]
Jul 16 21:18:13.133805 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:13.133781    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120ca14a_e4f4_4c9a_a751_567022b9e5a0.slice/crio-0765c5e3a7912988f82a2f88ba98b3e17d58c0cb299d6f1eadf8b7c9b35facfe WatchSource:0}: Error finding container 0765c5e3a7912988f82a2f88ba98b3e17d58c0cb299d6f1eadf8b7c9b35facfe: Status 404 returned error can't find the container with id 0765c5e3a7912988f82a2f88ba98b3e17d58c0cb299d6f1eadf8b7c9b35facfe
Jul 16 21:18:13.984763 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:13.984719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh" event={"ID":"120ca14a-e4f4-4c9a-a751-567022b9e5a0","Type":"ContainerStarted","Data":"0765c5e3a7912988f82a2f88ba98b3e17d58c0cb299d6f1eadf8b7c9b35facfe"}
Jul 16 21:18:14.342005 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.341921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:14.803664 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.803629    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"]
Jul 16 21:18:14.807018 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.806999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:14.811636 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.811612    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-p8z8h\""
Jul 16 21:18:14.851151 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.851128    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"]
Jul 16 21:18:14.927876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.927841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz\") pod \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" (UID: \"3d5939d6-b0be-4efa-9e2a-d574a147cf46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:14.946431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:14.946408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:15.028712 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:15.028685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz\") pod \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" (UID: \"3d5939d6-b0be-4efa-9e2a-d574a147cf46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:15.051077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:15.051041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz\") pod \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" (UID: \"3d5939d6-b0be-4efa-9e2a-d574a147cf46\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:15.119644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:15.119574    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:15.290996 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:15.290976    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"]
Jul 16 21:18:15.293399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:15.293374    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5939d6_b0be_4efa_9e2a_d574a147cf46.slice/crio-bd48c4692af043e4a748253326c205d8ef30b5c34a62bd1a30a5155cdd2e76cf WatchSource:0}: Error finding container bd48c4692af043e4a748253326c205d8ef30b5c34a62bd1a30a5155cdd2e76cf: Status 404 returned error can't find the container with id bd48c4692af043e4a748253326c205d8ef30b5c34a62bd1a30a5155cdd2e76cf
Jul 16 21:18:15.997171 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:15.997139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6" event={"ID":"3d5939d6-b0be-4efa-9e2a-d574a147cf46","Type":"ContainerStarted","Data":"bd48c4692af043e4a748253326c205d8ef30b5c34a62bd1a30a5155cdd2e76cf"}
Jul 16 21:18:17.448284 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:17.448250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:17.726446 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:17.726411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:17.987654 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:17.987580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:18.007067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:18.007032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6" event={"ID":"3d5939d6-b0be-4efa-9e2a-d574a147cf46","Type":"ContainerStarted","Data":"f7919c0f35a3b78b66d1ab40bcc94875826a85ae9b66e28ee339de47bd5801f6"}
Jul 16 21:18:18.007228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:18.007136    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:18.121796 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:18.121744    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6" podStartSLOduration=1.925677559 podStartE2EDuration="4.121727822s" totalImagesPullingTime="2.196050263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:18.120267263 +0000 UTC m=+560.970884652" watchObservedRunningTime="2026-07-16 21:18:18.121727822 +0000 UTC m=+560.972345199"
Jul 16 21:18:19.965300 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:19.965274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jcj7s"
Jul 16 21:18:20.018471 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:20.018334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:20.020545 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:20.020520    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh" event={"ID":"120ca14a-e4f4-4c9a-a751-567022b9e5a0","Type":"ContainerStarted","Data":"97e7cf82ca4c121fb4c255594f5a5e37f8425243684a660fac4b59891573f73c"}
Jul 16 21:18:20.020706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:20.020589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:20.076873 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:20.076810    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh" podStartSLOduration=1.453771623 podStartE2EDuration="8.076794824s" totalImagesPullingTime="6.623023201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:20.076573551 +0000 UTC m=+562.927190940" watchObservedRunningTime="2026-07-16 21:18:20.076794824 +0000 UTC m=+562.927412201"
Jul 16 21:18:22.880756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:22.880726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:22.994471 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:22.994437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:23.404361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:23.404330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:29.006726 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:29.006696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:29.015422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:29.015391    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:29.110325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:29.110290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:31.028686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:31.028656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:31.529786 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:31.529746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:31.651983 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:31.651930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:32.129556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.129522    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"]
Jul 16 21:18:32.133015 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.132999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.153215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.153193    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"]
Jul 16 21:18:32.282996 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.282960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74mqz\" (UniqueName: \"kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.283252 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.283027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.384006 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.383934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74mqz\" (UniqueName: \"kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.384006 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.383996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.384324 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.384307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.396575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.396550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74mqz\" (UniqueName: \"kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.442720 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.442698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:32.581668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.581643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"]
Jul 16 21:18:32.583103 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:32.583057    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8820a7_e8d8_412f_ad3c_bdd76c59dac9.slice/crio-ace1c9a8adf775cdd58fa162c66fa0917e8a91e4f8216d13e02547f6841fdd3a WatchSource:0}: Error finding container ace1c9a8adf775cdd58fa162c66fa0917e8a91e4f8216d13e02547f6841fdd3a: Status 404 returned error can't find the container with id ace1c9a8adf775cdd58fa162c66fa0917e8a91e4f8216d13e02547f6841fdd3a
Jul 16 21:18:32.886881 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.886804    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"]
Jul 16 21:18:32.896067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.896042    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"]
Jul 16 21:18:32.910573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.910547    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"]
Jul 16 21:18:32.910758 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.910733    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" containerName="manager" containerID="cri-o://97e7cf82ca4c121fb4c255594f5a5e37f8425243684a660fac4b59891573f73c" gracePeriod=2
Jul 16 21:18:32.918497 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.918472    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:32.918908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.918853    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" containerName="manager"
Jul 16 21:18:32.918908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.918867    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" containerName="manager"
Jul 16 21:18:32.919013 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.918929    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" containerName="manager"
Jul 16 21:18:32.921905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.921881    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:32.927225 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.927200    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"]
Jul 16 21:18:32.953260 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:32.953218    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"120ca14a-e4f4-4c9a-a751-567022b9e5a0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:32.955295 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.955268    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:32.956142 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:32.956110    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:32.959760 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.959733    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"]
Jul 16 21:18:32.959981 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.959952    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" containerName="manager" containerID="cri-o://f7919c0f35a3b78b66d1ab40bcc94875826a85ae9b66e28ee339de47bd5801f6" gracePeriod=2
Jul 16 21:18:32.966784 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.966763    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:32.967230 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.967184    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" containerName="manager"
Jul 16 21:18:32.967230 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.967205    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" containerName="manager"
Jul 16 21:18:32.967364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.967330    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" containerName="manager"
Jul 16 21:18:32.970500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.970481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:32.981752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.981672    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"]
Jul 16 21:18:32.991206 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.991178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:32.991331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.991256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqx7\" (UniqueName: \"kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:32.991331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.991306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkbdk\" (UniqueName: \"kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:32.991445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.991332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:32.992532 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:32.992512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:33.001941 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.001916    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:33.004777 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.004745    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:33.087295 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.087269    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq" container="manager"
Jul 16 21:18:33.089405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.089370    2559 generic.go:356] "Generic (PLEG): container finished" podID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" containerID="97e7cf82ca4c121fb4c255594f5a5e37f8425243684a660fac4b59891573f73c" exitCode=0
Jul 16 21:18:33.090614 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.090479    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:33.091384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.091361    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" containerID="f7919c0f35a3b78b66d1ab40bcc94875826a85ae9b66e28ee339de47bd5801f6" exitCode=0
Jul 16 21:18:33.091844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.091804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqx7\" (UniqueName: \"kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:33.091946 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.091898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkbdk\" (UniqueName: \"kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:33.092021 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.091943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:33.092021 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.091994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:33.092611 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.092452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:33.092611 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.092547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:33.094162 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.094124    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:33.099696 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.098309    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:33.106889 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.106836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqx7\" (UniqueName: \"kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-frq5t\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:33.107364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.107318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkbdk\" (UniqueName: \"kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8n9rn\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:33.198890 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.198867    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:33.202203 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.202165    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:33.205017 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.204993    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:33.205246 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.205231    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:33.207498 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.207480    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:33.211528 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.211508    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:33.216660 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.216638    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bjrlh\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:33.219081 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:33.219060    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tmfp6\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:33.294344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.294314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume\") pod \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") "
Jul 16 21:18:33.294462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.294359    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vh45\" (UniqueName: \"kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45\") pod \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\" (UID: \"120ca14a-e4f4-4c9a-a751-567022b9e5a0\") "
Jul 16 21:18:33.294462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.294394    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz\") pod \"3d5939d6-b0be-4efa-9e2a-d574a147cf46\" (UID: \"3d5939d6-b0be-4efa-9e2a-d574a147cf46\") "
Jul 16 21:18:33.294771 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.294750    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "120ca14a-e4f4-4c9a-a751-567022b9e5a0" (UID: "120ca14a-e4f4-4c9a-a751-567022b9e5a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:18:33.296461 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.296438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz" (OuterVolumeSpecName: "kube-api-access-ctzsz") pod "3d5939d6-b0be-4efa-9e2a-d574a147cf46" (UID: "3d5939d6-b0be-4efa-9e2a-d574a147cf46"). InnerVolumeSpecName "kube-api-access-ctzsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:18:33.296533 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.296481    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45" (OuterVolumeSpecName: "kube-api-access-8vh45") pod "120ca14a-e4f4-4c9a-a751-567022b9e5a0" (UID: "120ca14a-e4f4-4c9a-a751-567022b9e5a0"). InnerVolumeSpecName "kube-api-access-8vh45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:18:33.328640 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.328620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:33.335549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.335531    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:33.398480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.398388    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vh45\" (UniqueName: \"kubernetes.io/projected/120ca14a-e4f4-4c9a-a751-567022b9e5a0-kube-api-access-8vh45\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:33.398480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.398421    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/3d5939d6-b0be-4efa-9e2a-d574a147cf46-kube-api-access-ctzsz\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:33.398480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.398439    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/120ca14a-e4f4-4c9a-a751-567022b9e5a0-extensions-socket-volume\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:33.508636 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.508612    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:33.510837 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:33.510802    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b5fc52_c12e_44bc_8a86_396d6306034c.slice/crio-8d4a773627cb1e012246f040452ed878a70d2b8f23dbd3b53aa5b6a7c0357738 WatchSource:0}: Error finding container 8d4a773627cb1e012246f040452ed878a70d2b8f23dbd3b53aa5b6a7c0357738: Status 404 returned error can't find the container with id 8d4a773627cb1e012246f040452ed878a70d2b8f23dbd3b53aa5b6a7c0357738
Jul 16 21:18:33.515771 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.515747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:33.518620 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:33.518596    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c8cfd1_6de4_4eb8_817e_5b3a8293b824.slice/crio-be8ed81301255721fc0381047858fae229f336d6c5efe692fafd35a6441334f8 WatchSource:0}: Error finding container be8ed81301255721fc0381047858fae229f336d6c5efe692fafd35a6441334f8: Status 404 returned error can't find the container with id be8ed81301255721fc0381047858fae229f336d6c5efe692fafd35a6441334f8
Jul 16 21:18:33.678083 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.678044    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120ca14a-e4f4-4c9a-a751-567022b9e5a0" path="/var/lib/kubelet/pods/120ca14a-e4f4-4c9a-a751-567022b9e5a0/volumes"
Jul 16 21:18:33.678492 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:33.678472    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" path="/var/lib/kubelet/pods/3d5939d6-b0be-4efa-9e2a-d574a147cf46/volumes"
Jul 16 21:18:34.097734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.097693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" event={"ID":"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824","Type":"ContainerStarted","Data":"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"}
Jul 16 21:18:34.097952 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.097758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" event={"ID":"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824","Type":"ContainerStarted","Data":"be8ed81301255721fc0381047858fae229f336d6c5efe692fafd35a6441334f8"}
Jul 16 21:18:34.097952 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.097908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:34.099068 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.099039    2559 scope.go:117] "RemoveContainer" containerID="97e7cf82ca4c121fb4c255594f5a5e37f8425243684a660fac4b59891573f73c"
Jul 16 21:18:34.099203 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.099039    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bjrlh"
Jul 16 21:18:34.101244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.100936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" event={"ID":"05b5fc52-c12e-44bc-8a86-396d6306034c","Type":"ContainerStarted","Data":"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"}
Jul 16 21:18:34.101244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.101007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" event={"ID":"05b5fc52-c12e-44bc-8a86-396d6306034c","Type":"ContainerStarted","Data":"8d4a773627cb1e012246f040452ed878a70d2b8f23dbd3b53aa5b6a7c0357738"}
Jul 16 21:18:34.101414 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.101298    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:34.102656 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.102641    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tmfp6"
Jul 16 21:18:34.104599 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.104569    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" containerName="manager" containerID="cri-o://2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf" gracePeriod=2
Jul 16 21:18:34.109475 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.109454    2559 scope.go:117] "RemoveContainer" containerID="f7919c0f35a3b78b66d1ab40bcc94875826a85ae9b66e28ee339de47bd5801f6"
Jul 16 21:18:34.122688 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.122648    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" podStartSLOduration=2.122635728 podStartE2EDuration="2.122635728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:34.120311648 +0000 UTC m=+576.970929025" watchObservedRunningTime="2026-07-16 21:18:34.122635728 +0000 UTC m=+576.973253082"
Jul 16 21:18:34.144318 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.144281    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" podStartSLOduration=2.144267634 podStartE2EDuration="2.144267634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:34.14277405 +0000 UTC m=+576.993391426" watchObservedRunningTime="2026-07-16 21:18:34.144267634 +0000 UTC m=+576.994885012"
Jul 16 21:18:34.342447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.342424    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:34.345373 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:34.345349    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:34.404794 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.404773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74mqz\" (UniqueName: \"kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz\") pod \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") "
Jul 16 21:18:34.404893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.404802    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume\") pod \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\" (UID: \"6f8820a7-e8d8-412f-ad3c-bdd76c59dac9\") "
Jul 16 21:18:34.405222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.405200    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" (UID: "6f8820a7-e8d8-412f-ad3c-bdd76c59dac9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:18:34.406983 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.406966    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz" (OuterVolumeSpecName: "kube-api-access-74mqz") pod "6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" (UID: "6f8820a7-e8d8-412f-ad3c-bdd76c59dac9"). InnerVolumeSpecName "kube-api-access-74mqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:18:34.505302 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.505275    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74mqz\" (UniqueName: \"kubernetes.io/projected/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-kube-api-access-74mqz\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:34.505302 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:34.505298    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9-extensions-socket-volume\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:35.112695 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.112657    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" containerID="2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf" exitCode=0
Jul 16 21:18:35.112899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.112701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:35.112899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.112760    2559 scope.go:117] "RemoveContainer" containerID="2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf"
Jul 16 21:18:35.115922 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:35.115898    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:35.121841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.121825    2559 scope.go:117] "RemoveContainer" containerID="2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf"
Jul 16 21:18:35.122142 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:35.122120    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf\": container with ID starting with 2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf not found: ID does not exist" containerID="2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf"
Jul 16 21:18:35.122234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.122148    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf"} err="failed to get container status \"2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf\": rpc error: code = NotFound desc = could not find container \"2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf\": container with ID starting with 2355f9495d4cd5838db880ee1d649ed7643b9facd574b9ac20381d9c40d6cacf not found: ID does not exist"
Jul 16 21:18:35.123372 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:35.123346    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8hpcq\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8hpcq"
Jul 16 21:18:35.679348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:35.679313    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8820a7-e8d8-412f-ad3c-bdd76c59dac9" path="/var/lib/kubelet/pods/6f8820a7-e8d8-412f-ad3c-bdd76c59dac9/volumes"
Jul 16 21:18:37.201234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:37.201176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:37.301232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:37.301202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:37.833449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:37.833404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:37.921137 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:37.921108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:38.673124 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:38.673073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:38.820801 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:38.820767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:41.405569 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:41.405535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:41.505265 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:41.505234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:45.115863 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.115828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:45.116238 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.115921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:45.225460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.225429    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:45.225730 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.225663    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" podUID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" containerName="manager" containerID="cri-o://79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808" gracePeriod=10
Jul 16 21:18:45.443526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.443498    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:18:45.446394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.444573    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" containerName="manager"
Jul 16 21:18:45.446394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.444604    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" containerName="manager"
Jul 16 21:18:45.446394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.444828    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5939d6-b0be-4efa-9e2a-d574a147cf46" containerName="manager"
Jul 16 21:18:45.452449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.452424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.478209 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.478184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:18:45.483024 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.483007    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:45.503385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.503361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f55r7\" (UniqueName: \"kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.503482 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.503423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.604486 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.604455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume\") pod \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") "
Jul 16 21:18:45.604645 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.604507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgqx7\" (UniqueName: \"kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7\") pod \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\" (UID: \"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824\") "
Jul 16 21:18:45.604694 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.604646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f55r7\" (UniqueName: \"kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.604747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.604698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.604823 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.604801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" (UID: "f8c8cfd1-6de4-4eb8-817e-5b3a8293b824"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:18:45.605019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.605001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.606570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.606548    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7" (OuterVolumeSpecName: "kube-api-access-tgqx7") pod "f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" (UID: "f8c8cfd1-6de4-4eb8-817e-5b3a8293b824"). InnerVolumeSpecName "kube-api-access-tgqx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:18:45.615017 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.614995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f55r7\" (UniqueName: \"kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7\") pod \"kuadrant-operator-controller-manager-86878c769f-j28z9\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.705436 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.705413    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-extensions-socket-volume\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:45.705436 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.705437    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgqx7\" (UniqueName: \"kubernetes.io/projected/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824-kube-api-access-tgqx7\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:45.778847 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.778823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:45.925544 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:45.925519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:18:45.926903 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:18:45.926871    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c09cf1_d2ee_4423_9849_e5111aeb9f12.slice/crio-dd7ab110b373fdb932e2b684ec950c0d971dec0d98a6fec2b6fda35565acefdd WatchSource:0}: Error finding container dd7ab110b373fdb932e2b684ec950c0d971dec0d98a6fec2b6fda35565acefdd: Status 404 returned error can't find the container with id dd7ab110b373fdb932e2b684ec950c0d971dec0d98a6fec2b6fda35565acefdd
Jul 16 21:18:46.173463 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.173431    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" containerID="79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808" exitCode=0
Jul 16 21:18:46.173916 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.173480    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"
Jul 16 21:18:46.173916 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.173526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" event={"ID":"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824","Type":"ContainerDied","Data":"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"}
Jul 16 21:18:46.173916 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.173586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t" event={"ID":"f8c8cfd1-6de4-4eb8-817e-5b3a8293b824","Type":"ContainerDied","Data":"be8ed81301255721fc0381047858fae229f336d6c5efe692fafd35a6441334f8"}
Jul 16 21:18:46.173916 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.173625    2559 scope.go:117] "RemoveContainer" containerID="79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"
Jul 16 21:18:46.175842 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.175815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" event={"ID":"14c09cf1-d2ee-4423-9849-e5111aeb9f12","Type":"ContainerStarted","Data":"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"}
Jul 16 21:18:46.176207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.176179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" event={"ID":"14c09cf1-d2ee-4423-9849-e5111aeb9f12","Type":"ContainerStarted","Data":"dd7ab110b373fdb932e2b684ec950c0d971dec0d98a6fec2b6fda35565acefdd"}
Jul 16 21:18:46.176331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.176314    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:46.182552 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.182534    2559 scope.go:117] "RemoveContainer" containerID="79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"
Jul 16 21:18:46.182804 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:46.182783    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808\": container with ID starting with 79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808 not found: ID does not exist" containerID="79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"
Jul 16 21:18:46.182867 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.182813    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808"} err="failed to get container status \"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808\": rpc error: code = NotFound desc = could not find container \"79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808\": container with ID starting with 79b0c169aeeea3a397c7bf1cdcb012ebd9e3437f5c75e091d46364eedb144808 not found: ID does not exist"
Jul 16 21:18:46.203679 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.203630    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:46.213712 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.213691    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-frq5t"]
Jul 16 21:18:46.250753 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.250711    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" podStartSLOduration=1.250697923 podStartE2EDuration="1.250697923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:18:46.24852901 +0000 UTC m=+589.099146390" watchObservedRunningTime="2026-07-16 21:18:46.250697923 +0000 UTC m=+589.101315300"
Jul 16 21:18:46.666363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.666327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:46.773078 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:46.773046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:47.678465 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:47.678431    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" path="/var/lib/kubelet/pods/f8c8cfd1-6de4-4eb8-817e-5b3a8293b824/volumes"
Jul 16 21:18:48.193780 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:48.193740    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:48.307424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:48.307395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:50.591160 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:50.591127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:50.728619 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:50.728590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:54.325780 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:54.325739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:18:57.185389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.185356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:18:57.235835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.235805    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:57.236035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.236011    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" podUID="05b5fc52-c12e-44bc-8a86-396d6306034c" containerName="manager" containerID="cri-o://8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb" gracePeriod=10
Jul 16 21:18:57.490995 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.490972    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:57.598609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.598584    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:18:57.605827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.605803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:18:57.605969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.605917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume\") pod \"05b5fc52-c12e-44bc-8a86-396d6306034c\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") "
Jul 16 21:18:57.606033 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.605979    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkbdk\" (UniqueName: \"kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk\") pod \"05b5fc52-c12e-44bc-8a86-396d6306034c\" (UID: \"05b5fc52-c12e-44bc-8a86-396d6306034c\") "
Jul 16 21:18:57.606340 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.606310    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05b5fc52-c12e-44bc-8a86-396d6306034c" (UID: "05b5fc52-c12e-44bc-8a86-396d6306034c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:18:57.608504 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.608479    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk" (OuterVolumeSpecName: "kube-api-access-pkbdk") pod "05b5fc52-c12e-44bc-8a86-396d6306034c" (UID: "05b5fc52-c12e-44bc-8a86-396d6306034c"). InnerVolumeSpecName "kube-api-access-pkbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:18:57.707292 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.707268    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b5fc52-c12e-44bc-8a86-396d6306034c-extensions-socket-volume\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:57.707292 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:57.707289    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkbdk\" (UniqueName: \"kubernetes.io/projected/05b5fc52-c12e-44bc-8a86-396d6306034c-kube-api-access-pkbdk\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:18:58.237012 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.236978    2559 generic.go:356] "Generic (PLEG): container finished" podID="05b5fc52-c12e-44bc-8a86-396d6306034c" containerID="8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb" exitCode=0
Jul 16 21:18:58.237432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.237026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" event={"ID":"05b5fc52-c12e-44bc-8a86-396d6306034c","Type":"ContainerDied","Data":"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"}
Jul 16 21:18:58.237432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.237035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"
Jul 16 21:18:58.237432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.237067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn" event={"ID":"05b5fc52-c12e-44bc-8a86-396d6306034c","Type":"ContainerDied","Data":"8d4a773627cb1e012246f040452ed878a70d2b8f23dbd3b53aa5b6a7c0357738"}
Jul 16 21:18:58.237432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.237110    2559 scope.go:117] "RemoveContainer" containerID="8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"
Jul 16 21:18:58.245893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.245869    2559 scope.go:117] "RemoveContainer" containerID="8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"
Jul 16 21:18:58.246174 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:18:58.246156    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb\": container with ID starting with 8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb not found: ID does not exist" containerID="8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"
Jul 16 21:18:58.246228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.246183    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb"} err="failed to get container status \"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb\": rpc error: code = NotFound desc = could not find container \"8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb\": container with ID starting with 8abf0d8cc1dd5f0f471abfefae1b1ed8f72211b4aed2cc9d32576381967178eb not found: ID does not exist"
Jul 16 21:18:58.263966 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.263930    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:58.272350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:58.272330    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8n9rn"]
Jul 16 21:18:59.677936 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:18:59.677901    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b5fc52-c12e-44bc-8a86-396d6306034c" path="/var/lib/kubelet/pods/05b5fc52-c12e-44bc-8a86-396d6306034c/volumes"
Jul 16 21:19:01.623271 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623242    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"]
Jul 16 21:19:01.623660 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623645    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b5fc52-c12e-44bc-8a86-396d6306034c" containerName="manager"
Jul 16 21:19:01.623700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623661    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b5fc52-c12e-44bc-8a86-396d6306034c" containerName="manager"
Jul 16 21:19:01.623749 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623673    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" containerName="manager"
Jul 16 21:19:01.623749 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623712    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" containerName="manager"
Jul 16 21:19:01.623861 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623836    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c8cfd1-6de4-4eb8-817e-5b3a8293b824" containerName="manager"
Jul 16 21:19:01.623861 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.623857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b5fc52-c12e-44bc-8a86-396d6306034c" containerName="manager"
Jul 16 21:19:01.628504 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.628484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.631731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.631707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 21:19:01.631859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.631768    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-n88hs\""
Jul 16 21:19:01.647127 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.647084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"]
Jul 16 21:19:01.738881 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.738839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43af5c5-eb03-48ef-b2b1-45c000406f78-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.738907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.738956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.738976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.739026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.739061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2j7l\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-kube-api-access-v2j7l\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739147 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.739129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.739196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.739393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.739230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.808393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.808364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:01.840543 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43af5c5-eb03-48ef-b2b1-45c000406f78-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.840874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2j7l\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-kube-api-access-v2j7l\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.841069 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.840956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.841190 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.841163    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.841275 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.841254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.841332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.841285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.841416 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.841391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d43af5c5-eb03-48ef-b2b1-45c000406f78-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.843180 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.843157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.843354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.843335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.858220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.858202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.859814 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.859791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2j7l\" (UniqueName: \"kubernetes.io/projected/d43af5c5-eb03-48ef-b2b1-45c000406f78-kube-api-access-v2j7l\") pod \"maas-default-gateway-openshift-default-56654dcf7-x5zst\" (UID: \"d43af5c5-eb03-48ef-b2b1-45c000406f78\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.939517 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.939463    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:01.944828 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:01.944804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:02.102704 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:02.102676    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"]
Jul 16 21:19:02.104123 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:02.104072    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43af5c5_eb03_48ef_b2b1_45c000406f78.slice/crio-339f5f34b1370d1a5378acc973625d054d916ceb68db441edfcb7ed32fb1d104 WatchSource:0}: Error finding container 339f5f34b1370d1a5378acc973625d054d916ceb68db441edfcb7ed32fb1d104: Status 404 returned error can't find the container with id 339f5f34b1370d1a5378acc973625d054d916ceb68db441edfcb7ed32fb1d104
Jul 16 21:19:02.258693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:02.258666    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" event={"ID":"d43af5c5-eb03-48ef-b2b1-45c000406f78","Type":"ContainerStarted","Data":"339f5f34b1370d1a5378acc973625d054d916ceb68db441edfcb7ed32fb1d104"}
Jul 16 21:19:05.394055 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:05.394024    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:19:05.394475 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:05.394112    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:19:05.394475 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:05.394141    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:19:05.855567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:05.855532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:06.280570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:06.280536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" event={"ID":"d43af5c5-eb03-48ef-b2b1-45c000406f78","Type":"ContainerStarted","Data":"929961d9f6c859e9f67ccd2b4d256d648acd80c81e1d6c0f0259c827fba5dcf9"}
Jul 16 21:19:06.325378 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:06.325335    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podStartSLOduration=2.037550472 podStartE2EDuration="5.325319768s" totalImagesPullingTime="3.287769296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:06.32393633 +0000 UTC m=+609.174553707" watchObservedRunningTime="2026-07-16 21:19:06.325319768 +0000 UTC m=+609.175937145"
Jul 16 21:19:06.939998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:06.939963    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:06.944834 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:06.944808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:07.286014 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:07.285983    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:07.286811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:07.286791    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:19:15.425065 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.425032    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:15.428896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.428876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.431942 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.431918    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 21:19:15.432051 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.431967    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nnslt\""
Jul 16 21:19:15.439499 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.439477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:15.440563 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.440538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:15.521957 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.521924    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:15.549408 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.549372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:15.557720 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.557693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.557880 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.557726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgn2\" (UniqueName: \"kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.643669 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.643639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:15.658734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.658705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.658893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.658740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgn2\" (UniqueName: \"kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.659410 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.659391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.669307 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.669283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgn2\" (UniqueName: \"kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2\") pod \"limitador-limitador-64c94fd64f-6lgb4\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.739258 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.739235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:15.883858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:15.883835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:15.885780 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:15.885748    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a470ec0_6e37_4101_acd7_60f877a9882c.slice/crio-b84b865055bd7acfedc490a161476c267882b69f7226cb6c8d2f3bf00e6f7187 WatchSource:0}: Error finding container b84b865055bd7acfedc490a161476c267882b69f7226cb6c8d2f3bf00e6f7187: Status 404 returned error can't find the container with id b84b865055bd7acfedc490a161476c267882b69f7226cb6c8d2f3bf00e6f7187
Jul 16 21:19:16.258338 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.258309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:16.262856 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.262837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:16.266071 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.266053    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2xhd\""
Jul 16 21:19:16.269794 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.269771    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:16.296815 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.296791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:16.328706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.328679    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" event={"ID":"5a470ec0-6e37-4101-acd7-60f877a9882c","Type":"ContainerStarted","Data":"b84b865055bd7acfedc490a161476c267882b69f7226cb6c8d2f3bf00e6f7187"}
Jul 16 21:19:16.364106 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.364060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4flnd\" (UniqueName: \"kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd\") pod \"authorino-58cd955675-djlks\" (UID: \"17bff22c-4674-42da-9b44-bf85b0a9b4f7\") " pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:16.379845 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.379818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:16.465073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.465050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4flnd\" (UniqueName: \"kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd\") pod \"authorino-58cd955675-djlks\" (UID: \"17bff22c-4674-42da-9b44-bf85b0a9b4f7\") " pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:16.476172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.476152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4flnd\" (UniqueName: \"kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd\") pod \"authorino-58cd955675-djlks\" (UID: \"17bff22c-4674-42da-9b44-bf85b0a9b4f7\") " pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:16.574394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.574321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:16.742752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:16.742721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:16.745034 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:16.745006    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17bff22c_4674_42da_9b44_bf85b0a9b4f7.slice/crio-99e29590e4111d3b406b7515cec038b3b7fe7fe913e6b6d2e83c18220712841c WatchSource:0}: Error finding container 99e29590e4111d3b406b7515cec038b3b7fe7fe913e6b6d2e83c18220712841c: Status 404 returned error can't find the container with id 99e29590e4111d3b406b7515cec038b3b7fe7fe913e6b6d2e83c18220712841c
Jul 16 21:19:17.337760 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:17.337719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-djlks" event={"ID":"17bff22c-4674-42da-9b44-bf85b0a9b4f7","Type":"ContainerStarted","Data":"99e29590e4111d3b406b7515cec038b3b7fe7fe913e6b6d2e83c18220712841c"}
Jul 16 21:19:21.362625 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.362585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" event={"ID":"5a470ec0-6e37-4101-acd7-60f877a9882c","Type":"ContainerStarted","Data":"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"}
Jul 16 21:19:21.363139 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.362687    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:21.364745 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.364723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-djlks" event={"ID":"17bff22c-4674-42da-9b44-bf85b0a9b4f7","Type":"ContainerStarted","Data":"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"}
Jul 16 21:19:21.381870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.381843    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:21.383674 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.383636    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" podStartSLOduration=1.6536014620000001 podStartE2EDuration="6.383622784s" totalImagesPullingTime="4.730021322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:21.383002251 +0000 UTC m=+624.233619629" watchObservedRunningTime="2026-07-16 21:19:21.383622784 +0000 UTC m=+624.234240187"
Jul 16 21:19:21.401310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:21.401274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-djlks" podStartSLOduration=1.5248384750000001 podStartE2EDuration="5.401261966s" totalImagesPullingTime="3.876423491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:21.400223713 +0000 UTC m=+624.250841099" watchObservedRunningTime="2026-07-16 21:19:21.401261966 +0000 UTC m=+624.251879342"
Jul 16 21:19:23.375101 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:23.375061    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-djlks" podUID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" containerName="authorino" containerID="cri-o://28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45" gracePeriod=30
Jul 16 21:19:23.622373 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:23.622350    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:23.822827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:23.822800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4flnd\" (UniqueName: \"kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd\") pod \"17bff22c-4674-42da-9b44-bf85b0a9b4f7\" (UID: \"17bff22c-4674-42da-9b44-bf85b0a9b4f7\") "
Jul 16 21:19:23.824866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:23.824842    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd" (OuterVolumeSpecName: "kube-api-access-4flnd") pod "17bff22c-4674-42da-9b44-bf85b0a9b4f7" (UID: "17bff22c-4674-42da-9b44-bf85b0a9b4f7"). InnerVolumeSpecName "kube-api-access-4flnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:19:23.923342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:23.923313    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4flnd\" (UniqueName: \"kubernetes.io/projected/17bff22c-4674-42da-9b44-bf85b0a9b4f7-kube-api-access-4flnd\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:19:24.380443 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.380408    2559 generic.go:356] "Generic (PLEG): container finished" podID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" containerID="28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45" exitCode=0
Jul 16 21:19:24.380443 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.380443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-djlks" event={"ID":"17bff22c-4674-42da-9b44-bf85b0a9b4f7","Type":"ContainerDied","Data":"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"}
Jul 16 21:19:24.380920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.380452    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-djlks"
Jul 16 21:19:24.380920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.380470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-djlks" event={"ID":"17bff22c-4674-42da-9b44-bf85b0a9b4f7","Type":"ContainerDied","Data":"99e29590e4111d3b406b7515cec038b3b7fe7fe913e6b6d2e83c18220712841c"}
Jul 16 21:19:24.380920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.380485    2559 scope.go:117] "RemoveContainer" containerID="28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"
Jul 16 21:19:24.389515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.389497    2559 scope.go:117] "RemoveContainer" containerID="28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"
Jul 16 21:19:24.389756 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:19:24.389738    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45\": container with ID starting with 28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45 not found: ID does not exist" containerID="28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"
Jul 16 21:19:24.389817 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.389768    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45"} err="failed to get container status \"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45\": rpc error: code = NotFound desc = could not find container \"28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45\": container with ID starting with 28a86317e1a419bb8e266cbe2a8acfb2bdd4b7476075cb8ac182c8f1bdbb6a45 not found: ID does not exist"
Jul 16 21:19:24.402762 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.402736    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:24.406415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.406392    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-djlks"]
Jul 16 21:19:24.847824 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:24.847789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:25.677830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:25.677799    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" path="/var/lib/kubelet/pods/17bff22c-4674-42da-9b44-bf85b0a9b4f7/volumes"
Jul 16 21:19:32.371048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:32.371021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:32.393614 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:32.393584    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:32.419830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:32.419793    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" podUID="5a470ec0-6e37-4101-acd7-60f877a9882c" containerName="limitador" containerID="cri-o://ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646" gracePeriod=30
Jul 16 21:19:33.371991 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.371968    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:33.399773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.399750    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file\") pod \"5a470ec0-6e37-4101-acd7-60f877a9882c\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") "
Jul 16 21:19:33.399899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.399828    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvgn2\" (UniqueName: \"kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2\") pod \"5a470ec0-6e37-4101-acd7-60f877a9882c\" (UID: \"5a470ec0-6e37-4101-acd7-60f877a9882c\") "
Jul 16 21:19:33.400126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.400104    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file" (OuterVolumeSpecName: "config-file") pod "5a470ec0-6e37-4101-acd7-60f877a9882c" (UID: "5a470ec0-6e37-4101-acd7-60f877a9882c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:19:33.401971 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.401947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2" (OuterVolumeSpecName: "kube-api-access-xvgn2") pod "5a470ec0-6e37-4101-acd7-60f877a9882c" (UID: "5a470ec0-6e37-4101-acd7-60f877a9882c"). InnerVolumeSpecName "kube-api-access-xvgn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:19:33.425451 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.425429    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a470ec0-6e37-4101-acd7-60f877a9882c" containerID="ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646" exitCode=0
Jul 16 21:19:33.425548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.425469    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"
Jul 16 21:19:33.425548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.425495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" event={"ID":"5a470ec0-6e37-4101-acd7-60f877a9882c","Type":"ContainerDied","Data":"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"}
Jul 16 21:19:33.425548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.425533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6lgb4" event={"ID":"5a470ec0-6e37-4101-acd7-60f877a9882c","Type":"ContainerDied","Data":"b84b865055bd7acfedc490a161476c267882b69f7226cb6c8d2f3bf00e6f7187"}
Jul 16 21:19:33.425676 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.425555    2559 scope.go:117] "RemoveContainer" containerID="ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"
Jul 16 21:19:33.434781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.434767    2559 scope.go:117] "RemoveContainer" containerID="ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"
Jul 16 21:19:33.435020 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:19:33.435005    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646\": container with ID starting with ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646 not found: ID does not exist" containerID="ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"
Jul 16 21:19:33.435062 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.435028    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646"} err="failed to get container status \"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646\": rpc error: code = NotFound desc = could not find container \"ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646\": container with ID starting with ad255b1c018374a9ea8779d276a19932035d3473c7ec2ffa8384c0a5ad1ab646 not found: ID does not exist"
Jul 16 21:19:33.448859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.448831    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:33.452947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.452927    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6lgb4"]
Jul 16 21:19:33.500971 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.500917    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvgn2\" (UniqueName: \"kubernetes.io/projected/5a470ec0-6e37-4101-acd7-60f877a9882c-kube-api-access-xvgn2\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:19:33.500971 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.500938    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a470ec0-6e37-4101-acd7-60f877a9882c-config-file\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:19:33.678822 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.678793    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a470ec0-6e37-4101-acd7-60f877a9882c" path="/var/lib/kubelet/pods/5a470ec0-6e37-4101-acd7-60f877a9882c/volumes"
Jul 16 21:19:33.867405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.867316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:33.964521 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:33.964475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:34.317332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317306    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"]
Jul 16 21:19:34.317701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317685    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" containerName="authorino"
Jul 16 21:19:34.317701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" containerName="authorino"
Jul 16 21:19:34.317797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317711    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a470ec0-6e37-4101-acd7-60f877a9882c" containerName="limitador"
Jul 16 21:19:34.317797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317716    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a470ec0-6e37-4101-acd7-60f877a9882c" containerName="limitador"
Jul 16 21:19:34.317797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317772    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17bff22c-4674-42da-9b44-bf85b0a9b4f7" containerName="authorino"
Jul 16 21:19:34.317797 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.317781    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a470ec0-6e37-4101-acd7-60f877a9882c" containerName="limitador"
Jul 16 21:19:34.322004 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.321988    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.325181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.325153    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 21:19:34.325308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.325250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7ffjw\""
Jul 16 21:19:34.325308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.325263    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 21:19:34.325414 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.325302    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 21:19:34.331228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.331207    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"]
Jul 16 21:19:34.369678 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.369653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:34.409538 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.409515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-data\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.409814 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.409548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8nfz\" (UniqueName: \"kubernetes.io/projected/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-kube-api-access-h8nfz\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.510406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.510380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-data\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.510514 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.510417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8nfz\" (UniqueName: \"kubernetes.io/projected/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-kube-api-access-h8nfz\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.510751 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.510731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-data\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.519903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.519881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8nfz\" (UniqueName: \"kubernetes.io/projected/4f4c3440-f99d-45bf-a9bb-d8ad9afef710-kube-api-access-h8nfz\") pod \"postgres-69fb4594cf-qsngd\" (UID: \"4f4c3440-f99d-45bf-a9bb-d8ad9afef710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.633128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.633047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:34.769934 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:34.769908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"]
Jul 16 21:19:34.771983 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:34.771948    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4c3440_f99d_45bf_a9bb_d8ad9afef710.slice/crio-c2e454a49cb11cb6b9d406acf72ef2e58bf0035d063101b19d8d69afc2e1e708 WatchSource:0}: Error finding container c2e454a49cb11cb6b9d406acf72ef2e58bf0035d063101b19d8d69afc2e1e708: Status 404 returned error can't find the container with id c2e454a49cb11cb6b9d406acf72ef2e58bf0035d063101b19d8d69afc2e1e708
Jul 16 21:19:35.437082 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:35.437046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd" event={"ID":"4f4c3440-f99d-45bf-a9bb-d8ad9afef710","Type":"ContainerStarted","Data":"c2e454a49cb11cb6b9d406acf72ef2e58bf0035d063101b19d8d69afc2e1e708"}
Jul 16 21:19:35.834176 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:35.834032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:40.467169 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:40.467127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd" event={"ID":"4f4c3440-f99d-45bf-a9bb-d8ad9afef710","Type":"ContainerStarted","Data":"04725bdd14dc7e26926b8c085a3437c90ab65c35d574317fc9ae324d699e6e80"}
Jul 16 21:19:40.467540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:40.467266    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:40.485645 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:40.485603    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd" podStartSLOduration=1.28763937 podStartE2EDuration="6.485588825s" totalImagesPullingTime="5.197949455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:40.48429116 +0000 UTC m=+643.334908537" watchObservedRunningTime="2026-07-16 21:19:40.485588825 +0000 UTC m=+643.336206203"
Jul 16 21:19:46.504515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:46.504487    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsngd"
Jul 16 21:19:46.830422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:46.830340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:47.059756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.059721    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:47.063436 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.063420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:47.067273 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.067251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2xhd\""
Jul 16 21:19:47.071851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.071830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:47.120832 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.120767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp4hq\" (UniqueName: \"kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq\") pod \"authorino-5d4b67c446-x5wnw\" (UID: \"c78caf94-3514-4c9b-9998-791206e58e85\") " pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:47.221897 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.221874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp4hq\" (UniqueName: \"kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq\") pod \"authorino-5d4b67c446-x5wnw\" (UID: \"c78caf94-3514-4c9b-9998-791206e58e85\") " pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:47.247831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.247809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp4hq\" (UniqueName: \"kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq\") pod \"authorino-5d4b67c446-x5wnw\" (UID: \"c78caf94-3514-4c9b-9998-791206e58e85\") " pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:47.340906 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.340882    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:47.341103 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.341075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:47.417589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.417556    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:47.422281 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.422258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:47.439068 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.439046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:47.487734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.487709    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:47.489449 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:47.489425    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc78caf94_3514_4c9b_9998_791206e58e85.slice/crio-e2b6f0cd2550ea169f1ff31e8d742685fd142000a138c70b776e75a54310309e WatchSource:0}: Error finding container e2b6f0cd2550ea169f1ff31e8d742685fd142000a138c70b776e75a54310309e: Status 404 returned error can't find the container with id e2b6f0cd2550ea169f1ff31e8d742685fd142000a138c70b776e75a54310309e
Jul 16 21:19:47.491558 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.491520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:47.502954 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.502896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" event={"ID":"c78caf94-3514-4c9b-9998-791206e58e85","Type":"ContainerStarted","Data":"e2b6f0cd2550ea169f1ff31e8d742685fd142000a138c70b776e75a54310309e"}
Jul 16 21:19:47.523433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.523408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtnwg\" (UniqueName: \"kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg\") pod \"authorino-fdb5994bc-gc6fm\" (UID: \"0d697852-4166-40d9-b325-3c3073b28c41\") " pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:47.623977 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.623947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtnwg\" (UniqueName: \"kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg\") pod \"authorino-fdb5994bc-gc6fm\" (UID: \"0d697852-4166-40d9-b325-3c3073b28c41\") " pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:47.633034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.633009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtnwg\" (UniqueName: \"kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg\") pod \"authorino-fdb5994bc-gc6fm\" (UID: \"0d697852-4166-40d9-b325-3c3073b28c41\") " pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:47.681266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.681205    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:47.681458 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.681445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:47.715470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.715444    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:19:47.721188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.721168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.724546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.724520    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 21:19:47.726893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.726873    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:19:47.824978 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.824938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wvx\" (UniqueName: \"kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.825158 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.825002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.826762 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.826744    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:47.828805 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:47.828779    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d697852_4166_40d9_b325_3c3073b28c41.slice/crio-c14217719026220dcadfeac48d2320258b38b7f3414ff12c58bb35022e563c54 WatchSource:0}: Error finding container c14217719026220dcadfeac48d2320258b38b7f3414ff12c58bb35022e563c54: Status 404 returned error can't find the container with id c14217719026220dcadfeac48d2320258b38b7f3414ff12c58bb35022e563c54
Jul 16 21:19:47.925642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.925618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wvx\" (UniqueName: \"kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.925801 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.925670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.928000 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.927976    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:47.934623 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:47.934571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wvx\" (UniqueName: \"kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx\") pod \"authorino-5db79bdf59-klxt6\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") " pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:48.033273 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.033240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:19:48.166662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.166639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:19:48.169253 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:48.169226    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod043537e3_67b5_467f_a26f_84ccffdfbcdb.slice/crio-1e5901966de2435181b2b4727dabeca016d45ce4c053ecc75d679d46fd988471 WatchSource:0}: Error finding container 1e5901966de2435181b2b4727dabeca016d45ce4c053ecc75d679d46fd988471: Status 404 returned error can't find the container with id 1e5901966de2435181b2b4727dabeca016d45ce4c053ecc75d679d46fd988471
Jul 16 21:19:48.510411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.510380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" event={"ID":"0d697852-4166-40d9-b325-3c3073b28c41","Type":"ContainerStarted","Data":"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"}
Jul 16 21:19:48.510411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.510417    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" event={"ID":"0d697852-4166-40d9-b325-3c3073b28c41","Type":"ContainerStarted","Data":"c14217719026220dcadfeac48d2320258b38b7f3414ff12c58bb35022e563c54"}
Jul 16 21:19:48.510647 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.510412    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" podUID="0d697852-4166-40d9-b325-3c3073b28c41" containerName="authorino" containerID="cri-o://0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5" gracePeriod=30
Jul 16 21:19:48.512205 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.512176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" event={"ID":"c78caf94-3514-4c9b-9998-791206e58e85","Type":"ContainerStarted","Data":"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"}
Jul 16 21:19:48.512334 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.512257    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" podUID="c78caf94-3514-4c9b-9998-791206e58e85" containerName="authorino" containerID="cri-o://3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c" gracePeriod=30
Jul 16 21:19:48.513406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.513384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79bdf59-klxt6" event={"ID":"043537e3-67b5-467f-a26f-84ccffdfbcdb","Type":"ContainerStarted","Data":"1e5901966de2435181b2b4727dabeca016d45ce4c053ecc75d679d46fd988471"}
Jul 16 21:19:48.527232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.527194    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" podStartSLOduration=1.088804165 podStartE2EDuration="1.527178776s" totalImagesPullingTime="438.374611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:48.525722746 +0000 UTC m=+651.376340123" watchObservedRunningTime="2026-07-16 21:19:48.527178776 +0000 UTC m=+651.377796154"
Jul 16 21:19:48.541703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.541665    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" podStartSLOduration=1.188167154 podStartE2EDuration="1.541651939s" totalImagesPullingTime="353.484785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:48.541333247 +0000 UTC m=+651.391950626" watchObservedRunningTime="2026-07-16 21:19:48.541651939 +0000 UTC m=+651.392269315"
Jul 16 21:19:48.767271 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.767248    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:48.780509 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.780487    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:48.832932 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.832902    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp4hq\" (UniqueName: \"kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq\") pod \"c78caf94-3514-4c9b-9998-791206e58e85\" (UID: \"c78caf94-3514-4c9b-9998-791206e58e85\") "
Jul 16 21:19:48.833194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.833169    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtnwg\" (UniqueName: \"kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg\") pod \"0d697852-4166-40d9-b325-3c3073b28c41\" (UID: \"0d697852-4166-40d9-b325-3c3073b28c41\") "
Jul 16 21:19:48.835128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.835064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq" (OuterVolumeSpecName: "kube-api-access-rp4hq") pod "c78caf94-3514-4c9b-9998-791206e58e85" (UID: "c78caf94-3514-4c9b-9998-791206e58e85"). InnerVolumeSpecName "kube-api-access-rp4hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:19:48.835265 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.835240    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg" (OuterVolumeSpecName: "kube-api-access-xtnwg") pod "0d697852-4166-40d9-b325-3c3073b28c41" (UID: "0d697852-4166-40d9-b325-3c3073b28c41"). InnerVolumeSpecName "kube-api-access-xtnwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:19:48.934495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.934462    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtnwg\" (UniqueName: \"kubernetes.io/projected/0d697852-4166-40d9-b325-3c3073b28c41-kube-api-access-xtnwg\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:19:48.934495 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:48.934489    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp4hq\" (UniqueName: \"kubernetes.io/projected/c78caf94-3514-4c9b-9998-791206e58e85-kube-api-access-rp4hq\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:19:49.519758 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.519672    2559 generic.go:356] "Generic (PLEG): container finished" podID="0d697852-4166-40d9-b325-3c3073b28c41" containerID="0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5" exitCode=0
Jul 16 21:19:49.519758 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.519734    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdb5994bc-gc6fm"
Jul 16 21:19:49.519965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.519757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" event={"ID":"0d697852-4166-40d9-b325-3c3073b28c41","Type":"ContainerDied","Data":"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"}
Jul 16 21:19:49.519965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.519797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdb5994bc-gc6fm" event={"ID":"0d697852-4166-40d9-b325-3c3073b28c41","Type":"ContainerDied","Data":"c14217719026220dcadfeac48d2320258b38b7f3414ff12c58bb35022e563c54"}
Jul 16 21:19:49.519965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.519819    2559 scope.go:117] "RemoveContainer" containerID="0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"
Jul 16 21:19:49.521142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.520996    2559 generic.go:356] "Generic (PLEG): container finished" podID="c78caf94-3514-4c9b-9998-791206e58e85" containerID="3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c" exitCode=0
Jul 16 21:19:49.521142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.521051    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x5wnw"
Jul 16 21:19:49.521142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.521084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" event={"ID":"c78caf94-3514-4c9b-9998-791206e58e85","Type":"ContainerDied","Data":"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"}
Jul 16 21:19:49.521142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.521141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x5wnw" event={"ID":"c78caf94-3514-4c9b-9998-791206e58e85","Type":"ContainerDied","Data":"e2b6f0cd2550ea169f1ff31e8d742685fd142000a138c70b776e75a54310309e"}
Jul 16 21:19:49.522976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.522953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79bdf59-klxt6" event={"ID":"043537e3-67b5-467f-a26f-84ccffdfbcdb","Type":"ContainerStarted","Data":"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"}
Jul 16 21:19:49.530568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.530553    2559 scope.go:117] "RemoveContainer" containerID="0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"
Jul 16 21:19:49.530840 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:19:49.530810    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5\": container with ID starting with 0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5 not found: ID does not exist" containerID="0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"
Jul 16 21:19:49.530840 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.530831    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5"} err="failed to get container status \"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5\": rpc error: code = NotFound desc = could not find container \"0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5\": container with ID starting with 0e7c60a03e729d1a60c45afae983ae9593151a3870a8c3ce584e17a1a51397a5 not found: ID does not exist"
Jul 16 21:19:49.530927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.530847    2559 scope.go:117] "RemoveContainer" containerID="3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"
Jul 16 21:19:49.538795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.538778    2559 scope.go:117] "RemoveContainer" containerID="3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"
Jul 16 21:19:49.539048 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:19:49.539030    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c\": container with ID starting with 3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c not found: ID does not exist" containerID="3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"
Jul 16 21:19:49.539138 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.539055    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c"} err="failed to get container status \"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c\": rpc error: code = NotFound desc = could not find container \"3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c\": container with ID starting with 3e745bdf7dc6e5b9cc19e74914a562797e4bf4dd7288727f4dbf90f348be410c not found: ID does not exist"
Jul 16 21:19:49.545682 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.545646    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5db79bdf59-klxt6" podStartSLOduration=2.004945608 podStartE2EDuration="2.545634926s" totalImagesPullingTime="540.689318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:49.544249587 +0000 UTC m=+652.394866964" watchObservedRunningTime="2026-07-16 21:19:49.545634926 +0000 UTC m=+652.396252303"
Jul 16 21:19:49.560920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.560896    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:49.564223 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.564202    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x5wnw"]
Jul 16 21:19:49.580614 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.580591    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:49.586584 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.586562    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fdb5994bc-gc6fm"]
Jul 16 21:19:49.678919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.678887    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d697852-4166-40d9-b325-3c3073b28c41" path="/var/lib/kubelet/pods/0d697852-4166-40d9-b325-3c3073b28c41/volumes"
Jul 16 21:19:49.679257 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:49.679242    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78caf94-3514-4c9b-9998-791206e58e85" path="/var/lib/kubelet/pods/c78caf94-3514-4c9b-9998-791206e58e85/volumes"
Jul 16 21:19:54.281592 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.281556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:54.285976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.285952    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:19:54.286350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286337    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78caf94-3514-4c9b-9998-791206e58e85" containerName="authorino"
Jul 16 21:19:54.286403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286352    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78caf94-3514-4c9b-9998-791206e58e85" containerName="authorino"
Jul 16 21:19:54.286403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286367    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d697852-4166-40d9-b325-3c3073b28c41" containerName="authorino"
Jul 16 21:19:54.286403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286372    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d697852-4166-40d9-b325-3c3073b28c41" containerName="authorino"
Jul 16 21:19:54.286494 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286429    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d697852-4166-40d9-b325-3c3073b28c41" containerName="authorino"
Jul 16 21:19:54.286494 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.286438    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78caf94-3514-4c9b-9998-791206e58e85" containerName="authorino"
Jul 16 21:19:54.357899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.357874    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:19:54.358039 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.357967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.362781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.362757    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 21:19:54.362781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.362779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqfq7\""
Jul 16 21:19:54.362994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.362758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 21:19:54.370521 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.370496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:54.451524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.451498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:54.456204 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.456183    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:19:54.481248 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.481215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.481248 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.481252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbfg\" (UniqueName: \"kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.486891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.486845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:19:54.487011 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.486940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.581974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.581904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.581974 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.581941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z76n\" (UniqueName: \"kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.582212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.581991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.582212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.582013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbfg\" (UniqueName: \"kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.584558 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.584534    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.592129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.592078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbfg\" (UniqueName: \"kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg\") pod \"maas-controller-564df84566-8jwlc\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") " pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.669086 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.669057    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:54.682548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.682527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z76n\" (UniqueName: \"kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.682650 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.682629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.685126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.685080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.694341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.694314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z76n\" (UniqueName: \"kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n\") pod \"maas-controller-57c55c95-zvpzp\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") " pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.797580 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.797554    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:54.819651 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.819631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:19:54.821249 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:54.821227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cf14ba_80b0_4f55_970e_4e2c267717b3.slice/crio-d372fd9a68966d176dd4714731bbc305954110c2b0c3bc851867ea6c19101208 WatchSource:0}: Error finding container d372fd9a68966d176dd4714731bbc305954110c2b0c3bc851867ea6c19101208: Status 404 returned error can't find the container with id d372fd9a68966d176dd4714731bbc305954110c2b0c3bc851867ea6c19101208
Jul 16 21:19:54.960818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:54.960796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:19:54.962664 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:19:54.962636    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a5693d_2ab8_4e21_abe0_1f96c5b35e8b.slice/crio-0b90d973ac9cff68f63907a2f702b913e42b690cf3e36d917a8ecf6a79a4bd76 WatchSource:0}: Error finding container 0b90d973ac9cff68f63907a2f702b913e42b690cf3e36d917a8ecf6a79a4bd76: Status 404 returned error can't find the container with id 0b90d973ac9cff68f63907a2f702b913e42b690cf3e36d917a8ecf6a79a4bd76
Jul 16 21:19:55.556785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:55.556748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zvpzp" event={"ID":"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b","Type":"ContainerStarted","Data":"0b90d973ac9cff68f63907a2f702b913e42b690cf3e36d917a8ecf6a79a4bd76"}
Jul 16 21:19:55.558263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:55.558233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564df84566-8jwlc" event={"ID":"f0cf14ba-80b0-4f55-970e-4e2c267717b3","Type":"ContainerStarted","Data":"d372fd9a68966d176dd4714731bbc305954110c2b0c3bc851867ea6c19101208"}
Jul 16 21:19:57.953882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:57.953861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 21:19:58.154567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.154515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:58.253135 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.253081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:19:58.581953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.581851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zvpzp" event={"ID":"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b","Type":"ContainerStarted","Data":"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"}
Jul 16 21:19:58.582175 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.581977    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:19:58.583712 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.583685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564df84566-8jwlc" event={"ID":"f0cf14ba-80b0-4f55-970e-4e2c267717b3","Type":"ContainerStarted","Data":"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"}
Jul 16 21:19:58.583830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.583811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:19:58.605558 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.605517    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57c55c95-zvpzp" podStartSLOduration=1.611689457 podStartE2EDuration="4.605503273s" totalImagesPullingTime="2.993813816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:58.603406983 +0000 UTC m=+661.454024362" watchObservedRunningTime="2026-07-16 21:19:58.605503273 +0000 UTC m=+661.456121022"
Jul 16 21:19:58.625875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:19:58.625827    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-564df84566-8jwlc" podStartSLOduration=1.497869425 podStartE2EDuration="4.625809004s" totalImagesPullingTime="3.127939579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:19:58.623339 +0000 UTC m=+661.473956377" watchObservedRunningTime="2026-07-16 21:19:58.625809004 +0000 UTC m=+661.476426383"
Jul 16 21:20:09.590903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:09.590876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:20:09.591494 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:09.591076    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:20:09.661133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:09.659229    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:20:09.661133 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:09.659422    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-564df84566-8jwlc" podUID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" containerName="manager" containerID="cri-o://9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6" gracePeriod=30
Jul 16 21:20:09.915813 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:09.915787    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:20:10.014234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.014207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert\") pod \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") "
Jul 16 21:20:10.014401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.014277    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpbfg\" (UniqueName: \"kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg\") pod \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\" (UID: \"f0cf14ba-80b0-4f55-970e-4e2c267717b3\") "
Jul 16 21:20:10.016536 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.016506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f0cf14ba-80b0-4f55-970e-4e2c267717b3" (UID: "f0cf14ba-80b0-4f55-970e-4e2c267717b3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:20:10.016670 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.016644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg" (OuterVolumeSpecName: "kube-api-access-rpbfg") pod "f0cf14ba-80b0-4f55-970e-4e2c267717b3" (UID: "f0cf14ba-80b0-4f55-970e-4e2c267717b3"). InnerVolumeSpecName "kube-api-access-rpbfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:20:10.115207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.115170    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0cf14ba-80b0-4f55-970e-4e2c267717b3-webhook-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:20:10.115207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.115206    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpbfg\" (UniqueName: \"kubernetes.io/projected/f0cf14ba-80b0-4f55-970e-4e2c267717b3-kube-api-access-rpbfg\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:20:10.642921 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.642883    2559 generic.go:356] "Generic (PLEG): container finished" podID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" containerID="9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6" exitCode=0
Jul 16 21:20:10.643339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.642930    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-564df84566-8jwlc"
Jul 16 21:20:10.643339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.642941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564df84566-8jwlc" event={"ID":"f0cf14ba-80b0-4f55-970e-4e2c267717b3","Type":"ContainerDied","Data":"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"}
Jul 16 21:20:10.643339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.642995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-564df84566-8jwlc" event={"ID":"f0cf14ba-80b0-4f55-970e-4e2c267717b3","Type":"ContainerDied","Data":"d372fd9a68966d176dd4714731bbc305954110c2b0c3bc851867ea6c19101208"}
Jul 16 21:20:10.643339 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.643024    2559 scope.go:117] "RemoveContainer" containerID="9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"
Jul 16 21:20:10.652750 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.652723    2559 scope.go:117] "RemoveContainer" containerID="9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"
Jul 16 21:20:10.653046 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:20:10.653023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6\": container with ID starting with 9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6 not found: ID does not exist" containerID="9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"
Jul 16 21:20:10.653172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.653058    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6"} err="failed to get container status \"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6\": rpc error: code = NotFound desc = could not find container \"9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6\": container with ID starting with 9b8a5a439f61d078f57147916f76e76bb3ee9a2719361b9da100d44c909dcce6 not found: ID does not exist"
Jul 16 21:20:10.665550 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.665529    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:20:10.669463 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:10.669442    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-564df84566-8jwlc"]
Jul 16 21:20:11.678862 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:11.678830    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" path="/var/lib/kubelet/pods/f0cf14ba-80b0-4f55-970e-4e2c267717b3/volumes"
Jul 16 21:20:29.321544 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.321505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:20:29.922473 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.922438    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"]
Jul 16 21:20:29.922831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.922820    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" containerName="manager"
Jul 16 21:20:29.922872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.922833    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" containerName="manager"
Jul 16 21:20:29.922906 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.922894    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0cf14ba-80b0-4f55-970e-4e2c267717b3" containerName="manager"
Jul 16 21:20:29.928512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.928491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:29.931479 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.931460    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 21:20:29.940362 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.940338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"]
Jul 16 21:20:29.959620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.959595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gs4m\" (UniqueName: \"kubernetes.io/projected/00b1793f-d48e-4c8e-984a-b9adf6ad7841-kube-api-access-6gs4m\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:29.959725 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.959635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b1793f-d48e-4c8e-984a-b9adf6ad7841-maas-api-tls\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:29.959725 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:29.959651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b1793f-d48e-4c8e-984a-b9adf6ad7841-openshift-service-ca\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.060923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.060901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gs4m\" (UniqueName: \"kubernetes.io/projected/00b1793f-d48e-4c8e-984a-b9adf6ad7841-kube-api-access-6gs4m\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.061134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.060939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b1793f-d48e-4c8e-984a-b9adf6ad7841-maas-api-tls\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.061134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.060957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b1793f-d48e-4c8e-984a-b9adf6ad7841-openshift-service-ca\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.061684 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.061660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b1793f-d48e-4c8e-984a-b9adf6ad7841-openshift-service-ca\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.063662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.063642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b1793f-d48e-4c8e-984a-b9adf6ad7841-maas-api-tls\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.070587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.070556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gs4m\" (UniqueName: \"kubernetes.io/projected/00b1793f-d48e-4c8e-984a-b9adf6ad7841-kube-api-access-6gs4m\") pod \"maas-api-96f5c9c8d-qjb6l\" (UID: \"00b1793f-d48e-4c8e-984a-b9adf6ad7841\") " pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.239845 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.239816    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:30.383235 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.383205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"]
Jul 16 21:20:30.386560 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:20:30.386528    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b1793f_d48e_4c8e_984a_b9adf6ad7841.slice/crio-aa1a16b5d6e752ad38c8d79bc47561e6c0133ef9a9daafd5edecd306553356ac WatchSource:0}: Error finding container aa1a16b5d6e752ad38c8d79bc47561e6c0133ef9a9daafd5edecd306553356ac: Status 404 returned error can't find the container with id aa1a16b5d6e752ad38c8d79bc47561e6c0133ef9a9daafd5edecd306553356ac
Jul 16 21:20:30.512236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.512157    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"]
Jul 16 21:20:30.516821 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.516804    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.522914 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.522893    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 21:20:30.523041 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.522899    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j7sf7\""
Jul 16 21:20:30.528794 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.528775    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"]
Jul 16 21:20:30.564829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.564800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcmtp\" (UniqueName: \"kubernetes.io/projected/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-kube-api-access-mcmtp\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.564962 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.564858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.666039 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.666007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.666240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.666112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcmtp\" (UniqueName: \"kubernetes.io/projected/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-kube-api-access-mcmtp\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.666739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.666714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.675971 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.675948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcmtp\" (UniqueName: \"kubernetes.io/projected/79c6d579-6c65-4b1c-bc22-73caf9e2e8bb-kube-api-access-mcmtp\") pod \"payload-pre-processing-7677b774bb-kkjgw\" (UID: \"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.737415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.737381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l" event={"ID":"00b1793f-d48e-4c8e-984a-b9adf6ad7841","Type":"ContainerStarted","Data":"aa1a16b5d6e752ad38c8d79bc47561e6c0133ef9a9daafd5edecd306553356ac"}
Jul 16 21:20:30.829035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.828956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:30.881592 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.881560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:20:30.967447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:30.967421    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"]
Jul 16 21:20:30.970064 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:20:30.970040    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c6d579_6c65_4b1c_bc22_73caf9e2e8bb.slice/crio-12a6782a2b3d33295d5510687f0760e07b1ea562c8e1da40b97aaa2e18bfa020 WatchSource:0}: Error finding container 12a6782a2b3d33295d5510687f0760e07b1ea562c8e1da40b97aaa2e18bfa020: Status 404 returned error can't find the container with id 12a6782a2b3d33295d5510687f0760e07b1ea562c8e1da40b97aaa2e18bfa020
Jul 16 21:20:31.779135 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:31.779042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw" event={"ID":"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb","Type":"ContainerStarted","Data":"12a6782a2b3d33295d5510687f0760e07b1ea562c8e1da40b97aaa2e18bfa020"}
Jul 16 21:20:32.787032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:32.786994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l" event={"ID":"00b1793f-d48e-4c8e-984a-b9adf6ad7841","Type":"ContainerStarted","Data":"0080165d87084aa6fe5014aba0ff861cf82a3272c67748e4b02feede9f3340e8"}
Jul 16 21:20:32.787524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:32.787156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:32.806346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:32.806198    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l" podStartSLOduration=1.730712203 podStartE2EDuration="3.806178824s" totalImagesPullingTime="2.075466621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:20:32.804137404 +0000 UTC m=+695.654754784" watchObservedRunningTime="2026-07-16 21:20:32.806178824 +0000 UTC m=+695.656796202"
Jul 16 21:20:34.801223 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:34.801188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw" event={"ID":"79c6d579-6c65-4b1c-bc22-73caf9e2e8bb","Type":"ContainerStarted","Data":"aa1fe73759d45f265307aca6f06bb53edb0c291559ad9bd1a68e3477b5420288"}
Jul 16 21:20:34.801625 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:34.801387    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:34.820530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:34.820488    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw" podStartSLOduration=1.6832061249999999 podStartE2EDuration="4.82047412s" totalImagesPullingTime="3.137267995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:20:34.818655365 +0000 UTC m=+697.669272743" watchObservedRunningTime="2026-07-16 21:20:34.82047412 +0000 UTC m=+697.671091496"
Jul 16 21:20:38.158685 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.158037    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x5zst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:41572->10.132.0.40:15021: read: connection reset by peer" start-of-body=
Jul 16 21:20:38.158685 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.158117    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podUID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:41572->10.132.0.40:15021: read: connection reset by peer"
Jul 16 21:20:38.800011 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.799977    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-96f5c9c8d-qjb6l"
Jul 16 21:20:38.825918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.825888    2559 generic.go:356] "Generic (PLEG): container finished" podID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerID="929961d9f6c859e9f67ccd2b4d256d648acd80c81e1d6c0f0259c827fba5dcf9" exitCode=0
Jul 16 21:20:38.826051 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.825959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" event={"ID":"d43af5c5-eb03-48ef-b2b1-45c000406f78","Type":"ContainerDied","Data":"929961d9f6c859e9f67ccd2b4d256d648acd80c81e1d6c0f0259c827fba5dcf9"}
Jul 16 21:20:38.826361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.826344    2559 scope.go:117] "RemoveContainer" containerID="929961d9f6c859e9f67ccd2b4d256d648acd80c81e1d6c0f0259c827fba5dcf9"
Jul 16 21:20:38.827313 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.827283    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:20:38.827411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.827346    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:20:38.827411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:38.827378    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:20:39.832862 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.832786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" event={"ID":"d43af5c5-eb03-48ef-b2b1-45c000406f78","Type":"ContainerStarted","Data":"dec2283913d8671bcf213c17992e89f2d2c3d4941cc7683f42e82e217a7d0064"}
Jul 16 21:20:39.863626 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.863582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:20:39.940687 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.940654    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:20:39.940869 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.940848    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x5zst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:20:39.940953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.940921    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podUID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 16 21:20:39.957215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:39.957174    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:20:40.940215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:40.940181    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x5zst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:20:40.940593 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:40.940246    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podUID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 16 21:20:41.940505 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:41.940468    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x5zst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:20:41.941145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:41.941108    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podUID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 16 21:20:42.939929 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:42.939891    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x5zst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:20:42.940111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:42.939962    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst" podUID="d43af5c5-eb03-48ef-b2b1-45c000406f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 16 21:20:43.943427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:43.943398    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:20:43.943901 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:43.943671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:20:43.944507 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:43.944488    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x5zst"
Jul 16 21:20:45.812604 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:45.812573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kkjgw"
Jul 16 21:20:50.324557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.324480    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"]
Jul 16 21:20:50.329341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.329316    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.332594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.332569    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 21:20:50.332741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.332645    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 21:20:50.332741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.332655    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j767n\""
Jul 16 21:20:50.334317 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.334299    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 21:20:50.340812 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.340792    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"]
Jul 16 21:20:50.357167 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.357142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:20:50.446241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d4d9\" (UniqueName: \"kubernetes.io/projected/b4d58343-875a-4530-8d0c-90e3cb146e99-kube-api-access-6d4d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.446389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.446389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.446389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.446389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d58343-875a-4530-8d0c-90e3cb146e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.446540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.446392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547757 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4d9\" (UniqueName: \"kubernetes.io/projected/b4d58343-875a-4530-8d0c-90e3cb146e99-kube-api-access-6d4d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d58343-875a-4530-8d0c-90e3cb146e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.547910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.547906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.548259 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.548233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.548451 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.548426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.548664 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.548632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.550238 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.550212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d58343-875a-4530-8d0c-90e3cb146e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.550753 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.550730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d58343-875a-4530-8d0c-90e3cb146e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.558446 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.558420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d4d9\" (UniqueName: \"kubernetes.io/projected/b4d58343-875a-4530-8d0c-90e3cb146e99-kube-api-access-6d4d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9\" (UID: \"b4d58343-875a-4530-8d0c-90e3cb146e99\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.639879 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.639797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:20:50.780489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.780462    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"]
Jul 16 21:20:50.782851 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:20:50.782825    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d58343_875a_4530_8d0c_90e3cb146e99.slice/crio-e552cbe2174bcdf5bda8f78356eb2d740851a4c95123f1f31eca3f8018ecadfd WatchSource:0}: Error finding container e552cbe2174bcdf5bda8f78356eb2d740851a4c95123f1f31eca3f8018ecadfd: Status 404 returned error can't find the container with id e552cbe2174bcdf5bda8f78356eb2d740851a4c95123f1f31eca3f8018ecadfd
Jul 16 21:20:50.888998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:50.888966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9" event={"ID":"b4d58343-875a-4530-8d0c-90e3cb146e99","Type":"ContainerStarted","Data":"e552cbe2174bcdf5bda8f78356eb2d740851a4c95123f1f31eca3f8018ecadfd"}
Jul 16 21:20:52.901623 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:52.901582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9" event={"ID":"b4d58343-875a-4530-8d0c-90e3cb146e99","Type":"ContainerStarted","Data":"c7836472843ae22a30d73d3a41459f1fcfe38204a1f3f65fb487339cdf78c99e"}
Jul 16 21:20:52.921829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:52.921785    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9" podStartSLOduration=1.674702449 podStartE2EDuration="2.921769662s" totalImagesPullingTime="1.247067213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:20:52.919589389 +0000 UTC m=+715.770206770" watchObservedRunningTime="2026-07-16 21:20:52.921769662 +0000 UTC m=+715.772387039"
Jul 16 21:20:58.116549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:20:58.116463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:00.640514 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:00.640479    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:21:00.640989 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:00.640838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:21:00.655874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:00.655846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:21:00.953595 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:00.953518    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9"
Jul 16 21:21:06.734085 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:06.734043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:16.751659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:16.751619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:19.903769 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:19.903731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:22.810353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.810321    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"]
Jul 16 21:21:22.814252 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.814232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.817566 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.817539    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 21:21:22.834975 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.834947    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"]
Jul 16 21:21:22.838168 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.838140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:22.920263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.920384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.920384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.920462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.920462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:22.920462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:22.920449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxqnv\" (UniqueName: \"kubernetes.io/projected/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-kube-api-access-cxqnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqnv\" (UniqueName: \"kubernetes.io/projected/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-kube-api-access-cxqnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021520 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.021735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.021724    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.023886 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.023865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.024262 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.024244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.030075 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.030054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxqnv\" (UniqueName: \"kubernetes.io/projected/0368cc7e-b458-455a-9ace-aba1bb2e3f7e-kube-api-access-cxqnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979\" (UID: \"0368cc7e-b458-455a-9ace-aba1bb2e3f7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.128764 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.128682    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:23.284419 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.284394    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"]
Jul 16 21:21:23.286283 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:21:23.286257    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0368cc7e_b458_455a_9ace_aba1bb2e3f7e.slice/crio-811ed411f36347ce5c4f519ac62099c59c1160c5f5117c1fc4d7aac64cba2014 WatchSource:0}: Error finding container 811ed411f36347ce5c4f519ac62099c59c1160c5f5117c1fc4d7aac64cba2014: Status 404 returned error can't find the container with id 811ed411f36347ce5c4f519ac62099c59c1160c5f5117c1fc4d7aac64cba2014
Jul 16 21:21:23.287579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:23.287558    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:21:24.056964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:24.056932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979" event={"ID":"0368cc7e-b458-455a-9ace-aba1bb2e3f7e","Type":"ContainerStarted","Data":"2ea098c60d0ba787e54e3c891a18d54793eecfb176f1283b13de1ebd262f88e4"}
Jul 16 21:21:24.057462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:24.056984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979" event={"ID":"0368cc7e-b458-455a-9ace-aba1bb2e3f7e","Type":"ContainerStarted","Data":"811ed411f36347ce5c4f519ac62099c59c1160c5f5117c1fc4d7aac64cba2014"}
Jul 16 21:21:24.077451 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:24.077406    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979" podStartSLOduration=1.842974466 podStartE2EDuration="2.077392894s" totalImagesPullingTime="234.418428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:21:24.076529945 +0000 UTC m=+746.927147323" watchObservedRunningTime="2026-07-16 21:21:24.077392894 +0000 UTC m=+746.928010270"
Jul 16 21:21:31.749463 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:31.749430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:33.129583 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:33.129547    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:33.129977 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:33.129609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:33.142493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:33.142469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:33.715596 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:33.715525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:21:34.124359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:34.124285    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979"
Jul 16 21:21:48.757114 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:21:48.757062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:22:41.981791 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:41.981758    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:22:42.078266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:42.078238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:22:43.481286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.481246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:22:43.540674 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.540643    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:22:43.540879 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.540857    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5db79bdf59-klxt6" podUID="043537e3-67b5-467f-a26f-84ccffdfbcdb" containerName="authorino" containerID="cri-o://02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad" gracePeriod=30
Jul 16 21:22:43.700317 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.700276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:22:43.802705 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.802681    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:22:43.913474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.913439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert\") pod \"043537e3-67b5-467f-a26f-84ccffdfbcdb\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") "
Jul 16 21:22:43.913648 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.913517    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56wvx\" (UniqueName: \"kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx\") pod \"043537e3-67b5-467f-a26f-84ccffdfbcdb\" (UID: \"043537e3-67b5-467f-a26f-84ccffdfbcdb\") "
Jul 16 21:22:43.915690 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.915658    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx" (OuterVolumeSpecName: "kube-api-access-56wvx") pod "043537e3-67b5-467f-a26f-84ccffdfbcdb" (UID: "043537e3-67b5-467f-a26f-84ccffdfbcdb"). InnerVolumeSpecName "kube-api-access-56wvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:22:43.926323 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:43.926300    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "043537e3-67b5-467f-a26f-84ccffdfbcdb" (UID: "043537e3-67b5-467f-a26f-84ccffdfbcdb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:22:44.014489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.014465    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56wvx\" (UniqueName: \"kubernetes.io/projected/043537e3-67b5-467f-a26f-84ccffdfbcdb-kube-api-access-56wvx\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:22:44.014489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.014489    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/043537e3-67b5-467f-a26f-84ccffdfbcdb-tls-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:22:44.476905 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.476871    2559 generic.go:356] "Generic (PLEG): container finished" podID="043537e3-67b5-467f-a26f-84ccffdfbcdb" containerID="02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad" exitCode=0
Jul 16 21:22:44.477064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.476910    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79bdf59-klxt6"
Jul 16 21:22:44.477064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.476945    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79bdf59-klxt6" event={"ID":"043537e3-67b5-467f-a26f-84ccffdfbcdb","Type":"ContainerDied","Data":"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"}
Jul 16 21:22:44.477064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.476981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79bdf59-klxt6" event={"ID":"043537e3-67b5-467f-a26f-84ccffdfbcdb","Type":"ContainerDied","Data":"1e5901966de2435181b2b4727dabeca016d45ce4c053ecc75d679d46fd988471"}
Jul 16 21:22:44.477064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.477002    2559 scope.go:117] "RemoveContainer" containerID="02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"
Jul 16 21:22:44.486422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.486405    2559 scope.go:117] "RemoveContainer" containerID="02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"
Jul 16 21:22:44.486696 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:22:44.486668    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad\": container with ID starting with 02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad not found: ID does not exist" containerID="02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"
Jul 16 21:22:44.486739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.486692    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad"} err="failed to get container status \"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad\": rpc error: code = NotFound desc = could not find container \"02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad\": container with ID starting with 02f169ab5439aa71e6426bda32da04b416d6e0603aee03ee8b98b879495be4ad not found: ID does not exist"
Jul 16 21:22:44.510512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.510490    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:22:44.520743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:44.520722    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5db79bdf59-klxt6"]
Jul 16 21:22:45.679060 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:22:45.679029    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="043537e3-67b5-467f-a26f-84ccffdfbcdb" path="/var/lib/kubelet/pods/043537e3-67b5-467f-a26f-84ccffdfbcdb/volumes"
Jul 16 21:23:28.420570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.420539    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:23:28.421178 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.420727    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57c55c95-zvpzp" podUID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" containerName="manager" containerID="cri-o://67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e" gracePeriod=30
Jul 16 21:23:28.678747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.678679    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:23:28.692993 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.692962    2559 generic.go:356] "Generic (PLEG): container finished" podID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" containerID="67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e" exitCode=0
Jul 16 21:23:28.693163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.693000    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zvpzp"
Jul 16 21:23:28.693163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.693040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zvpzp" event={"ID":"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b","Type":"ContainerDied","Data":"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"}
Jul 16 21:23:28.693163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.693107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zvpzp" event={"ID":"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b","Type":"ContainerDied","Data":"0b90d973ac9cff68f63907a2f702b913e42b690cf3e36d917a8ecf6a79a4bd76"}
Jul 16 21:23:28.693163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.693154    2559 scope.go:117] "RemoveContainer" containerID="67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"
Jul 16 21:23:28.702206 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.702183    2559 scope.go:117] "RemoveContainer" containerID="67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"
Jul 16 21:23:28.702615 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:23:28.702547    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e\": container with ID starting with 67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e not found: ID does not exist" containerID="67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"
Jul 16 21:23:28.702615 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.702585    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e"} err="failed to get container status \"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e\": rpc error: code = NotFound desc = could not find container \"67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e\": container with ID starting with 67c15a7e33ac6bff8cfaa96ed37d4570a0b82a51d5fecf34a9dc332e23cb2f9e not found: ID does not exist"
Jul 16 21:23:28.715240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.715215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert\") pod \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") "
Jul 16 21:23:28.715348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.715298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z76n\" (UniqueName: \"kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n\") pod \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\" (UID: \"f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b\") "
Jul 16 21:23:28.717401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.717373    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" (UID: "f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:23:28.717527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.717451    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n" (OuterVolumeSpecName: "kube-api-access-7z76n") pod "f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" (UID: "f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b"). InnerVolumeSpecName "kube-api-access-7z76n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:23:28.816979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.816950    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-webhook-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:23:28.816979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:28.816975    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z76n\" (UniqueName: \"kubernetes.io/projected/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b-kube-api-access-7z76n\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:23:29.017648 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:29.017620    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:23:29.022319 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:29.022295    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57c55c95-zvpzp"]
Jul 16 21:23:29.679072 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:29.679040    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" path="/var/lib/kubelet/pods/f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b/volumes"
Jul 16 21:23:57.630127 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:57.630032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:23:57.635322 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:23:57.635301    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:24:29.850623 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.850582    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:29.851074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851017    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043537e3-67b5-467f-a26f-84ccffdfbcdb" containerName="authorino"
Jul 16 21:24:29.851074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851029    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="043537e3-67b5-467f-a26f-84ccffdfbcdb" containerName="authorino"
Jul 16 21:24:29.851074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851042    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" containerName="manager"
Jul 16 21:24:29.851074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851048    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" containerName="manager"
Jul 16 21:24:29.851233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851130    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="043537e3-67b5-467f-a26f-84ccffdfbcdb" containerName="authorino"
Jul 16 21:24:29.851233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.851143    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2a5693d-2ab8-4e21-abe0-1f96c5b35e8b" containerName="manager"
Jul 16 21:24:29.854246 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.854230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:29.859228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.859205    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqfq7\""
Jul 16 21:24:29.859228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.859225    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 21:24:29.859435 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.859231    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 21:24:29.864189 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.864166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:29.963866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.963829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:29.964038 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:29.963937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4d4\" (UniqueName: \"kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.064843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.064810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4d4\" (UniqueName: \"kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.065001 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.064899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.067512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.067492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.073970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.073951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4d4\" (UniqueName: \"kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4\") pod \"maas-controller-57c55c95-zklhp\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") " pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.166059 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.165973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:30.301872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:30.301843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:30.303383 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:24:30.303360    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b7092b_6417_4c74_9ce1_1d1fa6dd7b87.slice/crio-66a373581dd7110059c8838ac10be8ef541b5f507e8d811a344858c9eb84a6a7 WatchSource:0}: Error finding container 66a373581dd7110059c8838ac10be8ef541b5f507e8d811a344858c9eb84a6a7: Status 404 returned error can't find the container with id 66a373581dd7110059c8838ac10be8ef541b5f507e8d811a344858c9eb84a6a7
Jul 16 21:24:31.001552 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:31.001473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zklhp" event={"ID":"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87","Type":"ContainerStarted","Data":"672d9396e64001b0e90c567cd2b06e9778b699ad75d5e657e313561ebd664099"}
Jul 16 21:24:31.001919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:31.001549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zklhp" event={"ID":"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87","Type":"ContainerStarted","Data":"66a373581dd7110059c8838ac10be8ef541b5f507e8d811a344858c9eb84a6a7"}
Jul 16 21:24:31.001919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:31.001601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:31.022955 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:31.022903    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57c55c95-zklhp" podStartSLOduration=1.599233047 podStartE2EDuration="2.022886766s" totalImagesPullingTime="423.653719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:24:31.021410324 +0000 UTC m=+933.872027700" watchObservedRunningTime="2026-07-16 21:24:31.022886766 +0000 UTC m=+933.873504142"
Jul 16 21:24:42.008102 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:42.008057    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:46.774518 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:46.774481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:24:46.904227 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:46.904195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:46.904433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:46.904406    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57c55c95-zklhp" podUID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" containerName="manager" containerID="cri-o://672d9396e64001b0e90c567cd2b06e9778b699ad75d5e657e313561ebd664099" gracePeriod=30
Jul 16 21:24:47.082244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.081991    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" containerID="672d9396e64001b0e90c567cd2b06e9778b699ad75d5e657e313561ebd664099" exitCode=0
Jul 16 21:24:47.082244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.082178    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zklhp" event={"ID":"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87","Type":"ContainerDied","Data":"672d9396e64001b0e90c567cd2b06e9778b699ad75d5e657e313561ebd664099"}
Jul 16 21:24:47.172456 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.172432    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:47.326744 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.326710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf4d4\" (UniqueName: \"kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4\") pod \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") "
Jul 16 21:24:47.326926 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.326783    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert\") pod \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\" (UID: \"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87\") "
Jul 16 21:24:47.328997 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.328960    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" (UID: "d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:24:47.329131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.328991    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4" (OuterVolumeSpecName: "kube-api-access-bf4d4") pod "d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" (UID: "d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87"). InnerVolumeSpecName "kube-api-access-bf4d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:24:47.427568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.427538    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf4d4\" (UniqueName: \"kubernetes.io/projected/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-kube-api-access-bf4d4\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:24:47.427568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:47.427567    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87-webhook-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:24:48.088343 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:48.088314    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-zklhp"
Jul 16 21:24:48.088742 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:48.088340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-zklhp" event={"ID":"d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87","Type":"ContainerDied","Data":"66a373581dd7110059c8838ac10be8ef541b5f507e8d811a344858c9eb84a6a7"}
Jul 16 21:24:48.088742 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:48.088397    2559 scope.go:117] "RemoveContainer" containerID="672d9396e64001b0e90c567cd2b06e9778b699ad75d5e657e313561ebd664099"
Jul 16 21:24:48.107729 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:48.107706    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:48.112599 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:48.112578    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57c55c95-zklhp"]
Jul 16 21:24:49.007323 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.007289    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57c55c95-hnclh"]
Jul 16 21:24:49.007701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.007684    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" containerName="manager"
Jul 16 21:24:49.007701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.007700    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" containerName="manager"
Jul 16 21:24:49.007866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.007780    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" containerName="manager"
Jul 16 21:24:49.012191 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.012175    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.017518 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.017492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 21:24:49.017657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.017539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 21:24:49.017657 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.017606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xqfq7\""
Jul 16 21:24:49.024178 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.024159    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-hnclh"]
Jul 16 21:24:49.142489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.142454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjxq\" (UniqueName: \"kubernetes.io/projected/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-kube-api-access-wpjxq\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.142856 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.142497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-webhook-cert\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.243100 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.243056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-webhook-cert\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.243254 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.243199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjxq\" (UniqueName: \"kubernetes.io/projected/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-kube-api-access-wpjxq\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.245857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.245832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-webhook-cert\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.255136 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.255115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjxq\" (UniqueName: \"kubernetes.io/projected/4bda049f-c3b4-4797-8c4e-bd267e11c0ae-kube-api-access-wpjxq\") pod \"maas-controller-57c55c95-hnclh\" (UID: \"4bda049f-c3b4-4797-8c4e-bd267e11c0ae\") " pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.323759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.323702    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:49.454280 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.454243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:24:49.465214 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.465191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57c55c95-hnclh"]
Jul 16 21:24:49.466195 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:24:49.466166    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bda049f_c3b4_4797_8c4e_bd267e11c0ae.slice/crio-c61f095ec8b709c687a76373dbddd5ed0f6faa364b7fdb723a65fc853aba49c0 WatchSource:0}: Error finding container c61f095ec8b709c687a76373dbddd5ed0f6faa364b7fdb723a65fc853aba49c0: Status 404 returned error can't find the container with id c61f095ec8b709c687a76373dbddd5ed0f6faa364b7fdb723a65fc853aba49c0
Jul 16 21:24:49.679785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:49.679700    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87" path="/var/lib/kubelet/pods/d7b7092b-6417-4c74-9ce1-1d1fa6dd7b87/volumes"
Jul 16 21:24:50.100966 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:50.100940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-hnclh" event={"ID":"4bda049f-c3b4-4797-8c4e-bd267e11c0ae","Type":"ContainerStarted","Data":"c61f095ec8b709c687a76373dbddd5ed0f6faa364b7fdb723a65fc853aba49c0"}
Jul 16 21:24:51.107998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:51.107951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57c55c95-hnclh" event={"ID":"4bda049f-c3b4-4797-8c4e-bd267e11c0ae","Type":"ContainerStarted","Data":"a1faef1c2030e38c1d525673bfdd4e3724c193e298bb8f8230a44a1311b9929c"}
Jul 16 21:24:51.108442 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:51.108037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:24:51.128453 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:24:51.128409    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57c55c95-hnclh" podStartSLOduration=2.516796318 podStartE2EDuration="3.128394566s" totalImagesPullingTime="611.598248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:24:51.127630585 +0000 UTC m=+953.978247962" watchObservedRunningTime="2026-07-16 21:24:51.128394566 +0000 UTC m=+953.979011972"
Jul 16 21:25:02.115444 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:02.115410    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57c55c95-hnclh"
Jul 16 21:25:30.293036 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:30.292985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:30.386249 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:30.386219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:30.518471 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:30.518440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:36.453157 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:36.453119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:38.109770 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:38.109726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:40.377521 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:40.377477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:43.129477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:43.129421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:43.314386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:43.314357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:49.874115 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:49.874063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:49.998941 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:49.998910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:25:51.264931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:25:51.264896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:28:57.664841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:28:57.664768    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:28:57.666571 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:28:57.666550    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:29:48.092642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:48.092606    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:29:48.093258 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:48.092792    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" podUID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" containerName="manager" containerID="cri-o://8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c" gracePeriod=10
Jul 16 21:29:51.759245 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:51.759219    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:29:51.912642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:51.912567    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f55r7\" (UniqueName: \"kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7\") pod \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") "
Jul 16 21:29:51.912642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:51.912615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume\") pod \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\" (UID: \"14c09cf1-d2ee-4423-9849-e5111aeb9f12\") "
Jul 16 21:29:51.913023 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:51.913000    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14c09cf1-d2ee-4423-9849-e5111aeb9f12" (UID: "14c09cf1-d2ee-4423-9849-e5111aeb9f12"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:29:51.914784 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:51.914763    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7" (OuterVolumeSpecName: "kube-api-access-f55r7") pod "14c09cf1-d2ee-4423-9849-e5111aeb9f12" (UID: "14c09cf1-d2ee-4423-9849-e5111aeb9f12"). InnerVolumeSpecName "kube-api-access-f55r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:29:52.013703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.013681    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f55r7\" (UniqueName: \"kubernetes.io/projected/14c09cf1-d2ee-4423-9849-e5111aeb9f12-kube-api-access-f55r7\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:29:52.013703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.013701    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14c09cf1-d2ee-4423-9849-e5111aeb9f12-extensions-socket-volume\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:29:52.601130 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.601077    2559 generic.go:356] "Generic (PLEG): container finished" podID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" containerID="8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c" exitCode=0
Jul 16 21:29:52.601130 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.601125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" event={"ID":"14c09cf1-d2ee-4423-9849-e5111aeb9f12","Type":"ContainerDied","Data":"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"}
Jul 16 21:29:52.601350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.601151    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"
Jul 16 21:29:52.601350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.601223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9" event={"ID":"14c09cf1-d2ee-4423-9849-e5111aeb9f12","Type":"ContainerDied","Data":"dd7ab110b373fdb932e2b684ec950c0d971dec0d98a6fec2b6fda35565acefdd"}
Jul 16 21:29:52.601350 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.601251    2559 scope.go:117] "RemoveContainer" containerID="8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"
Jul 16 21:29:52.612143 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.611981    2559 scope.go:117] "RemoveContainer" containerID="8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"
Jul 16 21:29:52.612279 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:29:52.612262    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c\": container with ID starting with 8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c not found: ID does not exist" containerID="8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"
Jul 16 21:29:52.612321 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.612288    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c"} err="failed to get container status \"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c\": rpc error: code = NotFound desc = could not find container \"8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c\": container with ID starting with 8f57d49f7dc56762bb08b2fe722bffca7436245a9ad5d5433073793f8a517d5c not found: ID does not exist"
Jul 16 21:29:52.626100 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.626062    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:29:52.632485 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:52.632466    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j28z9"]
Jul 16 21:29:53.678763 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:29:53.678721    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" path="/var/lib/kubelet/pods/14c09cf1-d2ee-4423-9849-e5111aeb9f12/volumes"
Jul 16 21:30:00.210202 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.210153    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"]
Jul 16 21:30:00.210620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.210555    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" containerName="manager"
Jul 16 21:30:00.210620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.210566    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" containerName="manager"
Jul 16 21:30:00.210701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.210635    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c09cf1-d2ee-4423-9849-e5111aeb9f12" containerName="manager"
Jul 16 21:30:00.214812 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.214794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"
Jul 16 21:30:00.218259 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.218238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:30:00.224470 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.224453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"
Jul 16 21:30:00.234667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.234646    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"]
Jul 16 21:30:00.364889 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.364865    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"]
Jul 16 21:30:00.366583 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:30:00.366554    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8608f0b3_9b6d_4f1c_aea4_c4a0b07103ea.slice/crio-d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c WatchSource:0}: Error finding container d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c: Status 404 returned error can't find the container with id d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c
Jul 16 21:30:00.368612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.368596    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:30:00.654802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:00.654770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht" event={"ID":"8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea","Type":"ContainerStarted","Data":"d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c"}
Jul 16 21:30:04.675637 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:04.675608    2559 generic.go:356] "Generic (PLEG): container finished" podID="8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea" containerID="792d1d8433d6989111dd54e60802afe53d30343f7dc5f9db7a679d2e204dabd9" exitCode=0
Jul 16 21:30:04.675967 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:04.675688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht" event={"ID":"8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea","Type":"ContainerDied","Data":"792d1d8433d6989111dd54e60802afe53d30343f7dc5f9db7a679d2e204dabd9"}
Jul 16 21:30:05.823569 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:05.823546    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"
Jul 16 21:30:06.685528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:06.685496    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht"
Jul 16 21:30:06.685697 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:06.685495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737290-xb8ht" event={"ID":"8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea","Type":"ContainerDied","Data":"d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c"}
Jul 16 21:30:06.685697 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:06.685628    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d320578af27feec20d82e4deef8bf0bcaf77501ff9ccff490e68306d558d123c"
Jul 16 21:30:49.226321 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.226294    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"]
Jul 16 21:30:49.229061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.226688    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea" containerName="cleanup"
Jul 16 21:30:49.229061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.226699    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea" containerName="cleanup"
Jul 16 21:30:49.229061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.226757    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea" containerName="cleanup"
Jul 16 21:30:49.230253 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.230223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.233346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.233328    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7vxp\""
Jul 16 21:30:49.245019 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.244990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"]
Jul 16 21:30:49.391728 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.391701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdtkh\" (UniqueName: \"kubernetes.io/projected/4af092dd-bf01-4b0e-b556-3343ffd55a94-kube-api-access-wdtkh\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.391862 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.391814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4af092dd-bf01-4b0e-b556-3343ffd55a94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.492789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.492722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4af092dd-bf01-4b0e-b556-3343ffd55a94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.492789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.492762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdtkh\" (UniqueName: \"kubernetes.io/projected/4af092dd-bf01-4b0e-b556-3343ffd55a94-kube-api-access-wdtkh\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.493078 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.493059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4af092dd-bf01-4b0e-b556-3343ffd55a94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.502268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.502245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdtkh\" (UniqueName: \"kubernetes.io/projected/4af092dd-bf01-4b0e-b556-3343ffd55a94-kube-api-access-wdtkh\") pod \"kuadrant-operator-controller-manager-86878c769f-xhjpb\" (UID: \"4af092dd-bf01-4b0e-b556-3343ffd55a94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.540363 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.540341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.698194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.698172    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"]
Jul 16 21:30:49.700734 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:30:49.700705    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af092dd_bf01_4b0e_b556_3343ffd55a94.slice/crio-235923724e2e13086da77a16f141fe34d2cf961e84f04ce957bc9ed0bb6231f4 WatchSource:0}: Error finding container 235923724e2e13086da77a16f141fe34d2cf961e84f04ce957bc9ed0bb6231f4: Status 404 returned error can't find the container with id 235923724e2e13086da77a16f141fe34d2cf961e84f04ce957bc9ed0bb6231f4
Jul 16 21:30:49.899573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.899540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb" event={"ID":"4af092dd-bf01-4b0e-b556-3343ffd55a94","Type":"ContainerStarted","Data":"f3b731ea58fad4b3f6e34ed6eac2bc58975f87a9fc6e8ac6b64738d789ed2077"}
Jul 16 21:30:49.899746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.899585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb" event={"ID":"4af092dd-bf01-4b0e-b556-3343ffd55a94","Type":"ContainerStarted","Data":"235923724e2e13086da77a16f141fe34d2cf961e84f04ce957bc9ed0bb6231f4"}
Jul 16 21:30:49.899746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.899618    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:30:49.921686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:30:49.921629    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb" podStartSLOduration=0.921613621 podStartE2EDuration="921.613621ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:30:49.919522296 +0000 UTC m=+1312.770139673" watchObservedRunningTime="2026-07-16 21:30:49.921613621 +0000 UTC m=+1312.772230997"
Jul 16 21:31:00.906502 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:31:00.906471    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xhjpb"
Jul 16 21:31:12.141785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:31:12.141751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:31:13.469779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:31:13.469748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:32:27.675897 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:32:27.675861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:32:37.928823 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:32:37.928777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:33:30.007323 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:33:30.007266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:33:30.107045 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:33:30.106982    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:33:57.697345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:33:57.697310    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:33:57.697870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:33:57.697608    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:36:49.704542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:36:49.704509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:36:56.704759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:36:56.704720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:04.652480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:04.652444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:09.968260 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:09.967998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:12.811938 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:12.811906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:12.915075 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:12.915041    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:13.283058 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:13.283013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:19.517520 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:19.517431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:19.583323 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:19.583284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:19.770741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:19.770659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:19.855799 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:19.855746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:20.954179 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:20.954135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:21.040909 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.040874    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:37:21.045129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.045082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.048541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.048410    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xcg5c\""
Jul 16 21:37:21.048541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.048494    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fc2328dc-serving-cert\""
Jul 16 21:37:21.056311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.056288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:37:21.158048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.158016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.158284 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.158068    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.158284 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.158112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqzg\" (UniqueName: \"kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.259207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.259171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqzg\" (UniqueName: \"kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.259378 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.259282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.259378 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.259321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.259903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.259879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.261862 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.261829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.274455 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.274431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqzg\" (UniqueName: \"kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg\") pod \"maas-api-e2e-ait-fc2328dc-6449898788-jzgvn\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.285701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.285676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:21.358256 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.358222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:21.386582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.386551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:21.503907 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.503880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:37:21.505272 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:37:21.505241    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933548dd_a8ef_4d63_a6b7_390d2eaf1632.slice/crio-25a71c2a584b993c981ddc829546f7ae2483e949b76ef82191d5b9ba12652108 WatchSource:0}: Error finding container 25a71c2a584b993c981ddc829546f7ae2483e949b76ef82191d5b9ba12652108: Status 404 returned error can't find the container with id 25a71c2a584b993c981ddc829546f7ae2483e949b76ef82191d5b9ba12652108
Jul 16 21:37:21.506742 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.506723    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:37:21.699852 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.699770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:21.830401 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.830312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:21.891150 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:21.891116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerStarted","Data":"25a71c2a584b993c981ddc829546f7ae2483e949b76ef82191d5b9ba12652108"}
Jul 16 21:37:22.901587 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:22.901555    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="93a6a49905e7af11b0da911ed7bb1dd4d75cc34f1ad79292a1c8cd22a9421b74" exitCode=1
Jul 16 21:37:22.901922 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:22.901640    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"93a6a49905e7af11b0da911ed7bb1dd4d75cc34f1ad79292a1c8cd22a9421b74"}
Jul 16 21:37:22.901922 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:22.901843    2559 scope.go:117] "RemoveContainer" containerID="93a6a49905e7af11b0da911ed7bb1dd4d75cc34f1ad79292a1c8cd22a9421b74"
Jul 16 21:37:23.908458 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:23.908367    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2" exitCode=1
Jul 16 21:37:23.908891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:23.908461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"}
Jul 16 21:37:23.908891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:23.908529    2559 scope.go:117] "RemoveContainer" containerID="93a6a49905e7af11b0da911ed7bb1dd4d75cc34f1ad79292a1c8cd22a9421b74"
Jul 16 21:37:23.908891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:23.908651    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:23.908891 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:23.908838    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:24.285624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:24.285592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:37:24.914808 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:24.914776    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:24.915291 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:24.914981    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:26.359297 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:26.359260    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:26.359757 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:26.359742    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:26.359973 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:26.359949    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:31.359181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:31.359150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:31.359553 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:31.359485    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:31.359695 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:31.359676    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:42.673149 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:42.673115    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:44.013734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:44.013700    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd" exitCode=1
Jul 16 21:37:44.014156 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:44.013776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"}
Jul 16 21:37:44.014156 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:44.013846    2559 scope.go:117] "RemoveContainer" containerID="0f176cdcbf35768aabbe8020eeceb907f166d8b07e956ae2005cb138d8beeea2"
Jul 16 21:37:44.014268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:44.014170    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:37:44.014384 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:44.014358    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:46.358357 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:46.358326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:46.358739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:46.358660    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:37:46.358833 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:46.358815    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:37:51.358355 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:51.358322    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:37:51.358751 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:37:51.358706    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:37:51.358911 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:37:51.358887    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:02.672880 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:02.672853    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:38:02.673353 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:38:02.673025    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:17.674902 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:17.674874    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:38:19.197220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:19.197189    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed" exitCode=1
Jul 16 21:38:19.197624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:19.197226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"}
Jul 16 21:38:19.197624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:19.197275    2559 scope.go:117] "RemoveContainer" containerID="b13426320520b917f76d9373915cd156dda5a2a6c0440d144724f282064470bd"
Jul 16 21:38:19.197624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:19.197544    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:38:19.197813 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:38:19.197789    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:21.358516 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:21.358487    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:38:21.358912 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:21.358550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:38:21.358912 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:21.358857    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:38:21.359038 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:38:21.359020    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:35.673161 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:35.673129    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:38:35.673636 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:38:35.673365    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:48.672425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:48.672394    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:38:48.672782 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:38:48.672582    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:38:55.580494 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:55.580457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:38:57.730460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:57.730431    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:38:57.732973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:38:57.732948    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:39:02.672706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:02.672675    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:39:04.458347 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:04.458315    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc" exitCode=1
Jul 16 21:39:04.458742 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:04.458390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"}
Jul 16 21:39:04.458742 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:04.458454    2559 scope.go:117] "RemoveContainer" containerID="b76c6f83350d7a84b53a61627d8f738ee74d2354b3c23d0031bb294ab892e0ed"
Jul 16 21:39:04.458876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:04.458748    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:04.458958 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:04.458938    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:06.359067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:06.359037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:39:06.359459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:06.359408    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:06.359615 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:06.359586    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:11.358969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:11.358938    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:39:11.359435 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:11.359306    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:11.359479 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:11.359463    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:22.672891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:22.672860    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:22.673310 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:22.673037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:33.678789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:33.678764    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:33.679178 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:33.678931    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:34.904208 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:34.904175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:34.966344 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:34.966310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:44.673004 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:44.672971    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:44.673458 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:44.673181    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:39:58.673035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:39:58.673006    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:39:58.673432 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:39:58.673214    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:40:12.445449 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:12.445410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:12.545499 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:12.545461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:12.672942 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:12.672907    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:40:12.673163 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:40:12.673069    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:40:24.432263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:24.432170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:24.531546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:24.531508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:25.673138 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:25.673109    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:40:26.121544 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.121508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:26.221399 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.221358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:26.567359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.567325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:26.873865 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.873787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerStarted","Data":"3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"}
Jul 16 21:40:26.874239 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.873996    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:40:26.908802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:26.908757    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podStartSLOduration=182.065481599 podStartE2EDuration="3m5.908742818s" totalImagesPullingTime="3.843261219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:37:21 +0000 UTC" imagePullSessionsCount=6 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:26.90550256 +0000 UTC m=+1889.756119939" watchObservedRunningTime="2026-07-16 21:40:26.908742818 +0000 UTC m=+1889.759360191"
Jul 16 21:40:27.153128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:27.153033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:27.880523 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:27.880488    2559 generic.go:356] "Generic (PLEG): container finished" podID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerID="3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4" exitCode=1
Jul 16 21:40:27.880961 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:27.880538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"}
Jul 16 21:40:27.880961 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:27.880591    2559 scope.go:117] "RemoveContainer" containerID="e7d368726fdc54219cefaae21f5edbc5f2c1fd01fc72fb260f8e954e89a624cc"
Jul 16 21:40:27.880961 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:27.880768    2559 scope.go:117] "RemoveContainer" containerID="3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"
Jul 16 21:40:27.881123 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:40:27.880968    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:40:28.888402 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:28.888378    2559 scope.go:117] "RemoveContainer" containerID="3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"
Jul 16 21:40:28.888769 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:40:28.888537    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:40:31.358397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:31.358360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:40:31.358793 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:31.358716    2559 scope.go:117] "RemoveContainer" containerID="3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"
Jul 16 21:40:31.358965 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:40:31.358942    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-fc2328dc-6449898788-jzgvn_odh-ai-gateway-infra(933548dd-a8ef-4d63-a6b7-390d2eaf1632)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632"
Jul 16 21:40:32.445881 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.445848    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:40:32.470415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.470363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:32.575131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.575070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:32.590933 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.590908    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:40:32.622896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.622873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca\") pod \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") "
Jul 16 21:40:32.623034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.622908    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqqzg\" (UniqueName: \"kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg\") pod \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") "
Jul 16 21:40:32.623034 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.622952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls\") pod \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\" (UID: \"933548dd-a8ef-4d63-a6b7-390d2eaf1632\") "
Jul 16 21:40:32.623200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.623176    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "933548dd-a8ef-4d63-a6b7-390d2eaf1632" (UID: "933548dd-a8ef-4d63-a6b7-390d2eaf1632"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:40:32.625294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.625272    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg" (OuterVolumeSpecName: "kube-api-access-rqqzg") pod "933548dd-a8ef-4d63-a6b7-390d2eaf1632" (UID: "933548dd-a8ef-4d63-a6b7-390d2eaf1632"). InnerVolumeSpecName "kube-api-access-rqqzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:40:32.625383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.625326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "933548dd-a8ef-4d63-a6b7-390d2eaf1632" (UID: "933548dd-a8ef-4d63-a6b7-390d2eaf1632"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:40:32.723787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.723763    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933548dd-a8ef-4d63-a6b7-390d2eaf1632-openshift-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:40:32.723787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.723785    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqqzg\" (UniqueName: \"kubernetes.io/projected/933548dd-a8ef-4d63-a6b7-390d2eaf1632-kube-api-access-rqqzg\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:40:32.723989 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.723795    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933548dd-a8ef-4d63-a6b7-390d2eaf1632-maas-api-tls\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:40:32.911543 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.911511    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"
Jul 16 21:40:32.911703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.911559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn" event={"ID":"933548dd-a8ef-4d63-a6b7-390d2eaf1632","Type":"ContainerDied","Data":"25a71c2a584b993c981ddc829546f7ae2483e949b76ef82191d5b9ba12652108"}
Jul 16 21:40:32.911703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.911617    2559 scope.go:117] "RemoveContainer" containerID="3daf60521737e62d7fe04daa2b09cf3b51d27be90f06cc03f132991399f364f4"
Jul 16 21:40:32.936850 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.936828    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:40:32.940759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:32.940732    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc2328dc-6449898788-jzgvn"]
Jul 16 21:40:33.683467 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:33.683432    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" path="/var/lib/kubelet/pods/933548dd-a8ef-4d63-a6b7-390d2eaf1632/volumes"
Jul 16 21:40:38.720204 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:38.720168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:38.850908 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:38.850873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:39.020919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.020828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:39.111501 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.111454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:39.167784 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.167757    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:40:39.168387 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168367    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168387 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168388    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168399    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168407    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168415    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168424    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168433    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168441    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168453    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.168578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168462    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168630    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168645    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168655    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168664    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168673    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.169237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.168683    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:40:39.173278 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.173257    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.176355 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.176337    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0f8cd113-gw-openshift-default-dockercfg-6g8vm\""
Jul 16 21:40:39.182782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.182758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:40:39.203190 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.203152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:39.279607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmbt\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.279976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.279907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380551 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmbt\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380983 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380983 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.380983 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.380767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.381295 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.381243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.381427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.381318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.381427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.381321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.381427 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.381377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.381567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.381487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.383577 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.383558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.383893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.383871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.389702 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.389679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.389807 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.389752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmbt\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt\") pod \"e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") " pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.486677 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.486642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:39.631898 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.631870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:40:39.633530 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:40:39.633505    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91be908a_41e2_402e_bcef_5c4e666dd8f1.slice/crio-c7e444576f7ce4403cfa4b3564965fb11acdaff9265a3557935e855678f5c797 WatchSource:0}: Error finding container c7e444576f7ce4403cfa4b3564965fb11acdaff9265a3557935e855678f5c797: Status 404 returned error can't find the container with id c7e444576f7ce4403cfa4b3564965fb11acdaff9265a3557935e855678f5c797
Jul 16 21:40:39.635770 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.635739    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:39.635870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.635804    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:39.635870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.635834    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:39.947982 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.947886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerStarted","Data":"67c550a9289a0015f952eda2f23486f7313aedcf33bd961eae2c94d3bfb82e92"}
Jul 16 21:40:39.947982 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:39.947954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerStarted","Data":"c7e444576f7ce4403cfa4b3564965fb11acdaff9265a3557935e855678f5c797"}
Jul 16 21:40:40.486829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:40.486786    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:40.492074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:40.492049    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:40.515284 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:40.515233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podStartSLOduration=1.5152118909999999 podStartE2EDuration="1.515211891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:39.999999952 +0000 UTC m=+1902.850617329" watchObservedRunningTime="2026-07-16 21:40:40.515211891 +0000 UTC m=+1903.365829269"
Jul 16 21:40:40.953731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:40.953645    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:40.954703 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:40.954682    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:41.033340 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:41.033292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:41.132947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:41.132910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:41.238283 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:41.238247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:42.840913 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:42.840877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:42.941769 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:42.941730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:46.164843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:46.164813    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:40:52.012327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.012297    2559 generic.go:356] "Generic (PLEG): container finished" podID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerID="67c550a9289a0015f952eda2f23486f7313aedcf33bd961eae2c94d3bfb82e92" exitCode=0
Jul 16 21:40:52.012716 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.012375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerDied","Data":"67c550a9289a0015f952eda2f23486f7313aedcf33bd961eae2c94d3bfb82e92"}
Jul 16 21:40:52.012716 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.012713    2559 scope.go:117] "RemoveContainer" containerID="67c550a9289a0015f952eda2f23486f7313aedcf33bd961eae2c94d3bfb82e92"
Jul 16 21:40:52.013810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.013784    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:52.013874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.013852    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:52.013910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:52.013884    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:40:53.019640 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:53.019601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerStarted","Data":"5784448a3490f86fe899bcbcb29aec647310c9cae6ccac21aa02d2f0bb8a9a69"}
Jul 16 21:40:53.487549 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:53.487500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:53.488789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:53.488739    2559 patch_prober.go:28] interesting pod/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 16 21:40:53.488931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:53.488819    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 16 21:40:54.487385 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:54.487349    2559 patch_prober.go:28] interesting pod/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 16 21:40:54.487772 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:54.487402    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 16 21:40:55.487056 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:55.487024    2559 patch_prober.go:28] interesting pod/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 16 21:40:55.487382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:55.487118    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 16 21:40:55.954276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:55.954179    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:56.487689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:56.487660    2559 patch_prober.go:28] interesting pod/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 16 21:40:56.487916 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:56.487895    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 16 21:40:57.487422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:57.487388    2559 patch_prober.go:28] interesting pod/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 16 21:40:57.487820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:57.487438    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 16 21:40:58.491535 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:58.491505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:40:58.492658 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:40:58.492638    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:41:45.107738 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:45.107690    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:41:45.108276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:45.108032    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy" containerID="cri-o://5784448a3490f86fe899bcbcb29aec647310c9cae6ccac21aa02d2f0bb8a9a69" gracePeriod=30
Jul 16 21:41:45.148073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:45.148043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:45.247419 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:45.247336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:50.308426 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.308396    2559 generic.go:356] "Generic (PLEG): container finished" podID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerID="5784448a3490f86fe899bcbcb29aec647310c9cae6ccac21aa02d2f0bb8a9a69" exitCode=0
Jul 16 21:41:50.308832 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.308474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerDied","Data":"5784448a3490f86fe899bcbcb29aec647310c9cae6ccac21aa02d2f0bb8a9a69"}
Jul 16 21:41:50.308832 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.308556    2559 scope.go:117] "RemoveContainer" containerID="67c550a9289a0015f952eda2f23486f7313aedcf33bd961eae2c94d3bfb82e92"
Jul 16 21:41:50.370261 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.370233    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:41:50.512345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512369    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512435    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbmbt\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512496 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512475    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512723 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512500    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512723 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512723 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512576    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.512723 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.512602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket\") pod \"91be908a-41e2-402e-bcef-5c4e666dd8f1\" (UID: \"91be908a-41e2-402e-bcef-5c4e666dd8f1\") "
Jul 16 21:41:50.513254 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.513180    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:41:50.513254 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.513242    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:41:50.513503 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.513420    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:41:50.513503 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.513438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:41:50.513503 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.513485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:41:50.514673 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.514647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:41:50.514795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.514706    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 21:41:50.515058 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.515029    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:41:50.515184 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.515055    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt" (OuterVolumeSpecName: "kube-api-access-vbmbt") pod "91be908a-41e2-402e-bcef-5c4e666dd8f1" (UID: "91be908a-41e2-402e-bcef-5c4e666dd8f1"). InnerVolumeSpecName "kube-api-access-vbmbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:41:50.613578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613547    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613583    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613598    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613613    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613629    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613644    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613657    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613670    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbmbt\" (UniqueName: \"kubernetes.io/projected/91be908a-41e2-402e-bcef-5c4e666dd8f1-kube-api-access-vbmbt\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.613765 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.613684    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91be908a-41e2-402e-bcef-5c4e666dd8f1-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:41:50.662562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:50.662531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:51.314336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.314307    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"
Jul 16 21:41:51.314336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.314308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb" event={"ID":"91be908a-41e2-402e-bcef-5c4e666dd8f1","Type":"ContainerDied","Data":"c7e444576f7ce4403cfa4b3564965fb11acdaff9265a3557935e855678f5c797"}
Jul 16 21:41:51.314837 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.314402    2559 scope.go:117] "RemoveContainer" containerID="5784448a3490f86fe899bcbcb29aec647310c9cae6ccac21aa02d2f0bb8a9a69"
Jul 16 21:41:51.341679 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.341645    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:41:51.344027 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.343996    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0f8cd113-gw-openshift-default-74dcfdf49f-rnntb"]
Jul 16 21:41:51.651525 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.651468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:51.680160 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:51.680131    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" path="/var/lib/kubelet/pods/91be908a-41e2-402e-bcef-5c4e666dd8f1/volumes"
Jul 16 21:41:55.005149 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:55.005112    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:57.895114 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:57.895060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:57.968746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:57.968710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:58.127874 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.127838    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:41:58.128946 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.128917    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:41:58.128946 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.128946    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:41:58.129196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.128969    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:41:58.129196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.128978    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="933548dd-a8ef-4d63-a6b7-390d2eaf1632" containerName="maas-api"
Jul 16 21:41:58.129298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.129202    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:41:58.135080 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.135054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.138255 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.138235    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f60157c3-openshift-default-dockercfg-plcsm\""
Jul 16 21:41:58.145764 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.145696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:41:58.173169 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.173139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:58.272514 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.272485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:58.284622 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.284757 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.284757 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.284869 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.284869 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.284869 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.285001 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.285001 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.284984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdrz\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.285077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.285005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386218 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdrz\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386218 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386445 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386807 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.386986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.386946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.387255 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.387236    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.389031 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.389007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.389194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.389171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.400417 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.400341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdrz\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.402611 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.402589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token\") pod \"e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") " pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.447336 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.447307    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:58.621387 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.621352    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:41:58.630149 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:41:58.630074    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda010cc4a_7d4d_457b_98a2_7507bf497298.slice/crio-ce64ecbfa11c6c7e04129f2f1d182bbb89d07a10404ddd4986182f9e5243cdab WatchSource:0}: Error finding container ce64ecbfa11c6c7e04129f2f1d182bbb89d07a10404ddd4986182f9e5243cdab: Status 404 returned error can't find the container with id ce64ecbfa11c6c7e04129f2f1d182bbb89d07a10404ddd4986182f9e5243cdab
Jul 16 21:41:58.632154 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.632124    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:41:58.632240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.632189    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:41:58.632240 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:58.632217    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:41:59.360505 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.360462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerStarted","Data":"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"}
Jul 16 21:41:59.360940 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.360538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerStarted","Data":"ce64ecbfa11c6c7e04129f2f1d182bbb89d07a10404ddd4986182f9e5243cdab"}
Jul 16 21:41:59.364298 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.364260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:59.389888 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.389835    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podStartSLOduration=1.389815552 podStartE2EDuration="1.389815552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:41:59.387723777 +0000 UTC m=+1982.238341155" watchObservedRunningTime="2026-07-16 21:41:59.389815552 +0000 UTC m=+1982.240432929"
Jul 16 21:41:59.448335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.448302    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:59.453517 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.453494    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:41:59.464126 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.464078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:59.565699 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.565663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:41:59.918194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:41:59.918156    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:42:00.155704 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:00.155668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:42:00.343383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:00.343347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:42:00.365991 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:00.365962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:00.366789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:00.366772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:01.679947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:01.679844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:42:10.421621 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.421542    2559 generic.go:356] "Generic (PLEG): container finished" podID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerID="5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d" exitCode=0
Jul 16 21:42:10.421621 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.421609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerDied","Data":"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"}
Jul 16 21:42:10.422035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.422010    2559 scope.go:117] "RemoveContainer" containerID="5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"
Jul 16 21:42:10.423066 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.423039    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:42:10.423196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.423145    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:42:10.423260 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:10.423196    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:42:11.427773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:11.427734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerStarted","Data":"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"}
Jul 16 21:42:11.447745 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:11.447712    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:11.449166 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:11.449137    2559 patch_prober.go:28] interesting pod/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 16 21:42:11.449271 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:11.449202    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 16 21:42:12.448664 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:12.448631    2559 patch_prober.go:28] interesting pod/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 16 21:42:12.449243 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:12.449211    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 16 21:42:13.448275 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:13.448228    2559 patch_prober.go:28] interesting pod/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 16 21:42:13.448484 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:13.448292    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 16 21:42:14.448356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:14.447869    2559 patch_prober.go:28] interesting pod/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 16 21:42:14.448356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:14.447931    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 16 21:42:15.365879 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:15.365846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:15.451662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:15.451633    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:15.452791 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:15.452770    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:42:18.859583 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:42:18.859538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:43:57.764425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:43:57.764394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:43:57.771503 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:43:57.771477    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:45:13.832783 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:45:13.832741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:45:14.046011 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:45:14.045974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:45:25.917502 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:45:25.917471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:45:26.136270 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:45:26.136230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:46:29.948747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:46:29.948656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:46:30.012830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:46:30.012802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:47:02.452959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:47:02.452920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:04.627194 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:04.627154    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:48:04.627683 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:04.627421    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy" containerID="cri-o://48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36" gracePeriod=30
Jul 16 21:48:04.655104 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:04.655063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:04.807643 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:04.807603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:09.874048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.874024    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:48:09.945433 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pdrz\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945549    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945603    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945632    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:48:09.945976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945867    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.945976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.945894    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket\") pod \"a010cc4a-7d4d-457b-98a2-7507bf497298\" (UID: \"a010cc4a-7d4d-457b-98a2-7507bf497298\") "
Jul 16 21:48:09.946325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946046    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:48:09.946325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:48:09.946527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946488    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:48:09.946634 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946620    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a010cc4a-7d4d-457b-98a2-7507bf497298-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:09.946729 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946638    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:09.946729 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946652    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:09.946729 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.946665    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:09.947425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.947396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data" (OuterVolumeSpecName: "istio-data") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:48:09.948324 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.948276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token" (OuterVolumeSpecName: "istio-token") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:48:09.948324 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.948262    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz" (OuterVolumeSpecName: "kube-api-access-8pdrz") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "kube-api-access-8pdrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:48:09.948508 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.948365    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:48:09.948589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:09.948571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a010cc4a-7d4d-457b-98a2-7507bf497298" (UID: "a010cc4a-7d4d-457b-98a2-7507bf497298"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 21:48:10.047276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.047249    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pdrz\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-kube-api-access-8pdrz\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:10.047276 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.047274    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:10.047425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.047283    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:10.047425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.047290    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:10.047425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.047299    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a010cc4a-7d4d-457b-98a2-7507bf497298-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:48:10.250245 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.250208    2559 generic.go:356] "Generic (PLEG): container finished" podID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerID="48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36" exitCode=0
Jul 16 21:48:10.250382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.250255    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"
Jul 16 21:48:10.250382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.250282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerDied","Data":"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"}
Jul 16 21:48:10.250382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.250337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn" event={"ID":"a010cc4a-7d4d-457b-98a2-7507bf497298","Type":"ContainerDied","Data":"ce64ecbfa11c6c7e04129f2f1d182bbb89d07a10404ddd4986182f9e5243cdab"}
Jul 16 21:48:10.250382 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.250359    2559 scope.go:117] "RemoveContainer" containerID="48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"
Jul 16 21:48:10.262020 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.262003    2559 scope.go:117] "RemoveContainer" containerID="5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"
Jul 16 21:48:10.270727 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.270700    2559 scope.go:117] "RemoveContainer" containerID="48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"
Jul 16 21:48:10.270993 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:48:10.270965    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36\": container with ID starting with 48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36 not found: ID does not exist" containerID="48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"
Jul 16 21:48:10.271124 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.271004    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36"} err="failed to get container status \"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36\": rpc error: code = NotFound desc = could not find container \"48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36\": container with ID starting with 48880dbcda497cfc907daadfff126cb551765ae81a8a90e0b9d30437f1a39c36 not found: ID does not exist"
Jul 16 21:48:10.271124 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.271028    2559 scope.go:117] "RemoveContainer" containerID="5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"
Jul 16 21:48:10.271774 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:48:10.271440    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d\": container with ID starting with 5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d not found: ID does not exist" containerID="5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"
Jul 16 21:48:10.271774 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.271471    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d"} err="failed to get container status \"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d\": rpc error: code = NotFound desc = could not find container \"5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d\": container with ID starting with 5b5d79d3e0e0e427c8b2bed053f5f0518123e98d265866251ca1d38826d76c1d not found: ID does not exist"
Jul 16 21:48:10.273873 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.273854    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:48:10.277663 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.277643    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f60157c3-openshift-default-679d66fd9c-7zkbn"]
Jul 16 21:48:10.995373 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:10.995340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:11.180217 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:11.180183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:11.678364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:11.678334    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" path="/var/lib/kubelet/pods/a010cc4a-7d4d-457b-98a2-7507bf497298/volumes"
Jul 16 21:48:17.346346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.346301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:17.425286 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.425234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:17.557369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557331    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:48:17.557795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557779    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:48:17.557795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557797    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:48:17.557927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:48:17.557927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557832    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:48:17.557927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557903    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91be908a-41e2-402e-bcef-5c4e666dd8f1" containerName="istio-proxy"
Jul 16 21:48:17.557927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557917    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:48:17.557927 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.557923    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:48:17.562524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.562505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.565633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.565610    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c1cf683e-openshift-default-dockercfg-2tgsr\""
Jul 16 21:48:17.573876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.573854    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:48:17.594717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.594694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:17.607871 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.607798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.607871 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.607838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608012 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.607875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608012 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.607924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608012 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.607959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262gh\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608137 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.608014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608137 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.608118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608213 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.608166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.608213 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.608185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262gh\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709836 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709836 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.709956 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.709923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.710186 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.710083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.710325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.710305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.710547 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.710434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.712188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.712162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.712297 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.712265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.718009 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.717985    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.718132 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.718016    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-262gh\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh\") pod \"e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") " pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:17.874377 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:17.874306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:18.019732 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.019700    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:48:18.021399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:48:18.021373    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f70040_b1c7_4817_8396_34bf5188d721.slice/crio-17666a5a9a16c01e9a75124a5aa47bc02f73f33d6a48ccf5ec48f6a83c5993da WatchSource:0}: Error finding container 17666a5a9a16c01e9a75124a5aa47bc02f73f33d6a48ccf5ec48f6a83c5993da: Status 404 returned error can't find the container with id 17666a5a9a16c01e9a75124a5aa47bc02f73f33d6a48ccf5ec48f6a83c5993da
Jul 16 21:48:18.024005 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.023962    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:18.024112 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.024058    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:18.024163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.024124    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:18.294891 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.294851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerStarted","Data":"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"}
Jul 16 21:48:18.295110 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.294928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerStarted","Data":"17666a5a9a16c01e9a75124a5aa47bc02f73f33d6a48ccf5ec48f6a83c5993da"}
Jul 16 21:48:18.316383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.316307    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podStartSLOduration=1.316292721 podStartE2EDuration="1.316292721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:48:18.316215652 +0000 UTC m=+2361.166833028" watchObservedRunningTime="2026-07-16 21:48:18.316292721 +0000 UTC m=+2361.166910092"
Jul 16 21:48:18.738051 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.738006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:18.836424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.836378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:18.874533 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.874506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:18.922465 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:18.922430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:19.456508 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:19.456472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:19.555353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:19.555318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:19.657599 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:19.657558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:19.879446 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:19.879417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:20.305897 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:20.305868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:20.306918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:20.306895    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:21.233348 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:21.233304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:21.332809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:21.332769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:25.432185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:25.432133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:30.360222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.360189    2559 generic.go:356] "Generic (PLEG): container finished" podID="c3f70040-b1c7-4817-8396-34bf5188d721" containerID="302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6" exitCode=0
Jul 16 21:48:30.360612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.360235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerDied","Data":"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"}
Jul 16 21:48:30.360612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.360578    2559 scope.go:117] "RemoveContainer" containerID="302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"
Jul 16 21:48:30.361720 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.361691    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:30.361798 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.361780    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:30.361847 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:30.361834    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:31.373550 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:31.373509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerStarted","Data":"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"}
Jul 16 21:48:31.875378 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:31.875332    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:31.876831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:31.876801    2559 patch_prober.go:28] interesting pod/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 16 21:48:31.876972 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:31.876849    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 16 21:48:32.874938 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:32.874901    2559 patch_prober.go:28] interesting pod/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 16 21:48:32.875425 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:32.874968    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 16 21:48:33.875168 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:33.875130    2559 patch_prober.go:28] interesting pod/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 16 21:48:33.875564 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:33.875188    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 16 21:48:34.875209 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:34.875167    2559 patch_prober.go:28] interesting pod/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 16 21:48:34.875711 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:34.875242    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 16 21:48:35.306512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:35.306476    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:35.878556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:35.878530    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:35.879402 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:35.879385    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:48:55.223838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:55.223798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:48:57.797743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:57.797713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:48:57.810032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:48:57.810013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:49:06.810792 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:49:06.810745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:14.676459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:50:14.676417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:14.778910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:50:14.778870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:22.975224 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:50:22.975185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:50:23.076936 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:50:23.076896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:23.270629 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:23.270591    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:51:23.271172 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:23.270812    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy" containerID="cri-o://3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101" gracePeriod=30
Jul 16 21:51:23.303951 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:23.303913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:23.404968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:23.404930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:28.521676 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.521649    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:51:28.587166 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587187    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-262gh\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587243    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587269    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587336    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket\") pod \"c3f70040-b1c7-4817-8396-34bf5188d721\" (UID: \"c3f70040-b1c7-4817-8396-34bf5188d721\") "
Jul 16 21:51:28.587701 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587650    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:51:28.588631 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:51:28.588631 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.587872    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3f70040-b1c7-4817-8396-34bf5188d721-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.588631 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.588038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:51:28.588631 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.588329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:51:28.588945 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.588914    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:51:28.590618 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.590584    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:51:28.590715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.590679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh" (OuterVolumeSpecName: "kube-api-access-262gh") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "kube-api-access-262gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:51:28.590968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.590932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 21:51:28.591370 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.591338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3f70040-b1c7-4817-8396-34bf5188d721" (UID: "c3f70040-b1c7-4817-8396-34bf5188d721"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:51:28.688892 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688857    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.688892 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688890    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3f70040-b1c7-4817-8396-34bf5188d721-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688904    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688916    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688927    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688939    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-262gh\" (UniqueName: \"kubernetes.io/projected/c3f70040-b1c7-4817-8396-34bf5188d721-kube-api-access-262gh\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688952    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:28.689153 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:28.688965    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3f70040-b1c7-4817-8396-34bf5188d721-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:51:29.089485 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.089449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:29.278986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.278954    2559 generic.go:356] "Generic (PLEG): container finished" podID="c3f70040-b1c7-4817-8396-34bf5188d721" containerID="3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101" exitCode=0
Jul 16 21:51:29.279186 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.279008    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"
Jul 16 21:51:29.279186 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.279044    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerDied","Data":"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"}
Jul 16 21:51:29.279186 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.279123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr" event={"ID":"c3f70040-b1c7-4817-8396-34bf5188d721","Type":"ContainerDied","Data":"17666a5a9a16c01e9a75124a5aa47bc02f73f33d6a48ccf5ec48f6a83c5993da"}
Jul 16 21:51:29.279186 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.279155    2559 scope.go:117] "RemoveContainer" containerID="3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"
Jul 16 21:51:29.289117 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.289102    2559 scope.go:117] "RemoveContainer" containerID="302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"
Jul 16 21:51:29.297500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.297482    2559 scope.go:117] "RemoveContainer" containerID="3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"
Jul 16 21:51:29.297733 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:51:29.297714    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101\": container with ID starting with 3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101 not found: ID does not exist" containerID="3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"
Jul 16 21:51:29.297809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.297748    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101"} err="failed to get container status \"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101\": rpc error: code = NotFound desc = could not find container \"3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101\": container with ID starting with 3d89c57c94e0daddcebeea43bc5bb2b3e13964d714bd259a054d3f18a5084101 not found: ID does not exist"
Jul 16 21:51:29.297809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.297771    2559 scope.go:117] "RemoveContainer" containerID="302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"
Jul 16 21:51:29.298001 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:51:29.297982    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6\": container with ID starting with 302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6 not found: ID does not exist" containerID="302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"
Jul 16 21:51:29.298046 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.298007    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6"} err="failed to get container status \"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6\": rpc error: code = NotFound desc = could not find container \"302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6\": container with ID starting with 302d581920c2d8af77296d32ae4cad101945655f5c6b112948f4fd230a2404e6 not found: ID does not exist"
Jul 16 21:51:29.314217 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.314196    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:51:29.324998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.324970    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c1cf683e-openshift-default-646f47777f-nhpkr"]
Jul 16 21:51:29.679702 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.679674    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" path="/var/lib/kubelet/pods/c3f70040-b1c7-4817-8396-34bf5188d721/volumes"
Jul 16 21:51:29.865325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:29.865287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:36.958582 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:36.958541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.174415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:37.174382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.590346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:37.590311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:37.759719 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:37.759683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:39.479405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:39.479373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:45.124548 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:45.124516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:47.387773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:47.387737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:47.589690 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:47.589646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:47.763342 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:47.763310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:48.127467 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:48.127373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:51:58.925845 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:51:58.925803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:14.119469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:14.119432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:20.343366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:20.343262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:20.627210 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:20.627125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:20.771004 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:20.770970    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:36.506146 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:36.506079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:42.680838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:42.680800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:42.815152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:42.815121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:43.010323 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:43.010287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:45.161979 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.161944    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:52:45.162415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162399    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.162415 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162413    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.162493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162423    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:52:45.162493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162428    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a010cc4a-7d4d-457b-98a2-7507bf497298" containerName="istio-proxy"
Jul 16 21:52:45.162493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162446    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.162493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162452    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.162612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162514    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.162612 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.162522    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f70040-b1c7-4817-8396-34bf5188d721" containerName="istio-proxy"
Jul 16 21:52:45.165589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.165571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:52:45.168854 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.168831    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:52:45.172712 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.172690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:52:45.248602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.248569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5\" (UID: \"3ac0f74e-de86-453b-bbe3-db7e2c648e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:52:45.349903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.349873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5\" (UID: \"3ac0f74e-de86-453b-bbe3-db7e2c648e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:52:45.350556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.350535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5\" (UID: \"3ac0f74e-de86-453b-bbe3-db7e2c648e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:52:45.478498 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.478470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:52:45.615669 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.615641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:52:45.618051 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:52:45.618023    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac0f74e_de86_453b_bbe3_db7e2c648e13.slice/crio-dc7bc96721ad5e499cbcc97d28ee528861d42407aebbcad491a34da55a1950dd WatchSource:0}: Error finding container dc7bc96721ad5e499cbcc97d28ee528861d42407aebbcad491a34da55a1950dd: Status 404 returned error can't find the container with id dc7bc96721ad5e499cbcc97d28ee528861d42407aebbcad491a34da55a1950dd
Jul 16 21:52:45.664952 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:45.664926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" event={"ID":"3ac0f74e-de86-453b-bbe3-db7e2c648e13","Type":"ContainerStarted","Data":"dc7bc96721ad5e499cbcc97d28ee528861d42407aebbcad491a34da55a1950dd"}
Jul 16 21:52:46.671413 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:46.671320    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerID="8b4aba8352949f19e60523d33c217861f9e722b12ac7b35a32805c72f39b6763" exitCode=6
Jul 16 21:52:46.671834 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:46.671404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" event={"ID":"3ac0f74e-de86-453b-bbe3-db7e2c648e13","Type":"ContainerDied","Data":"8b4aba8352949f19e60523d33c217861f9e722b12ac7b35a32805c72f39b6763"}
Jul 16 21:52:46.671834 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:46.671528    2559 scope.go:117] "RemoveContainer" containerID="8b4aba8352949f19e60523d33c217861f9e722b12ac7b35a32805c72f39b6763"
Jul 16 21:52:47.679170 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:47.679062    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerID="32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49" exitCode=6
Jul 16 21:52:47.679636 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:47.679419    2559 scope.go:117] "RemoveContainer" containerID="32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49"
Jul 16 21:52:47.679696 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:52:47.679640    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5_odh-ai-gateway-infra(3ac0f74e-de86-453b-bbe3-db7e2c648e13)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13"
Jul 16 21:52:47.679768 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:47.679743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" event={"ID":"3ac0f74e-de86-453b-bbe3-db7e2c648e13","Type":"ContainerDied","Data":"32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49"}
Jul 16 21:52:47.679811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:47.679800    2559 scope.go:117] "RemoveContainer" containerID="8b4aba8352949f19e60523d33c217861f9e722b12ac7b35a32805c72f39b6763"
Jul 16 21:52:48.686732 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:48.686704    2559 scope.go:117] "RemoveContainer" containerID="32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49"
Jul 16 21:52:48.687166 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:52:48.686880    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5_odh-ai-gateway-infra(3ac0f74e-de86-453b-bbe3-db7e2c648e13)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13"
Jul 16 21:52:53.427136 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:53.427081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:52:54.216287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:52:54.216251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:00.624464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:00.624428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:00.753544 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:00.753501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:00.891352 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:00.891272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:00.992627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:00.992584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:01.724253 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:01.724219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:01.816739 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:01.816699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:01.920052 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:01.920022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:03.452655 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:03.452589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:03.607590 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:03.607551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:03.672856 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:03.672830    2559 scope.go:117] "RemoveContainer" containerID="32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49"
Jul 16 21:53:03.711122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:03.711077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:04.765829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:04.765800    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerID="885a3be7458eac24857308f38b6097445191b870fd98ceca383e20034773a1f9" exitCode=6
Jul 16 21:53:04.766337 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:04.765863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" event={"ID":"3ac0f74e-de86-453b-bbe3-db7e2c648e13","Type":"ContainerDied","Data":"885a3be7458eac24857308f38b6097445191b870fd98ceca383e20034773a1f9"}
Jul 16 21:53:04.766337 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:04.765925    2559 scope.go:117] "RemoveContainer" containerID="32369ef86b3226368cc67a9f66e318f14ed772554e55c7a56b0d99ba59048b49"
Jul 16 21:53:04.766337 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:04.766274    2559 scope.go:117] "RemoveContainer" containerID="885a3be7458eac24857308f38b6097445191b870fd98ceca383e20034773a1f9"
Jul 16 21:53:04.766503 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:53:04.766477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5_odh-ai-gateway-infra(3ac0f74e-de86-453b-bbe3-db7e2c648e13)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13"
Jul 16 21:53:05.804132 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:05.804085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:53:05.943808 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:05.943788    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:53:06.030883 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.030855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca\") pod \"3ac0f74e-de86-453b-bbe3-db7e2c648e13\" (UID: \"3ac0f74e-de86-453b-bbe3-db7e2c648e13\") "
Jul 16 21:53:06.031239 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.031218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ac0f74e-de86-453b-bbe3-db7e2c648e13" (UID: "3ac0f74e-de86-453b-bbe3-db7e2c648e13"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:53:06.132025 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.131953    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac0f74e-de86-453b-bbe3-db7e2c648e13-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:53:06.778234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.778197    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"
Jul 16 21:53:06.778234 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.778201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5" event={"ID":"3ac0f74e-de86-453b-bbe3-db7e2c648e13","Type":"ContainerDied","Data":"dc7bc96721ad5e499cbcc97d28ee528861d42407aebbcad491a34da55a1950dd"}
Jul 16 21:53:06.778441 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.778260    2559 scope.go:117] "RemoveContainer" containerID="885a3be7458eac24857308f38b6097445191b870fd98ceca383e20034773a1f9"
Jul 16 21:53:06.805557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.805526    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:53:06.810986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:06.810964    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-x6dp5"]
Jul 16 21:53:07.678778 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:07.678745    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" path="/var/lib/kubelet/pods/3ac0f74e-de86-453b-bbe3-db7e2c648e13/volumes"
Jul 16 21:53:09.958217 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:09.958175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:10.029448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:10.029414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:10.669353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:10.669309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:16.682539 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:16.682497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:16.782584 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:16.782547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:16.909403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:16.909353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:17.385379 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.385348    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:53:17.385958 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.385943    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.385962    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.385985    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.385994    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.386006    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.386015    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.386124    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.386138    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.386201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.386149    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac0f74e-de86-453b-bbe3-db7e2c648e13" containerName="revoke-keys"
Jul 16 21:53:17.391016 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.390993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.394447 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.394423    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f8eae57b-openshift-default-dockercfg-ngl7t\""
Jul 16 21:53:17.412813 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.412788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:53:17.428439 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6hg\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428710 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428710 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428710 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428710 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.428881 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.428745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.433466 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.433444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:17.529464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6hg\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529594 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.529923 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.530070 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.529995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.530151 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.530063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.530244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.530224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.530451 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.530436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.532134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.532115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.532193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.532180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.538674 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.538653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6hg\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.538852 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.538835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token\") pod \"e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") " pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.701773 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.701693    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:17.739365 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.739336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:17.849125 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.849080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:53:17.851152 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:53:17.851121    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f12c51_2ac4_4814_a318_8b2c68ebd6e5.slice/crio-52e255024c628bf8ba3760fba31648eeb4c8bc32de1c706cc3f9b7c7fc2434c7 WatchSource:0}: Error finding container 52e255024c628bf8ba3760fba31648eeb4c8bc32de1c706cc3f9b7c7fc2434c7: Status 404 returned error can't find the container with id 52e255024c628bf8ba3760fba31648eeb4c8bc32de1c706cc3f9b7c7fc2434c7
Jul 16 21:53:17.853320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.853283    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:17.853423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.853372    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:17.853423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:17.853416    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:18.840782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:18.840748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerStarted","Data":"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"}
Jul 16 21:53:18.841191 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:18.840796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerStarted","Data":"52e255024c628bf8ba3760fba31648eeb4c8bc32de1c706cc3f9b7c7fc2434c7"}
Jul 16 21:53:18.863035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:18.862988    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podStartSLOduration=1.862974095 podStartE2EDuration="1.862974095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:18.862356529 +0000 UTC m=+2661.712973908" watchObservedRunningTime="2026-07-16 21:53:18.862974095 +0000 UTC m=+2661.713591474"
Jul 16 21:53:19.702429 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:19.702403    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:19.707481 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:19.707456    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:19.846397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:19.846359    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:19.847274 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:19.847244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:20.839731 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:20.839699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:20.942489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:20.942454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:21.023309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:21.023281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:21.333394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:21.333346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:21.751646 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:21.751611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:21.852825 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:21.852792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:25.234335 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:25.234297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:25.953201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:25.953161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:26.047228 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:26.047197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:26.372239 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:26.372211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:32.436404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:32.436364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:32.571575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:32.571535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:35.512769 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.511676    2559 patch_prober.go:28] interesting pod/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": read tcp 10.132.0.2:49528->10.132.0.62:15021: read: connection reset by peer" start-of-body=
Jul 16 21:53:35.512769 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.511747    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": read tcp 10.132.0.2:49528->10.132.0.62:15021: read: connection reset by peer"
Jul 16 21:53:35.934700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.934619    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerID="94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3" exitCode=0
Jul 16 21:53:35.934700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.934689    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerDied","Data":"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"}
Jul 16 21:53:35.935076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.935062    2559 scope.go:117] "RemoveContainer" containerID="94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"
Jul 16 21:53:35.936057 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.936028    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:35.936145 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.936125    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:35.936193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:35.936157    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:53:36.942032 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:36.941993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerStarted","Data":"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"}
Jul 16 21:53:37.702576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:37.702542    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:37.702761 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:37.702731    2559 patch_prober.go:28] interesting pod/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 16 21:53:37.702820 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:37.702784    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 16 21:53:38.702334 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:38.702299    2559 patch_prober.go:28] interesting pod/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 16 21:53:38.702715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:38.702352    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 16 21:53:39.702462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:39.702426    2559 patch_prober.go:28] interesting pod/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 16 21:53:39.702839 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:39.702483    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 16 21:53:40.702193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:40.702155    2559 patch_prober.go:28] interesting pod/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 16 21:53:40.702374 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:40.702220    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 16 21:53:41.706080 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:41.706050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:41.706512 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:41.706490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:41.707207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:41.707191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:53:43.300662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:43.300610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:47.878138 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:47.878083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:54.023910 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:54.023832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:54.124309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:54.124275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:57.828978 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:57.828955    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:53:57.844331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:57.844307    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:53:58.520203 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.520174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:53:58.520389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.520367    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy" containerID="cri-o://21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540" gracePeriod=30
Jul 16 21:53:58.537349 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.537302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:58.762658 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.762623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:58.902008 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.901889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:58.991939 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:58.991903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:53:59.106996 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:53:59.106958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:03.784030 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.783971    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:54:03.847460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847476    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh6hg\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847634    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847718    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.847851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847783    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data\") pod \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\" (UID: \"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5\") "
Jul 16 21:54:03.848122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847900    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:54:03.848122 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.847917    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:54:03.848232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.848121    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.848232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.848142    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.848232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.848186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:54:03.848416 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.848357    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:54:03.849051 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.849027    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:54:03.850150 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.850115    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg" (OuterVolumeSpecName: "kube-api-access-wh6hg") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "kube-api-access-wh6hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:54:03.850150 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.850131    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:54:03.850361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.850340    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 21:54:03.850423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.850342    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" (UID: "e3f12c51-2ac4-4814-a318-8b2c68ebd6e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:54:03.949364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949336    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949362    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949377    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh6hg\" (UniqueName: \"kubernetes.io/projected/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-kube-api-access-wh6hg\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949390    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949401    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949412    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:03.949530 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:03.949422    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:04.084954 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.084878    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerID="21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540" exitCode=0
Jul 16 21:54:04.084954 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.084930    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"
Jul 16 21:54:04.085196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.084973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerDied","Data":"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"}
Jul 16 21:54:04.085196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.085039    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq" event={"ID":"e3f12c51-2ac4-4814-a318-8b2c68ebd6e5","Type":"ContainerDied","Data":"52e255024c628bf8ba3760fba31648eeb4c8bc32de1c706cc3f9b7c7fc2434c7"}
Jul 16 21:54:04.085196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.085070    2559 scope.go:117] "RemoveContainer" containerID="21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"
Jul 16 21:54:04.094602 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.094585    2559 scope.go:117] "RemoveContainer" containerID="94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"
Jul 16 21:54:04.102892 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.102872    2559 scope.go:117] "RemoveContainer" containerID="21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"
Jul 16 21:54:04.103131 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:04.103111    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540\": container with ID starting with 21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540 not found: ID does not exist" containerID="21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"
Jul 16 21:54:04.103188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.103140    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540"} err="failed to get container status \"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540\": rpc error: code = NotFound desc = could not find container \"21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540\": container with ID starting with 21a4f00f13b3c7f9a15384a603b282b02c965e519f6f7ad3476022812998a540 not found: ID does not exist"
Jul 16 21:54:04.103188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.103157    2559 scope.go:117] "RemoveContainer" containerID="94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"
Jul 16 21:54:04.103399 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:04.103383    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3\": container with ID starting with 94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3 not found: ID does not exist" containerID="94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"
Jul 16 21:54:04.103454 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.103403    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3"} err="failed to get container status \"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3\": rpc error: code = NotFound desc = could not find container \"94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3\": container with ID starting with 94b4cea4a701412ff88940a8cce4d0ddabd5a7b39c333a4f98ed0d76eaf8a2a3 not found: ID does not exist"
Jul 16 21:54:04.108483 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.108461    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:54:04.114672 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:04.114648    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f8eae57b-openshift-default-6f5c8d7c55-s2rhq"]
Jul 16 21:54:05.215219 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:05.215179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:05.319661 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:05.319623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:05.421242 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:05.421208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:05.554424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:05.554340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:05.679237 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:05.679210    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" path="/var/lib/kubelet/pods/e3f12c51-2ac4-4814-a318-8b2c68ebd6e5/volumes"
Jul 16 21:54:12.020308 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:12.020276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:12.129035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:12.129003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:18.825493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:18.825444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:19.137406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:19.137324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:19.272460 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:19.272424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:22.477367 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:22.477325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:22.572225 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:22.572194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:22.813258 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:22.813165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:22.969532 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:22.969497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:23.489554 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:23.489512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:23.625538 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:23.625499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:25.874035 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874005    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:25.874404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874391    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:25.874404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874402    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:25.874480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874416    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:25.874480 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874421    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:25.874546 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.874493    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:25.877882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.877862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:25.881065 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.881044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:54:25.887148 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.887081    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:25.939139 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:25.939077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz\" (UID: \"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:26.039555 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:26.039523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz\" (UID: \"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:26.040149 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:26.040133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz\" (UID: \"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:26.190201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:26.190117    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:26.332215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:26.332190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:26.334131 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:54:26.334080    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb9ab36_07d1_4c0b_a7bc_c774aa15fe97.slice/crio-4329e1e8c1c2ea6584e8282e52a26994e216e633b8f19eb943db32c470f1dadb WatchSource:0}: Error finding container 4329e1e8c1c2ea6584e8282e52a26994e216e633b8f19eb943db32c470f1dadb: Status 404 returned error can't find the container with id 4329e1e8c1c2ea6584e8282e52a26994e216e633b8f19eb943db32c470f1dadb
Jul 16 21:54:26.938912 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:26.938805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:27.033411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.033377    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:27.033837 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.033824    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3f12c51-2ac4-4814-a318-8b2c68ebd6e5" containerName="istio-proxy"
Jul 16 21:54:27.037268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.037251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:27.047661 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.047632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:27.151353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.151318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55\" (UID: \"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:27.197601 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.197530    2559 generic.go:356] "Generic (PLEG): container finished" podID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerID="05d3e455961b287604e264410adfe9151fbb9f66562eafe1a7616f876b56e52a" exitCode=6
Jul 16 21:54:27.197735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.197619    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerDied","Data":"05d3e455961b287604e264410adfe9151fbb9f66562eafe1a7616f876b56e52a"}
Jul 16 21:54:27.197735 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.197670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerStarted","Data":"4329e1e8c1c2ea6584e8282e52a26994e216e633b8f19eb943db32c470f1dadb"}
Jul 16 21:54:27.197815 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.197765    2559 scope.go:117] "RemoveContainer" containerID="05d3e455961b287604e264410adfe9151fbb9f66562eafe1a7616f876b56e52a"
Jul 16 21:54:27.252154 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.252121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55\" (UID: \"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:27.252715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.252698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55\" (UID: \"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:27.348561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.348533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:27.701899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:27.701875    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:27.704205 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:54:27.704178    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c3ee85_8c54_4ea7_b748_9c8f250e0fa4.slice/crio-24ebb4bedb082d2498d064bfc1ce98f1de85bd9ad960c5c0695257fb05f17677 WatchSource:0}: Error finding container 24ebb4bedb082d2498d064bfc1ce98f1de85bd9ad960c5c0695257fb05f17677: Status 404 returned error can't find the container with id 24ebb4bedb082d2498d064bfc1ce98f1de85bd9ad960c5c0695257fb05f17677
Jul 16 21:54:28.204868 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.204836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerStarted","Data":"46c43ced0898d3a6301f3d46c7a3c109c7f7a695cbd716c734a36e318e838944"}
Jul 16 21:54:28.205337 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.204892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerStarted","Data":"24ebb4bedb082d2498d064bfc1ce98f1de85bd9ad960c5c0695257fb05f17677"}
Jul 16 21:54:28.206675 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.206650    2559 generic.go:356] "Generic (PLEG): container finished" podID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerID="d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09" exitCode=6
Jul 16 21:54:28.206810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.206704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerDied","Data":"d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09"}
Jul 16 21:54:28.206810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.206756    2559 scope.go:117] "RemoveContainer" containerID="05d3e455961b287604e264410adfe9151fbb9f66562eafe1a7616f876b56e52a"
Jul 16 21:54:28.206970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.206950    2559 scope.go:117] "RemoveContainer" containerID="d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09"
Jul 16 21:54:28.207206 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:28.207187    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz_odh-ai-gateway-infra(efb9ab36-07d1-4c0b-a7bc-c774aa15fe97)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97"
Jul 16 21:54:28.224431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:28.224390    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" podStartSLOduration=1.224378057 podStartE2EDuration="1.224378057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:28.221063082 +0000 UTC m=+2731.071680459" watchObservedRunningTime="2026-07-16 21:54:28.224378057 +0000 UTC m=+2731.074995435"
Jul 16 21:54:29.217181 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:29.217147    2559 generic.go:356] "Generic (PLEG): container finished" podID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerID="46c43ced0898d3a6301f3d46c7a3c109c7f7a695cbd716c734a36e318e838944" exitCode=6
Jul 16 21:54:29.217622 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:29.217236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerDied","Data":"46c43ced0898d3a6301f3d46c7a3c109c7f7a695cbd716c734a36e318e838944"}
Jul 16 21:54:29.217622 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:29.217389    2559 scope.go:117] "RemoveContainer" containerID="46c43ced0898d3a6301f3d46c7a3c109c7f7a695cbd716c734a36e318e838944"
Jul 16 21:54:29.219409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:29.219393    2559 scope.go:117] "RemoveContainer" containerID="d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09"
Jul 16 21:54:29.219592 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:29.219574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz_odh-ai-gateway-infra(efb9ab36-07d1-4c0b-a7bc-c774aa15fe97)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97"
Jul 16 21:54:30.226167 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:30.226136    2559 generic.go:356] "Generic (PLEG): container finished" podID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerID="f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0" exitCode=6
Jul 16 21:54:30.226589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:30.226180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerDied","Data":"f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0"}
Jul 16 21:54:30.226589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:30.226227    2559 scope.go:117] "RemoveContainer" containerID="46c43ced0898d3a6301f3d46c7a3c109c7f7a695cbd716c734a36e318e838944"
Jul 16 21:54:30.226589 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:30.226430    2559 scope.go:117] "RemoveContainer" containerID="f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0"
Jul 16 21:54:30.226715 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:30.226629    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55_odh-ai-gateway-infra(60c3ee85-8c54-4ea7-b748-9c8f250e0fa4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4"
Jul 16 21:54:31.233428 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:31.233397    2559 scope.go:117] "RemoveContainer" containerID="f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0"
Jul 16 21:54:31.233783 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:31.233568    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55_odh-ai-gateway-infra(60c3ee85-8c54-4ea7-b748-9c8f250e0fa4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4"
Jul 16 21:54:33.516264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.516229    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:33.521038 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.521020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:33.528039 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.528009    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:33.606856 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.606826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq\" (UID: \"252bb095-f066-4c32-bec0-0d90c294c626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:33.707894 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.707867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq\" (UID: \"252bb095-f066-4c32-bec0-0d90c294c626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:33.708528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.708510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq\" (UID: \"252bb095-f066-4c32-bec0-0d90c294c626\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:33.832836 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.832760    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:33.913746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.913719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:54:33.984708 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:33.984683    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:33.986916 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:54:33.986893    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252bb095_f066_4c32_bec0_0d90c294c626.slice/crio-e9cc6801d726e508e741555f0f339b4d91063eda21b080cb632fc773af692e35 WatchSource:0}: Error finding container e9cc6801d726e508e741555f0f339b4d91063eda21b080cb632fc773af692e35: Status 404 returned error can't find the container with id e9cc6801d726e508e741555f0f339b4d91063eda21b080cb632fc773af692e35
Jul 16 21:54:34.250576 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:34.250539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" event={"ID":"252bb095-f066-4c32-bec0-0d90c294c626","Type":"ContainerStarted","Data":"e9cc6801d726e508e741555f0f339b4d91063eda21b080cb632fc773af692e35"}
Jul 16 21:54:35.258407 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:35.258373    2559 generic.go:356] "Generic (PLEG): container finished" podID="252bb095-f066-4c32-bec0-0d90c294c626" containerID="e84877fc988a7e8364034813e3a938491c59c69de5edb76f0330cbc06b38457d" exitCode=6
Jul 16 21:54:35.258801 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:35.258418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" event={"ID":"252bb095-f066-4c32-bec0-0d90c294c626","Type":"ContainerDied","Data":"e84877fc988a7e8364034813e3a938491c59c69de5edb76f0330cbc06b38457d"}
Jul 16 21:54:35.258801 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:35.258669    2559 scope.go:117] "RemoveContainer" containerID="e84877fc988a7e8364034813e3a938491c59c69de5edb76f0330cbc06b38457d"
Jul 16 21:54:36.266173 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:36.266139    2559 generic.go:356] "Generic (PLEG): container finished" podID="252bb095-f066-4c32-bec0-0d90c294c626" containerID="ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17" exitCode=6
Jul 16 21:54:36.266542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:36.266231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" event={"ID":"252bb095-f066-4c32-bec0-0d90c294c626","Type":"ContainerDied","Data":"ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17"}
Jul 16 21:54:36.266542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:36.266294    2559 scope.go:117] "RemoveContainer" containerID="e84877fc988a7e8364034813e3a938491c59c69de5edb76f0330cbc06b38457d"
Jul 16 21:54:36.266542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:36.266502    2559 scope.go:117] "RemoveContainer" containerID="ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17"
Jul 16 21:54:36.266754 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:36.266732    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq_odh-ai-gateway-infra(252bb095-f066-4c32-bec0-0d90c294c626)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" podUID="252bb095-f066-4c32-bec0-0d90c294c626"
Jul 16 21:54:37.273775 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:37.273749    2559 scope.go:117] "RemoveContainer" containerID="ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17"
Jul 16 21:54:37.274186 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:37.273937    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq_odh-ai-gateway-infra(252bb095-f066-4c32-bec0-0d90c294c626)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" podUID="252bb095-f066-4c32-bec0-0d90c294c626"
Jul 16 21:54:40.672789 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:40.672761    2559 scope.go:117] "RemoveContainer" containerID="d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09"
Jul 16 21:54:41.295943 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:41.295902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerStarted","Data":"cbe286a014047f741c7645aeb08920c144c5f049b72fb2e450f63097486ee2cf"}
Jul 16 21:54:41.313504 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:41.313452    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" podStartSLOduration=16.313438275 podStartE2EDuration="16.313438275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:41.311794974 +0000 UTC m=+2744.162412351" watchObservedRunningTime="2026-07-16 21:54:41.313438275 +0000 UTC m=+2744.164055651"
Jul 16 21:54:42.302431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:42.302398    2559 generic.go:356] "Generic (PLEG): container finished" podID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerID="cbe286a014047f741c7645aeb08920c144c5f049b72fb2e450f63097486ee2cf" exitCode=6
Jul 16 21:54:42.302841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:42.302458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerDied","Data":"cbe286a014047f741c7645aeb08920c144c5f049b72fb2e450f63097486ee2cf"}
Jul 16 21:54:42.302841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:42.302539    2559 scope.go:117] "RemoveContainer" containerID="d1b938b36379720ded7be22e26e96ceafb6b71e57d9b2d67858a51c078febf09"
Jul 16 21:54:42.302841 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:42.302784    2559 scope.go:117] "RemoveContainer" containerID="cbe286a014047f741c7645aeb08920c144c5f049b72fb2e450f63097486ee2cf"
Jul 16 21:54:42.303029 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:42.303006    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz_odh-ai-gateway-infra(efb9ab36-07d1-4c0b-a7bc-c774aa15fe97)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97"
Jul 16 21:54:42.327419 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:42.327397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:43.451603 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:43.451580    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:43.597652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:43.597561    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca\") pod \"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97\" (UID: \"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97\") "
Jul 16 21:54:43.597938 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:43.597914    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" (UID: "efb9ab36-07d1-4c0b-a7bc-c774aa15fe97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:54:43.673277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:43.673245    2559 scope.go:117] "RemoveContainer" containerID="f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0"
Jul 16 21:54:43.698526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:43.698503    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:44.315111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.315050    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"
Jul 16 21:54:44.315111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.315084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz" event={"ID":"efb9ab36-07d1-4c0b-a7bc-c774aa15fe97","Type":"ContainerDied","Data":"4329e1e8c1c2ea6584e8282e52a26994e216e633b8f19eb943db32c470f1dadb"}
Jul 16 21:54:44.315360 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.315172    2559 scope.go:117] "RemoveContainer" containerID="cbe286a014047f741c7645aeb08920c144c5f049b72fb2e450f63097486ee2cf"
Jul 16 21:54:44.317515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.317489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerStarted","Data":"0b241b77c1a49c462d0f98f5a680bd0d9cd9668574e6224a005134f35bc669d6"}
Jul 16 21:54:44.331858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.331836    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:44.335327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:44.335303    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wm6dz"]
Jul 16 21:54:45.282404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282372    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:54:45.282802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282770    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282780    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282791    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282796    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282814    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282819    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282880    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282889    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.282953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.282895    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" containerName="revoke-keys"
Jul 16 21:54:45.285857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.285841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:54:45.296128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.296084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:54:45.326698 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.326673    2559 generic.go:356] "Generic (PLEG): container finished" podID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerID="0b241b77c1a49c462d0f98f5a680bd0d9cd9668574e6224a005134f35bc669d6" exitCode=6
Jul 16 21:54:45.326831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.326751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerDied","Data":"0b241b77c1a49c462d0f98f5a680bd0d9cd9668574e6224a005134f35bc669d6"}
Jul 16 21:54:45.326831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.326823    2559 scope.go:117] "RemoveContainer" containerID="f2dca03879d00707d2f1e49e3106bb3a8e81003df84b0b5da3b281a42e1e7cc0"
Jul 16 21:54:45.327115 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.327084    2559 scope.go:117] "RemoveContainer" containerID="0b241b77c1a49c462d0f98f5a680bd0d9cd9668574e6224a005134f35bc669d6"
Jul 16 21:54:45.327316 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:45.327294    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55_odh-ai-gateway-infra(60c3ee85-8c54-4ea7-b748-9c8f250e0fa4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4"
Jul 16 21:54:45.359386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.359362    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:45.414418 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.414391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb\" (UID: \"6e202393-f303-4c5c-b9eb-197cfaf0afb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:54:45.515266 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.515238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb\" (UID: \"6e202393-f303-4c5c-b9eb-197cfaf0afb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:54:45.515781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.515764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb\" (UID: \"6e202393-f303-4c5c-b9eb-197cfaf0afb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:54:45.597248 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.597178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:54:45.679263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.679234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb9ab36-07d1-4c0b-a7bc-c774aa15fe97" path="/var/lib/kubelet/pods/efb9ab36-07d1-4c0b-a7bc-c774aa15fe97/volumes"
Jul 16 21:54:45.740958 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:45.740932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:54:45.742547 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:54:45.742524    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e202393_f303_4c5c_b9eb_197cfaf0afb9.slice/crio-44f5690e954692d4d909071a4d4383d75cc1f53c5b08db4f278fdba01435b691 WatchSource:0}: Error finding container 44f5690e954692d4d909071a4d4383d75cc1f53c5b08db4f278fdba01435b691: Status 404 returned error can't find the container with id 44f5690e954692d4d909071a4d4383d75cc1f53c5b08db4f278fdba01435b691
Jul 16 21:54:46.341543 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.341504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerStarted","Data":"a39142127e3d70ce992866dedf0a3c30e28e2d4077a2c32d8c45c849decd72bc"}
Jul 16 21:54:46.341969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.341584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerStarted","Data":"44f5690e954692d4d909071a4d4383d75cc1f53c5b08db4f278fdba01435b691"}
Jul 16 21:54:46.374933 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.374884    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" podStartSLOduration=1.374869012 podStartE2EDuration="1.374869012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:46.3733739 +0000 UTC m=+2749.223991278" watchObservedRunningTime="2026-07-16 21:54:46.374869012 +0000 UTC m=+2749.225486429"
Jul 16 21:54:46.557293 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.557268    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:46.726749 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.726723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca\") pod \"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4\" (UID: \"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4\") "
Jul 16 21:54:46.727111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.727064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" (UID: "60c3ee85-8c54-4ea7-b748-9c8f250e0fa4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:54:46.828367 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:46.828334    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:47.347727 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.347696    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"
Jul 16 21:54:47.348242 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.347691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55" event={"ID":"60c3ee85-8c54-4ea7-b748-9c8f250e0fa4","Type":"ContainerDied","Data":"24ebb4bedb082d2498d064bfc1ce98f1de85bd9ad960c5c0695257fb05f17677"}
Jul 16 21:54:47.348242 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.347846    2559 scope.go:117] "RemoveContainer" containerID="0b241b77c1a49c462d0f98f5a680bd0d9cd9668574e6224a005134f35bc669d6"
Jul 16 21:54:47.349929 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.349901    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerID="a39142127e3d70ce992866dedf0a3c30e28e2d4077a2c32d8c45c849decd72bc" exitCode=6
Jul 16 21:54:47.350067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.349987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerDied","Data":"a39142127e3d70ce992866dedf0a3c30e28e2d4077a2c32d8c45c849decd72bc"}
Jul 16 21:54:47.350197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.350143    2559 scope.go:117] "RemoveContainer" containerID="a39142127e3d70ce992866dedf0a3c30e28e2d4077a2c32d8c45c849decd72bc"
Jul 16 21:54:47.384444 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.384423    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:47.388969 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.388949    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-m4c55"]
Jul 16 21:54:47.678686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:47.678616    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" path="/var/lib/kubelet/pods/60c3ee85-8c54-4ea7-b748-9c8f250e0fa4/volumes"
Jul 16 21:54:48.359391 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:48.359359    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerID="077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2" exitCode=6
Jul 16 21:54:48.359844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:48.359447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerDied","Data":"077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2"}
Jul 16 21:54:48.359844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:48.359515    2559 scope.go:117] "RemoveContainer" containerID="a39142127e3d70ce992866dedf0a3c30e28e2d4077a2c32d8c45c849decd72bc"
Jul 16 21:54:48.359844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:48.359702    2559 scope.go:117] "RemoveContainer" containerID="077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2"
Jul 16 21:54:48.360028 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:48.359975    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb_odh-ai-gateway-infra(6e202393-f303-4c5c-b9eb-197cfaf0afb9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9"
Jul 16 21:54:48.673241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:48.673205    2559 scope.go:117] "RemoveContainer" containerID="ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17"
Jul 16 21:54:49.366964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:49.366931    2559 generic.go:356] "Generic (PLEG): container finished" podID="252bb095-f066-4c32-bec0-0d90c294c626" containerID="15cc5051e5e9af421b958b2f2e7bef1b9f1dadfda40f887ba148e06083e1c893" exitCode=6
Jul 16 21:54:49.367366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:49.367006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" event={"ID":"252bb095-f066-4c32-bec0-0d90c294c626","Type":"ContainerDied","Data":"15cc5051e5e9af421b958b2f2e7bef1b9f1dadfda40f887ba148e06083e1c893"}
Jul 16 21:54:49.367366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:49.367073    2559 scope.go:117] "RemoveContainer" containerID="ffdf2e07e050366802bbdc54259de09c099505c61445e48186195d2a8cc6be17"
Jul 16 21:54:49.367366 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:49.367367    2559 scope.go:117] "RemoveContainer" containerID="15cc5051e5e9af421b958b2f2e7bef1b9f1dadfda40f887ba148e06083e1c893"
Jul 16 21:54:49.367625 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:49.367602    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq_odh-ai-gateway-infra(252bb095-f066-4c32-bec0-0d90c294c626)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" podUID="252bb095-f066-4c32-bec0-0d90c294c626"
Jul 16 21:54:49.369129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:49.369113    2559 scope.go:117] "RemoveContainer" containerID="077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2"
Jul 16 21:54:49.369334 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:54:49.369317    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb_odh-ai-gateway-infra(6e202393-f303-4c5c-b9eb-197cfaf0afb9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9"
Jul 16 21:54:50.396596 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:50.396559    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:50.541207 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:50.541187    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:50.660887 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:50.660806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca\") pod \"252bb095-f066-4c32-bec0-0d90c294c626\" (UID: \"252bb095-f066-4c32-bec0-0d90c294c626\") "
Jul 16 21:54:50.663221 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:50.661382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "252bb095-f066-4c32-bec0-0d90c294c626" (UID: "252bb095-f066-4c32-bec0-0d90c294c626"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:54:50.663221 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:50.661572    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/252bb095-f066-4c32-bec0-0d90c294c626-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:54:51.381609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.381567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq" event={"ID":"252bb095-f066-4c32-bec0-0d90c294c626","Type":"ContainerDied","Data":"e9cc6801d726e508e741555f0f339b4d91063eda21b080cb632fc773af692e35"}
Jul 16 21:54:51.381609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.381592    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"
Jul 16 21:54:51.381848 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.381645    2559 scope.go:117] "RemoveContainer" containerID="15cc5051e5e9af421b958b2f2e7bef1b9f1dadfda40f887ba148e06083e1c893"
Jul 16 21:54:51.408451 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.408429    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:51.414384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.414362    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-t7clq"]
Jul 16 21:54:51.678288 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:54:51.678209    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252bb095-f066-4c32-bec0-0d90c294c626" path="/var/lib/kubelet/pods/252bb095-f066-4c32-bec0-0d90c294c626/volumes"
Jul 16 21:55:02.672488 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:02.672457    2559 scope.go:117] "RemoveContainer" containerID="077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2"
Jul 16 21:55:03.450213 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:03.450178    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerID="e65eeac429d81f2330b1939be4778c58d74bbeeba7eb559a8d76b41d6e1c9b45" exitCode=6
Jul 16 21:55:03.450403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:03.450225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerDied","Data":"e65eeac429d81f2330b1939be4778c58d74bbeeba7eb559a8d76b41d6e1c9b45"}
Jul 16 21:55:03.450403 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:03.450290    2559 scope.go:117] "RemoveContainer" containerID="077aaf070658138430b03d9420b284c788b6ebca0883e9b50eddc91e1e494bc2"
Jul 16 21:55:03.450584 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:03.450565    2559 scope.go:117] "RemoveContainer" containerID="e65eeac429d81f2330b1939be4778c58d74bbeeba7eb559a8d76b41d6e1c9b45"
Jul 16 21:55:03.450840 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:03.450816    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb_odh-ai-gateway-infra(6e202393-f303-4c5c-b9eb-197cfaf0afb9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9"
Jul 16 21:55:04.477581 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:04.477548    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:55:04.613838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:04.613815    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:55:04.684072 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:04.684037    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca\") pod \"6e202393-f303-4c5c-b9eb-197cfaf0afb9\" (UID: \"6e202393-f303-4c5c-b9eb-197cfaf0afb9\") "
Jul 16 21:55:04.684414 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:04.684391    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6e202393-f303-4c5c-b9eb-197cfaf0afb9" (UID: "6e202393-f303-4c5c-b9eb-197cfaf0afb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:55:04.785394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:04.785335    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e202393-f303-4c5c-b9eb-197cfaf0afb9-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:55:05.162747 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.162655    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"]
Jul 16 21:55:05.163187 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163169    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163187 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163189    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163201    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163208    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163215    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163223    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163235    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163243    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163254    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163261    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163273    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163280    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163405    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163418    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163430    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163439    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163448    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163456    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163466    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:05.163830 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.163475    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:05.166670 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.166649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:05.175484 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.175458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"]
Jul 16 21:55:05.187770 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.187740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd\" (UID: \"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:05.288749 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.288715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd\" (UID: \"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:05.289351 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.289333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd\" (UID: \"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:05.463904 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.463882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"
Jul 16 21:55:05.464116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.463935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb" event={"ID":"6e202393-f303-4c5c-b9eb-197cfaf0afb9","Type":"ContainerDied","Data":"44f5690e954692d4d909071a4d4383d75cc1f53c5b08db4f278fdba01435b691"}
Jul 16 21:55:05.464116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.464016    2559 scope.go:117] "RemoveContainer" containerID="e65eeac429d81f2330b1939be4778c58d74bbeeba7eb559a8d76b41d6e1c9b45"
Jul 16 21:55:05.479632 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.479613    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:05.486876 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.486397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:55:05.493176 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.493156    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xwfdb"]
Jul 16 21:55:05.621320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.621294    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"]
Jul 16 21:55:05.622541 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:55:05.622508    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe94a168_0cbc_45c1_8dc9_f5b6efd4df12.slice/crio-bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6 WatchSource:0}: Error finding container bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6: Status 404 returned error can't find the container with id bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6
Jul 16 21:55:05.680696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:05.680659    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" path="/var/lib/kubelet/pods/6e202393-f303-4c5c-b9eb-197cfaf0afb9/volumes"
Jul 16 21:55:06.469976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:06.469945    2559 generic.go:356] "Generic (PLEG): container finished" podID="fe94a168-0cbc-45c1-8dc9-f5b6efd4df12" containerID="6607a402de4b3720562ac575565e79eee9871fcec3dd456734ac1105eec5082f" exitCode=0
Jul 16 21:55:06.470163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:06.470031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd" event={"ID":"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12","Type":"ContainerDied","Data":"6607a402de4b3720562ac575565e79eee9871fcec3dd456734ac1105eec5082f"}
Jul 16 21:55:06.470163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:06.470103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd" event={"ID":"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12","Type":"ContainerStarted","Data":"bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6"}
Jul 16 21:55:07.338872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.338835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:07.440579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.440548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:07.613812 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.613791    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:07.711838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.711812    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca\") pod \"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12\" (UID: \"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12\") "
Jul 16 21:55:07.712216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.712195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe94a168-0cbc-45c1-8dc9-f5b6efd4df12" (UID: "fe94a168-0cbc-45c1-8dc9-f5b6efd4df12"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:55:07.812464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:07.812438    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe94a168-0cbc-45c1-8dc9-f5b6efd4df12-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:55:08.482609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:08.482574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd" event={"ID":"fe94a168-0cbc-45c1-8dc9-f5b6efd4df12","Type":"ContainerDied","Data":"bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6"}
Jul 16 21:55:08.483077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:08.482643    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc71b9acdd884125661c876a421f7f242f31800f0620510163911694d55c06c6"
Jul 16 21:55:08.483077 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:08.482588    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd"
Jul 16 21:55:15.664660 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.664620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:15.765920 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.765877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:15.946698 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.946615    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:15.947123 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947083    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe94a168-0cbc-45c1-8dc9-f5b6efd4df12" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947126    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe94a168-0cbc-45c1-8dc9-f5b6efd4df12" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947141    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947149    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="252bb095-f066-4c32-bec0-0d90c294c626" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947191    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947199    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e202393-f303-4c5c-b9eb-197cfaf0afb9" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947213    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:15.947233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947221    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:15.947568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947316    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c3ee85-8c54-4ea7-b748-9c8f250e0fa4" containerName="revoke-keys"
Jul 16 21:55:15.947568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.947332    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe94a168-0cbc-45c1-8dc9-f5b6efd4df12" containerName="revoke-keys"
Jul 16 21:55:15.950641 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.950619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:15.955976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.955948    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:55:15.975859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:15.975836    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:16.081750 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.081718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn\" (UID: \"fd8d87d4-3625-455f-aab1-517bd4c88292\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:16.091924 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.091882    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:16.182955 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.182926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn\" (UID: \"fd8d87d4-3625-455f-aab1-517bd4c88292\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:16.183528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.183510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn\" (UID: \"fd8d87d4-3625-455f-aab1-517bd4c88292\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:16.261515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.261486    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:16.424831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.424801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:16.429233 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:55:16.429208    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8d87d4_3625_455f_aab1_517bd4c88292.slice/crio-e6831651fe0b49041da3cb97c3a36f6288458fd8d95ec5e540b7eb3d6de3951e WatchSource:0}: Error finding container e6831651fe0b49041da3cb97c3a36f6288458fd8d95ec5e540b7eb3d6de3951e: Status 404 returned error can't find the container with id e6831651fe0b49041da3cb97c3a36f6288458fd8d95ec5e540b7eb3d6de3951e
Jul 16 21:55:16.526254 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:16.526195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" event={"ID":"fd8d87d4-3625-455f-aab1-517bd4c88292","Type":"ContainerStarted","Data":"e6831651fe0b49041da3cb97c3a36f6288458fd8d95ec5e540b7eb3d6de3951e"}
Jul 16 21:55:17.532725 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:17.532650    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerID="71114f246cc0a4ee5649c02382355d5931af73d9ff422d04b37efc0d17140297" exitCode=6
Jul 16 21:55:17.533118 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:17.532713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" event={"ID":"fd8d87d4-3625-455f-aab1-517bd4c88292","Type":"ContainerDied","Data":"71114f246cc0a4ee5649c02382355d5931af73d9ff422d04b37efc0d17140297"}
Jul 16 21:55:17.533118 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:17.532884    2559 scope.go:117] "RemoveContainer" containerID="71114f246cc0a4ee5649c02382355d5931af73d9ff422d04b37efc0d17140297"
Jul 16 21:55:18.540542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:18.540450    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerID="4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2" exitCode=6
Jul 16 21:55:18.540542 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:18.540526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" event={"ID":"fd8d87d4-3625-455f-aab1-517bd4c88292","Type":"ContainerDied","Data":"4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2"}
Jul 16 21:55:18.541043 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:18.540582    2559 scope.go:117] "RemoveContainer" containerID="71114f246cc0a4ee5649c02382355d5931af73d9ff422d04b37efc0d17140297"
Jul 16 21:55:18.541043 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:18.540839    2559 scope.go:117] "RemoveContainer" containerID="4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2"
Jul 16 21:55:18.541130 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:18.541044    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn_odh-ai-gateway-infra(fd8d87d4-3625-455f-aab1-517bd4c88292)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292"
Jul 16 21:55:19.549365 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:19.549331    2559 scope.go:117] "RemoveContainer" containerID="4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2"
Jul 16 21:55:19.549711 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:19.549598    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn_odh-ai-gateway-infra(fd8d87d4-3625-455f-aab1-517bd4c88292)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292"
Jul 16 21:55:20.290948 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:20.290908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:23.553462 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.553425    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:23.558552 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.558530    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:23.567689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.566970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:23.646060 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.646035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl\" (UID: \"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:23.746619 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.746594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl\" (UID: \"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:23.747209 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.747182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl\" (UID: \"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:23.872554 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:23.872468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:24.011058 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:24.011036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:24.013189 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:55:24.013158    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b426a4_df7c_475e_9a6b_6dc6c14a22c8.slice/crio-21ea58a3e4253024b40796d45373159f4252cba93c92593567a7f13ae0bc5ff7 WatchSource:0}: Error finding container 21ea58a3e4253024b40796d45373159f4252cba93c92593567a7f13ae0bc5ff7: Status 404 returned error can't find the container with id 21ea58a3e4253024b40796d45373159f4252cba93c92593567a7f13ae0bc5ff7
Jul 16 21:55:24.580313 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:24.580230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerStarted","Data":"81c2aee37478b0d43aa8e5bfee8aeaa022a02afab89fdaaf61ba9c8ffccb450d"}
Jul 16 21:55:24.580313 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:24.580283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerStarted","Data":"21ea58a3e4253024b40796d45373159f4252cba93c92593567a7f13ae0bc5ff7"}
Jul 16 21:55:24.599332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:24.599286    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" podStartSLOduration=1.5992711229999999 podStartE2EDuration="1.599271123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:55:24.597155252 +0000 UTC m=+2787.447772626" watchObservedRunningTime="2026-07-16 21:55:24.599271123 +0000 UTC m=+2787.449888500"
Jul 16 21:55:25.333945 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:25.333914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:25.586390 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:25.586302    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerID="81c2aee37478b0d43aa8e5bfee8aeaa022a02afab89fdaaf61ba9c8ffccb450d" exitCode=6
Jul 16 21:55:25.586746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:25.586396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerDied","Data":"81c2aee37478b0d43aa8e5bfee8aeaa022a02afab89fdaaf61ba9c8ffccb450d"}
Jul 16 21:55:25.586746 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:25.586554    2559 scope.go:117] "RemoveContainer" containerID="81c2aee37478b0d43aa8e5bfee8aeaa022a02afab89fdaaf61ba9c8ffccb450d"
Jul 16 21:55:26.195626 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:26.195593    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b426a4_df7c_475e_9a6b_6dc6c14a22c8.slice/crio-97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b426a4_df7c_475e_9a6b_6dc6c14a22c8.slice/crio-conmon-97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 21:55:26.593104 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:26.593069    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerID="97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da" exitCode=6
Jul 16 21:55:26.593478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:26.593156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerDied","Data":"97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da"}
Jul 16 21:55:26.593478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:26.593237    2559 scope.go:117] "RemoveContainer" containerID="81c2aee37478b0d43aa8e5bfee8aeaa022a02afab89fdaaf61ba9c8ffccb450d"
Jul 16 21:55:26.593478 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:26.593428    2559 scope.go:117] "RemoveContainer" containerID="97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da"
Jul 16 21:55:26.593644 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:26.593625    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl_odh-ai-gateway-infra(c0b426a4-df7c-475e-9a6b-6dc6c14a22c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8"
Jul 16 21:55:27.094272 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.094238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:27.098962 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.098945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:27.109621 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.109594    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:27.178857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.178825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf\" (UID: \"902229c1-97f5-4e5e-ac02-3030d3124374\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:27.279668 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.279627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf\" (UID: \"902229c1-97f5-4e5e-ac02-3030d3124374\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:27.280333 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.280313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf\" (UID: \"902229c1-97f5-4e5e-ac02-3030d3124374\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:27.410359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.410277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:27.600375 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.600345    2559 scope.go:117] "RemoveContainer" containerID="97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da"
Jul 16 21:55:27.600734 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:27.600529    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl_odh-ai-gateway-infra(c0b426a4-df7c-475e-9a6b-6dc6c14a22c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8"
Jul 16 21:55:27.757268 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:27.757230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:27.759399 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:55:27.759376    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902229c1_97f5_4e5e_ac02_3030d3124374.slice/crio-fd4df8879ed33001265962e4ae293c95e4233cb610a1b9a6cd37a364ae529819 WatchSource:0}: Error finding container fd4df8879ed33001265962e4ae293c95e4233cb610a1b9a6cd37a364ae529819: Status 404 returned error can't find the container with id fd4df8879ed33001265962e4ae293c95e4233cb610a1b9a6cd37a364ae529819
Jul 16 21:55:28.607618 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:28.607586    2559 generic.go:356] "Generic (PLEG): container finished" podID="902229c1-97f5-4e5e-ac02-3030d3124374" containerID="5fd00ba7319bdbad05f5310fce7e21b9153bd22fe1dc7d1f2f734185191e1cd4" exitCode=6
Jul 16 21:55:28.607966 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:28.607671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" event={"ID":"902229c1-97f5-4e5e-ac02-3030d3124374","Type":"ContainerDied","Data":"5fd00ba7319bdbad05f5310fce7e21b9153bd22fe1dc7d1f2f734185191e1cd4"}
Jul 16 21:55:28.607966 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:28.607732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" event={"ID":"902229c1-97f5-4e5e-ac02-3030d3124374","Type":"ContainerStarted","Data":"fd4df8879ed33001265962e4ae293c95e4233cb610a1b9a6cd37a364ae529819"}
Jul 16 21:55:28.607966 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:28.607857    2559 scope.go:117] "RemoveContainer" containerID="5fd00ba7319bdbad05f5310fce7e21b9153bd22fe1dc7d1f2f734185191e1cd4"
Jul 16 21:55:29.614423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:29.614339    2559 generic.go:356] "Generic (PLEG): container finished" podID="902229c1-97f5-4e5e-ac02-3030d3124374" containerID="46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d" exitCode=6
Jul 16 21:55:29.614423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:29.614413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" event={"ID":"902229c1-97f5-4e5e-ac02-3030d3124374","Type":"ContainerDied","Data":"46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d"}
Jul 16 21:55:29.614847 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:29.614457    2559 scope.go:117] "RemoveContainer" containerID="5fd00ba7319bdbad05f5310fce7e21b9153bd22fe1dc7d1f2f734185191e1cd4"
Jul 16 21:55:29.614847 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:29.614625    2559 scope.go:117] "RemoveContainer" containerID="46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d"
Jul 16 21:55:29.614847 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:29.614825    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf_odh-ai-gateway-infra(902229c1-97f5-4e5e-ac02-3030d3124374)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" podUID="902229c1-97f5-4e5e-ac02-3030d3124374"
Jul 16 21:55:30.620805 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:30.620775    2559 scope.go:117] "RemoveContainer" containerID="46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d"
Jul 16 21:55:30.621202 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:30.621005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf_odh-ai-gateway-infra(902229c1-97f5-4e5e-ac02-3030d3124374)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" podUID="902229c1-97f5-4e5e-ac02-3030d3124374"
Jul 16 21:55:34.673304 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:34.673272    2559 scope.go:117] "RemoveContainer" containerID="4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2"
Jul 16 21:55:34.775976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:34.775950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:35.650263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:35.650185    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerID="c098716e6fb03332682c7a98b7bee2ff96480ce34023c2de822cccf976a474f9" exitCode=6
Jul 16 21:55:35.650263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:35.650223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" event={"ID":"fd8d87d4-3625-455f-aab1-517bd4c88292","Type":"ContainerDied","Data":"c098716e6fb03332682c7a98b7bee2ff96480ce34023c2de822cccf976a474f9"}
Jul 16 21:55:35.650538 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:35.650279    2559 scope.go:117] "RemoveContainer" containerID="4b6bf9beeb49562a5ad96258e21d7332707068bdd1187f687719af382cb41bd2"
Jul 16 21:55:35.650610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:35.650549    2559 scope.go:117] "RemoveContainer" containerID="c098716e6fb03332682c7a98b7bee2ff96480ce34023c2de822cccf976a474f9"
Jul 16 21:55:35.650861 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:35.650839    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn_odh-ai-gateway-infra(fd8d87d4-3625-455f-aab1-517bd4c88292)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292"
Jul 16 21:55:36.687185 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:36.687128    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:36.830721 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:36.830689    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:36.968865 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:36.968841    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca\") pod \"fd8d87d4-3625-455f-aab1-517bd4c88292\" (UID: \"fd8d87d4-3625-455f-aab1-517bd4c88292\") "
Jul 16 21:55:36.969263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:36.969241    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd8d87d4-3625-455f-aab1-517bd4c88292" (UID: "fd8d87d4-3625-455f-aab1-517bd4c88292"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:55:37.070359 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.070328    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8d87d4-3625-455f-aab1-517bd4c88292-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:55:37.663600 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.663570    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"
Jul 16 21:55:37.663600 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.663579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn" event={"ID":"fd8d87d4-3625-455f-aab1-517bd4c88292","Type":"ContainerDied","Data":"e6831651fe0b49041da3cb97c3a36f6288458fd8d95ec5e540b7eb3d6de3951e"}
Jul 16 21:55:37.663844 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.663669    2559 scope.go:117] "RemoveContainer" containerID="c098716e6fb03332682c7a98b7bee2ff96480ce34023c2de822cccf976a474f9"
Jul 16 21:55:37.672759 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.672741    2559 scope.go:117] "RemoveContainer" containerID="97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da"
Jul 16 21:55:37.690423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.690385    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:37.695280 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:37.695258    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-qwrnn"]
Jul 16 21:55:38.670737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:38.670656    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerID="1e09aba2c29950ed25138568858862eed559efcdeebd1c5ea325475002bfb59e" exitCode=6
Jul 16 21:55:38.670737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:38.670690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerDied","Data":"1e09aba2c29950ed25138568858862eed559efcdeebd1c5ea325475002bfb59e"}
Jul 16 21:55:38.670737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:38.670735    2559 scope.go:117] "RemoveContainer" containerID="97e5d1e9e1d7a06f2b5abf263680f93568567ca85720403e94d0d490f6ef05da"
Jul 16 21:55:38.671106 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:38.671070    2559 scope.go:117] "RemoveContainer" containerID="1e09aba2c29950ed25138568858862eed559efcdeebd1c5ea325475002bfb59e"
Jul 16 21:55:38.671314 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:38.671289    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl_odh-ai-gateway-infra(c0b426a4-df7c-475e-9a6b-6dc6c14a22c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8"
Jul 16 21:55:39.679644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:39.679611    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" path="/var/lib/kubelet/pods/fd8d87d4-3625-455f-aab1-517bd4c88292/volumes"
Jul 16 21:55:39.698741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:39.698708    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:39.837393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:39.837372    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:39.997389 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:39.997353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca\") pod \"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8\" (UID: \"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8\") "
Jul 16 21:55:39.997690 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:39.997667    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" (UID: "c0b426a4-df7c-475e-9a6b-6dc6c14a22c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:55:40.097999 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.097969    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:55:40.684730 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.684695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl" event={"ID":"c0b426a4-df7c-475e-9a6b-6dc6c14a22c8","Type":"ContainerDied","Data":"21ea58a3e4253024b40796d45373159f4252cba93c92593567a7f13ae0bc5ff7"}
Jul 16 21:55:40.685176 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.684748    2559 scope.go:117] "RemoveContainer" containerID="1e09aba2c29950ed25138568858862eed559efcdeebd1c5ea325475002bfb59e"
Jul 16 21:55:40.685176 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.684711    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"
Jul 16 21:55:40.711364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.711336    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:40.718200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:40.718178    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ljnkl"]
Jul 16 21:55:41.678678 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:41.678647    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" path="/var/lib/kubelet/pods/c0b426a4-df7c-475e-9a6b-6dc6c14a22c8/volumes"
Jul 16 21:55:44.419383 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:44.419350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:44.673250 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:44.673181    2559 scope.go:117] "RemoveContainer" containerID="46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d"
Jul 16 21:55:45.712659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:45.712570    2559 generic.go:356] "Generic (PLEG): container finished" podID="902229c1-97f5-4e5e-ac02-3030d3124374" containerID="c6fa3b7f9067a2d346a4d5d20d72d79522fc29794c55f5d9a958e4b3461bd136" exitCode=6
Jul 16 21:55:45.712659 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:45.712633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" event={"ID":"902229c1-97f5-4e5e-ac02-3030d3124374","Type":"ContainerDied","Data":"c6fa3b7f9067a2d346a4d5d20d72d79522fc29794c55f5d9a958e4b3461bd136"}
Jul 16 21:55:45.713152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:45.712694    2559 scope.go:117] "RemoveContainer" containerID="46794b1d57749fa44856093f61937f707a5e319087a2025e33a06d097c49141d"
Jul 16 21:55:45.713152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:45.712949    2559 scope.go:117] "RemoveContainer" containerID="c6fa3b7f9067a2d346a4d5d20d72d79522fc29794c55f5d9a958e4b3461bd136"
Jul 16 21:55:45.713281 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:55:45.713221    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf_odh-ai-gateway-infra(902229c1-97f5-4e5e-ac02-3030d3124374)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" podUID="902229c1-97f5-4e5e-ac02-3030d3124374"
Jul 16 21:55:46.115325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:46.115292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:46.744973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:46.744940    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:46.892140 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:46.892114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:47.055854 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.055765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca\") pod \"902229c1-97f5-4e5e-ac02-3030d3124374\" (UID: \"902229c1-97f5-4e5e-ac02-3030d3124374\") "
Jul 16 21:55:47.056129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.056081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "902229c1-97f5-4e5e-ac02-3030d3124374" (UID: "902229c1-97f5-4e5e-ac02-3030d3124374"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:55:47.156420 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.156383    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/902229c1-97f5-4e5e-ac02-3030d3124374-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:55:47.725411 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.725378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf" event={"ID":"902229c1-97f5-4e5e-ac02-3030d3124374","Type":"ContainerDied","Data":"fd4df8879ed33001265962e4ae293c95e4233cb610a1b9a6cd37a364ae529819"}
Jul 16 21:55:47.725561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.725413    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"
Jul 16 21:55:47.725561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.725444    2559 scope.go:117] "RemoveContainer" containerID="c6fa3b7f9067a2d346a4d5d20d72d79522fc29794c55f5d9a958e4b3461bd136"
Jul 16 21:55:47.744038 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.744013    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:47.749005 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:47.748984    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-r22zf"]
Jul 16 21:55:49.678973 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:49.678941    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" path="/var/lib/kubelet/pods/902229c1-97f5-4e5e-ac02-3030d3124374/volumes"
Jul 16 21:55:52.895685 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:52.895644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:55:52.991390 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:55:52.991349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:02.634980 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:02.634948    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:02.860137 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:02.860081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:03.927598 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:03.927565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:04.055959 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:04.055911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:04.883562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:04.883525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:05.072295 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:05.072241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:06.486198 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:06.486166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:13.213156 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:13.213117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:13.321152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:13.321125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:13.870505 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:13.870465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:21.387607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:21.387567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:21.718220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:21.718189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:21.881715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:21.881677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:32.154575 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:32.154537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:32.486579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:32.486543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:56:53.504141 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:56:53.504051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:02.533998 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:02.533957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:02.679437 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:02.679386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:03.005999 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.005954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:03.498835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.498804    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:57:03.499306 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499271    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499310    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499321    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499327    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499336    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499342    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499351    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499356 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499356    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499370    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499379    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499387    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499392    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499402    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499408    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499474    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499483    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499489    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499494    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499501    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499506    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499512    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:03.499568 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.499516    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:03.502702 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.502686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.509665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.509644    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f53605-openshift-default-dockercfg-6b9rp\""
Jul 16 21:57:03.563193 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.563163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:57:03.622628 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw2km\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622787 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622956 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622956 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.622956 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.622844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.647111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.647071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:03.723899 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.723868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.723912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw2km\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.723954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724064 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.723981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724305 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724744 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.724872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.724825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.726390 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.726368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.726682 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.726664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.749161 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.749076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.753968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.753943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw2km\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km\") pod \"e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") " pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.813431 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.813398    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:03.971050 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.971008    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:57:03.983520 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:57:03.983492    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54008504_a8e7_4e65_b88e_10b22e79b2fc.slice/crio-6cb47bd7498b059a47fe5394b4676ad3c17c4c773b224dc9dadb3e3fffae8d4e WatchSource:0}: Error finding container 6cb47bd7498b059a47fe5394b4676ad3c17c4c773b224dc9dadb3e3fffae8d4e: Status 404 returned error can't find the container with id 6cb47bd7498b059a47fe5394b4676ad3c17c4c773b224dc9dadb3e3fffae8d4e
Jul 16 21:57:03.985648 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.985617    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:03.985719 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.985683    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:03.985719 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:03.985713    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:04.085825 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:04.085791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:04.123106 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:04.123056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerStarted","Data":"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"}
Jul 16 21:57:04.123249 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:04.123124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerStarted","Data":"6cb47bd7498b059a47fe5394b4676ad3c17c4c773b224dc9dadb3e3fffae8d4e"}
Jul 16 21:57:04.171405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:04.171344    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podStartSLOduration=1.171323113 podStartE2EDuration="1.171323113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:04.162322416 +0000 UTC m=+2887.012939815" watchObservedRunningTime="2026-07-16 21:57:04.171323113 +0000 UTC m=+2887.021940493"
Jul 16 21:57:04.813635 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:04.813600    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:05.818777 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:05.818749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:06.133652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.133572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:06.134422 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.134406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:06.524685 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.524649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:06.700753 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.700719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:06.799132 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.798993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:06.954129 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:06.954074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:07.574236 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:07.574182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:07.711457 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:07.711414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:10.945171 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:10.945133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:11.282610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:11.282566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:11.709144 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:11.709030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:12.235610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:12.235576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:14.690375 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:14.690343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:14.798354 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:14.798327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:15.007520 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:15.007483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:15.109269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:15.109238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:15.616664 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:15.616622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:16.053534 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.053501    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:16.054827 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.054803    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:16.054986 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.054973    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b426a4-df7c-475e-9a6b-6dc6c14a22c8" containerName="revoke-keys"
Jul 16 21:57:16.055940 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.055912    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:16.056120 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.056082    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="902229c1-97f5-4e5e-ac02-3030d3124374" containerName="revoke-keys"
Jul 16 21:57:16.056330 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.056317    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8d87d4-3625-455f-aab1-517bd4c88292" containerName="revoke-keys"
Jul 16 21:57:16.060148 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.060129    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:16.063706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.063658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:57:16.067866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.067844    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:16.142127 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.142071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf\" (UID: \"e09ab81e-a794-4117-8c18-3881420f4c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:16.242947 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.242918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf\" (UID: \"e09ab81e-a794-4117-8c18-3881420f4c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:16.243696 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.243674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf\" (UID: \"e09ab81e-a794-4117-8c18-3881420f4c6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:16.376570 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.376478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:16.582138 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.581846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:16.963562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:16.963356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:17.192143 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.192107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerStarted","Data":"13c1750d5970e96149221e6bdc00255ace694308eb8de1a912cc342648fca337"}
Jul 16 21:57:17.192514 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.192158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerStarted","Data":"7365315ef4f474a5ff178cef4144ed32b5692870e80798214768df2dda55bcbd"}
Jul 16 21:57:17.240469 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.240426    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" podStartSLOduration=1.240411478 podStartE2EDuration="1.240411478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:17.238069879 +0000 UTC m=+2900.088687255" watchObservedRunningTime="2026-07-16 21:57:17.240411478 +0000 UTC m=+2900.091028855"
Jul 16 21:57:17.261341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.261298    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:17.265770 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.265748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:17.286241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.286207    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:17.355707 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.355673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp\" (UID: \"633779ff-14f3-4b57-8d69-9f5fa94f0b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:17.457345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.457311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp\" (UID: \"633779ff-14f3-4b57-8d69-9f5fa94f0b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:17.458218 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.458187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp\" (UID: \"633779ff-14f3-4b57-8d69-9f5fa94f0b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:17.582117 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.581999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:17.740624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:17.740603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:17.743530 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:57:17.743497    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633779ff_14f3_4b57_8d69_9f5fa94f0b4c.slice/crio-1bcf1c3848c0b336f735b9e9d533ca691f29fa8a1090efc3243862b9f4e54c1f WatchSource:0}: Error finding container 1bcf1c3848c0b336f735b9e9d533ca691f29fa8a1090efc3243862b9f4e54c1f: Status 404 returned error can't find the container with id 1bcf1c3848c0b336f735b9e9d533ca691f29fa8a1090efc3243862b9f4e54c1f
Jul 16 21:57:18.199173 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.199138    2559 generic.go:356] "Generic (PLEG): container finished" podID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerID="13c1750d5970e96149221e6bdc00255ace694308eb8de1a912cc342648fca337" exitCode=6
Jul 16 21:57:18.199579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.199242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerDied","Data":"13c1750d5970e96149221e6bdc00255ace694308eb8de1a912cc342648fca337"}
Jul 16 21:57:18.199579 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.199483    2559 scope.go:117] "RemoveContainer" containerID="13c1750d5970e96149221e6bdc00255ace694308eb8de1a912cc342648fca337"
Jul 16 21:57:18.201165 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.201139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerStarted","Data":"aca0fc9a706b115d1717c7c41a3a47a367f9c7cbbfddc5c4c9f419a8a281fcf9"}
Jul 16 21:57:18.201269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.201192    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerStarted","Data":"1bcf1c3848c0b336f735b9e9d533ca691f29fa8a1090efc3243862b9f4e54c1f"}
Jul 16 21:57:18.236346 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:18.236303    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" podStartSLOduration=1.236288181 podStartE2EDuration="1.236288181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:18.2346098 +0000 UTC m=+2901.085227180" watchObservedRunningTime="2026-07-16 21:57:18.236288181 +0000 UTC m=+2901.086905557"
Jul 16 21:57:19.128608 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.128518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:19.208872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.208837    2559 generic.go:356] "Generic (PLEG): container finished" podID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerID="84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132" exitCode=6
Jul 16 21:57:19.209332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.208923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerDied","Data":"84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132"}
Jul 16 21:57:19.209332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.208986    2559 scope.go:117] "RemoveContainer" containerID="13c1750d5970e96149221e6bdc00255ace694308eb8de1a912cc342648fca337"
Jul 16 21:57:19.209332 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.209230    2559 scope.go:117] "RemoveContainer" containerID="84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132"
Jul 16 21:57:19.209516 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:19.209485    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf_odh-ai-gateway-infra(e09ab81e-a794-4117-8c18-3881420f4c6c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c"
Jul 16 21:57:19.210793 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.210769    2559 generic.go:356] "Generic (PLEG): container finished" podID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerID="aca0fc9a706b115d1717c7c41a3a47a367f9c7cbbfddc5c4c9f419a8a281fcf9" exitCode=6
Jul 16 21:57:19.210884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.210821    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerDied","Data":"aca0fc9a706b115d1717c7c41a3a47a367f9c7cbbfddc5c4c9f419a8a281fcf9"}
Jul 16 21:57:19.211073 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:19.211057    2559 scope.go:117] "RemoveContainer" containerID="aca0fc9a706b115d1717c7c41a3a47a367f9c7cbbfddc5c4c9f419a8a281fcf9"
Jul 16 21:57:20.218925 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:20.218872    2559 scope.go:117] "RemoveContainer" containerID="84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132"
Jul 16 21:57:20.219400 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:20.219158    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf_odh-ai-gateway-infra(e09ab81e-a794-4117-8c18-3881420f4c6c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c"
Jul 16 21:57:20.221183 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:20.221157    2559 generic.go:356] "Generic (PLEG): container finished" podID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerID="8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375" exitCode=6
Jul 16 21:57:20.221331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:20.221251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerDied","Data":"8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375"}
Jul 16 21:57:20.221331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:20.221313    2559 scope.go:117] "RemoveContainer" containerID="aca0fc9a706b115d1717c7c41a3a47a367f9c7cbbfddc5c4c9f419a8a281fcf9"
Jul 16 21:57:20.221573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:20.221557    2559 scope.go:117] "RemoveContainer" containerID="8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375"
Jul 16 21:57:20.221783 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:20.221759    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp_odh-ai-gateway-infra(633779ff-14f3-4b57-8d69-9f5fa94f0b4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c"
Jul 16 21:57:21.134948 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.134912    2559 patch_prober.go:28] interesting pod/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 16 21:57:21.135200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.134967    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 16 21:57:21.229967 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.229935    2559 scope.go:117] "RemoveContainer" containerID="8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375"
Jul 16 21:57:21.230437 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:21.230319    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp_odh-ai-gateway-infra(633779ff-14f3-4b57-8d69-9f5fa94f0b4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c"
Jul 16 21:57:21.233962 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.233929    2559 generic.go:356] "Generic (PLEG): container finished" podID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerID="12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3" exitCode=0
Jul 16 21:57:21.234109 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.234016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerDied","Data":"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"}
Jul 16 21:57:21.235879 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.235854    2559 scope.go:117] "RemoveContainer" containerID="12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"
Jul 16 21:57:21.237123 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.237077    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:21.237201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.237164    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:21.237201 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:21.237194    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:57:22.241011 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:22.240978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerStarted","Data":"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"}
Jul 16 21:57:22.814564 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:22.814523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:22.814835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:22.814811    2559 patch_prober.go:28] interesting pod/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 16 21:57:22.814928 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:22.814867    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 16 21:57:23.813921 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:23.813888    2559 patch_prober.go:28] interesting pod/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 16 21:57:23.814429 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:23.813945    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 16 21:57:24.814824 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:24.814783    2559 patch_prober.go:28] interesting pod/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 16 21:57:24.815322 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:24.814845    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 16 21:57:25.495893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.495857    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:25.500409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.500393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:25.510291 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.510266    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:25.629482 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.629446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-njzsr\" (UID: \"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:25.731080 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.731046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-njzsr\" (UID: \"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:25.731679 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.731660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-njzsr\" (UID: \"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:25.813131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.813020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:25.814320 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.814293    2559 patch_prober.go:28] interesting pod/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 16 21:57:25.814467 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:25.814343    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 16 21:57:26.019213 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:26.019187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:26.021133 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:57:26.021100    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ad8e0b_d8b2_42d8_82b9_eaf604ec315f.slice/crio-743fd24f198fd12dbcc6ea34110bef6ea7c43d5562b2bb309a58bef54cdc0e04 WatchSource:0}: Error finding container 743fd24f198fd12dbcc6ea34110bef6ea7c43d5562b2bb309a58bef54cdc0e04: Status 404 returned error can't find the container with id 743fd24f198fd12dbcc6ea34110bef6ea7c43d5562b2bb309a58bef54cdc0e04
Jul 16 21:57:26.268448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:26.268413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" event={"ID":"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f","Type":"ContainerStarted","Data":"743fd24f198fd12dbcc6ea34110bef6ea7c43d5562b2bb309a58bef54cdc0e04"}
Jul 16 21:57:26.817926 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:26.817894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:26.818248 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:26.818228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:26.818931 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:26.818914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:57:27.275877 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:27.275843    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerID="fca9de08d8c6418afafbb5c321f557db026aa0c03cf22c5d4f6839723eae78bb" exitCode=6
Jul 16 21:57:27.276306 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:27.275941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" event={"ID":"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f","Type":"ContainerDied","Data":"fca9de08d8c6418afafbb5c321f557db026aa0c03cf22c5d4f6839723eae78bb"}
Jul 16 21:57:27.276306 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:27.276149    2559 scope.go:117] "RemoveContainer" containerID="fca9de08d8c6418afafbb5c321f557db026aa0c03cf22c5d4f6839723eae78bb"
Jul 16 21:57:28.283416 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:28.283383    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerID="b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5" exitCode=6
Jul 16 21:57:28.283882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:28.283470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" event={"ID":"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f","Type":"ContainerDied","Data":"b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5"}
Jul 16 21:57:28.283882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:28.283539    2559 scope.go:117] "RemoveContainer" containerID="fca9de08d8c6418afafbb5c321f557db026aa0c03cf22c5d4f6839723eae78bb"
Jul 16 21:57:28.283882 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:28.283675    2559 scope.go:117] "RemoveContainer" containerID="b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5"
Jul 16 21:57:28.284031 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:28.283896    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-njzsr_odh-ai-gateway-infra(a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f"
Jul 16 21:57:29.290135 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:29.290085    2559 scope.go:117] "RemoveContainer" containerID="b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5"
Jul 16 21:57:29.290479 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:29.290313    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-njzsr_odh-ai-gateway-infra(a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f"
Jul 16 21:57:30.198070 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:30.198032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:30.290621 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:30.290584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:31.473665 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:31.473637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:31.673232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:31.673202    2559 scope.go:117] "RemoveContainer" containerID="84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132"
Jul 16 21:57:32.314780 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:32.314740    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerStarted","Data":"af711c330f6616bc3bfd22cf1de6c2d71c9b13222c86ef6453f432ccde01e2ff"}
Jul 16 21:57:33.322131 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:33.322084    2559 generic.go:356] "Generic (PLEG): container finished" podID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerID="af711c330f6616bc3bfd22cf1de6c2d71c9b13222c86ef6453f432ccde01e2ff" exitCode=6
Jul 16 21:57:33.322525 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:33.322150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerDied","Data":"af711c330f6616bc3bfd22cf1de6c2d71c9b13222c86ef6453f432ccde01e2ff"}
Jul 16 21:57:33.322525 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:33.322204    2559 scope.go:117] "RemoveContainer" containerID="84596419942adc4d4beb5f7bfc7ac8b9e62800a0da294c91f56e0e3fc8588132"
Jul 16 21:57:33.322525 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:33.322461    2559 scope.go:117] "RemoveContainer" containerID="af711c330f6616bc3bfd22cf1de6c2d71c9b13222c86ef6453f432ccde01e2ff"
Jul 16 21:57:33.322680 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:33.322662    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf_odh-ai-gateway-infra(e09ab81e-a794-4117-8c18-3881420f4c6c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c"
Jul 16 21:57:33.359399 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:33.359369    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:34.483302 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:34.483280    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:34.617067 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:34.616988    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca\") pod \"e09ab81e-a794-4117-8c18-3881420f4c6c\" (UID: \"e09ab81e-a794-4117-8c18-3881420f4c6c\") "
Jul 16 21:57:34.617409 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:34.617379    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e09ab81e-a794-4117-8c18-3881420f4c6c" (UID: "e09ab81e-a794-4117-8c18-3881420f4c6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:57:34.718609 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:34.718580    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e09ab81e-a794-4117-8c18-3881420f4c6c-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:57:35.336424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.336395    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"
Jul 16 21:57:35.336607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.336430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf" event={"ID":"e09ab81e-a794-4117-8c18-3881420f4c6c","Type":"ContainerDied","Data":"7365315ef4f474a5ff178cef4144ed32b5692870e80798214768df2dda55bcbd"}
Jul 16 21:57:35.336607 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.336493    2559 scope.go:117] "RemoveContainer" containerID="af711c330f6616bc3bfd22cf1de6c2d71c9b13222c86ef6453f432ccde01e2ff"
Jul 16 21:57:35.369394 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.369368    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:35.373375 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.373352    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-wr2tf"]
Jul 16 21:57:35.678369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:35.678293    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" path="/var/lib/kubelet/pods/e09ab81e-a794-4117-8c18-3881420f4c6c/volumes"
Jul 16 21:57:36.538778 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:36.538748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:36.644745 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:36.644713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:57:36.672707 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:36.672675    2559 scope.go:117] "RemoveContainer" containerID="8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375"
Jul 16 21:57:37.351707 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:37.351671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerStarted","Data":"42f6b71c02f98bbdb730f3b33840f103abad328263b068c46905f6e59a122790"}
Jul 16 21:57:38.358888 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:38.358852    2559 generic.go:356] "Generic (PLEG): container finished" podID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerID="42f6b71c02f98bbdb730f3b33840f103abad328263b068c46905f6e59a122790" exitCode=6
Jul 16 21:57:38.359384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:38.358925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerDied","Data":"42f6b71c02f98bbdb730f3b33840f103abad328263b068c46905f6e59a122790"}
Jul 16 21:57:38.359384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:38.359011    2559 scope.go:117] "RemoveContainer" containerID="8f239b25e115dcaded81f7929c42582331a3133e2dcbac78353594d1d28b2375"
Jul 16 21:57:38.359384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:38.359305    2559 scope.go:117] "RemoveContainer" containerID="42f6b71c02f98bbdb730f3b33840f103abad328263b068c46905f6e59a122790"
Jul 16 21:57:38.359582 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:38.359559    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp_odh-ai-gateway-infra(633779ff-14f3-4b57-8d69-9f5fa94f0b4c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c"
Jul 16 21:57:38.418636 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:38.418606    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:39.508872 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:39.508848    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:39.561477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:39.561442    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca\") pod \"633779ff-14f3-4b57-8d69-9f5fa94f0b4c\" (UID: \"633779ff-14f3-4b57-8d69-9f5fa94f0b4c\") "
Jul 16 21:57:39.561776 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:39.561753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "633779ff-14f3-4b57-8d69-9f5fa94f0b4c" (UID: "633779ff-14f3-4b57-8d69-9f5fa94f0b4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:57:39.662229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:39.662157    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633779ff-14f3-4b57-8d69-9f5fa94f0b4c-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:57:40.372893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:40.372861    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"
Jul 16 21:57:40.373076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:40.372893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp" event={"ID":"633779ff-14f3-4b57-8d69-9f5fa94f0b4c","Type":"ContainerDied","Data":"1bcf1c3848c0b336f735b9e9d533ca691f29fa8a1090efc3243862b9f4e54c1f"}
Jul 16 21:57:40.373076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:40.372963    2559 scope.go:117] "RemoveContainer" containerID="42f6b71c02f98bbdb730f3b33840f103abad328263b068c46905f6e59a122790"
Jul 16 21:57:40.392450 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:40.392428    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:40.396734 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:40.396712    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5rtgp"]
Jul 16 21:57:41.672619 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:41.672586    2559 scope.go:117] "RemoveContainer" containerID="b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5"
Jul 16 21:57:41.678968 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:41.678931    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" path="/var/lib/kubelet/pods/633779ff-14f3-4b57-8d69-9f5fa94f0b4c/volumes"
Jul 16 21:57:42.386442 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:42.386418    2559 generic.go:356] "Generic (PLEG): container finished" podID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerID="895bdf513c987eb72298bfc18d9e7e01a8b7182032186ea07e7f181e3980fce8" exitCode=6
Jul 16 21:57:42.386557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:42.386476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" event={"ID":"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f","Type":"ContainerDied","Data":"895bdf513c987eb72298bfc18d9e7e01a8b7182032186ea07e7f181e3980fce8"}
Jul 16 21:57:42.386557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:42.386523    2559 scope.go:117] "RemoveContainer" containerID="b784b0735b031bb02d147f709c053cbc8ddac736eba03e66293192cd0b1dffe5"
Jul 16 21:57:42.386859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:42.386836    2559 scope.go:117] "RemoveContainer" containerID="895bdf513c987eb72298bfc18d9e7e01a8b7182032186ea07e7f181e3980fce8"
Jul 16 21:57:42.387082 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:57:42.387063    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-njzsr_odh-ai-gateway-infra(a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f"
Jul 16 21:57:43.422937 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:43.422902    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:43.570558 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:43.570534    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:43.590233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:43.590207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca\") pod \"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f\" (UID: \"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f\") "
Jul 16 21:57:43.590547 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:43.590524    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" (UID: "a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:57:43.590642 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:43.590597    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:57:44.401364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:44.401335    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"
Jul 16 21:57:44.401526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:44.401382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr" event={"ID":"a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f","Type":"ContainerDied","Data":"743fd24f198fd12dbcc6ea34110bef6ea7c43d5562b2bb309a58bef54cdc0e04"}
Jul 16 21:57:44.401526 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:44.401466    2559 scope.go:117] "RemoveContainer" containerID="895bdf513c987eb72298bfc18d9e7e01a8b7182032186ea07e7f181e3980fce8"
Jul 16 21:57:44.428597 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:44.428559    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:44.430838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:44.430815    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-njzsr"]
Jul 16 21:57:45.678994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:57:45.678959    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" path="/var/lib/kubelet/pods/a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f/volumes"
Jul 16 21:58:03.768806 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.768769    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769244    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769258    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769266    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769271    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769280    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769285    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769297    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769302    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769310    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769315    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769323    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769328    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769339    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769343    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769353    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769358    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769427    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769434    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769440    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769449    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769455    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:03.769519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.769462    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:03.773808 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.773792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:03.777164 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.777068    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:58:03.780143 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.780119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:03.876567 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.876537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74\" (UID: \"caf58011-be11-489c-ac48-d3c0a41257f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:03.977680 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.977649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74\" (UID: \"caf58011-be11-489c-ac48-d3c0a41257f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:03.978324 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:03.978306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74\" (UID: \"caf58011-be11-489c-ac48-d3c0a41257f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:04.085220 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:04.085125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:04.224114 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:04.224068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:04.226375 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:04.226346    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf58011_be11_489c_ac48_d3c0a41257f7.slice/crio-02dcef255f874ed37a4c5d6205362fd2190decbc17221e18d123e5547a35cb27 WatchSource:0}: Error finding container 02dcef255f874ed37a4c5d6205362fd2190decbc17221e18d123e5547a35cb27: Status 404 returned error can't find the container with id 02dcef255f874ed37a4c5d6205362fd2190decbc17221e18d123e5547a35cb27
Jul 16 21:58:04.511523 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:04.511490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerStarted","Data":"fd6e2e7d84f951c6c861aed3e241c0775aa605ea3d535bf96f099125dacb0a9e"}
Jul 16 21:58:04.511670 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:04.511554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerStarted","Data":"02dcef255f874ed37a4c5d6205362fd2190decbc17221e18d123e5547a35cb27"}
Jul 16 21:58:04.529996 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:04.529945    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" podStartSLOduration=1.529930579 podStartE2EDuration="1.529930579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:04.528491349 +0000 UTC m=+2947.379108726" watchObservedRunningTime="2026-07-16 21:58:04.529930579 +0000 UTC m=+2947.380547956"
Jul 16 21:58:05.517557 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:05.517522    2559 generic.go:356] "Generic (PLEG): container finished" podID="caf58011-be11-489c-ac48-d3c0a41257f7" containerID="fd6e2e7d84f951c6c861aed3e241c0775aa605ea3d535bf96f099125dacb0a9e" exitCode=6
Jul 16 21:58:05.517953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:05.517607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerDied","Data":"fd6e2e7d84f951c6c861aed3e241c0775aa605ea3d535bf96f099125dacb0a9e"}
Jul 16 21:58:05.517953 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:05.517752    2559 scope.go:117] "RemoveContainer" containerID="fd6e2e7d84f951c6c861aed3e241c0775aa605ea3d535bf96f099125dacb0a9e"
Jul 16 21:58:06.106705 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.106631    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:06.107116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.107076    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:06.107116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.107106    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:06.107211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.107177    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="633779ff-14f3-4b57-8d69-9f5fa94f0b4c" containerName="revoke-keys"
Jul 16 21:58:06.107211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.107186    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ad8e0b-d8b2-42d8-82b9-eaf604ec315f" containerName="revoke-keys"
Jul 16 21:58:06.107211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.107194    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09ab81e-a794-4117-8c18-3881420f4c6c" containerName="revoke-keys"
Jul 16 21:58:06.110327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.110312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:06.122397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.122370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:06.196158 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.196117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9\" (UID: \"4062679d-3810-4a81-8da1-ea6761b78c68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:06.297386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.297358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9\" (UID: \"4062679d-3810-4a81-8da1-ea6761b78c68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:06.297919 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.297899    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9\" (UID: \"4062679d-3810-4a81-8da1-ea6761b78c68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:06.420714 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.420631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:06.527367 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.527332    2559 generic.go:356] "Generic (PLEG): container finished" podID="caf58011-be11-489c-ac48-d3c0a41257f7" containerID="a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050" exitCode=6
Jul 16 21:58:06.527785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.527412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerDied","Data":"a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050"}
Jul 16 21:58:06.527785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.527483    2559 scope.go:117] "RemoveContainer" containerID="fd6e2e7d84f951c6c861aed3e241c0775aa605ea3d535bf96f099125dacb0a9e"
Jul 16 21:58:06.527785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.527698    2559 scope.go:117] "RemoveContainer" containerID="a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050"
Jul 16 21:58:06.527964 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:06.527914    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74_odh-ai-gateway-infra(caf58011-be11-489c-ac48-d3c0a41257f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" podUID="caf58011-be11-489c-ac48-d3c0a41257f7"
Jul 16 21:58:06.561287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:06.561263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:06.563453 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:06.563417    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4062679d_3810_4a81_8da1_ea6761b78c68.slice/crio-2c53d1e09b3cf763171db2949386e5ad90b4d69d75f933eddb030c2f271d215c WatchSource:0}: Error finding container 2c53d1e09b3cf763171db2949386e5ad90b4d69d75f933eddb030c2f271d215c: Status 404 returned error can't find the container with id 2c53d1e09b3cf763171db2949386e5ad90b4d69d75f933eddb030c2f271d215c
Jul 16 21:58:07.533811 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:07.533730    2559 generic.go:356] "Generic (PLEG): container finished" podID="4062679d-3810-4a81-8da1-ea6761b78c68" containerID="a27499b2f1c61e33357b9bdad002dcb6091b6fab4b29a8926b9775ccd6527482" exitCode=6
Jul 16 21:58:07.534244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:07.533812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" event={"ID":"4062679d-3810-4a81-8da1-ea6761b78c68","Type":"ContainerDied","Data":"a27499b2f1c61e33357b9bdad002dcb6091b6fab4b29a8926b9775ccd6527482"}
Jul 16 21:58:07.534244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:07.533866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" event={"ID":"4062679d-3810-4a81-8da1-ea6761b78c68","Type":"ContainerStarted","Data":"2c53d1e09b3cf763171db2949386e5ad90b4d69d75f933eddb030c2f271d215c"}
Jul 16 21:58:07.534244 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:07.533986    2559 scope.go:117] "RemoveContainer" containerID="a27499b2f1c61e33357b9bdad002dcb6091b6fab4b29a8926b9775ccd6527482"
Jul 16 21:58:07.535686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:07.535670    2559 scope.go:117] "RemoveContainer" containerID="a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050"
Jul 16 21:58:07.535819 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:07.535803    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74_odh-ai-gateway-infra(caf58011-be11-489c-ac48-d3c0a41257f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" podUID="caf58011-be11-489c-ac48-d3c0a41257f7"
Jul 16 21:58:08.542698 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:08.542663    2559 generic.go:356] "Generic (PLEG): container finished" podID="4062679d-3810-4a81-8da1-ea6761b78c68" containerID="e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9" exitCode=6
Jul 16 21:58:08.543134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:08.542706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" event={"ID":"4062679d-3810-4a81-8da1-ea6761b78c68","Type":"ContainerDied","Data":"e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9"}
Jul 16 21:58:08.543134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:08.542794    2559 scope.go:117] "RemoveContainer" containerID="a27499b2f1c61e33357b9bdad002dcb6091b6fab4b29a8926b9775ccd6527482"
Jul 16 21:58:08.543134 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:08.542956    2559 scope.go:117] "RemoveContainer" containerID="e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9"
Jul 16 21:58:08.543264 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:08.543200    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9_odh-ai-gateway-infra(4062679d-3810-4a81-8da1-ea6761b78c68)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" podUID="4062679d-3810-4a81-8da1-ea6761b78c68"
Jul 16 21:58:09.550184 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:09.550159    2559 scope.go:117] "RemoveContainer" containerID="e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9"
Jul 16 21:58:09.550652 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:09.550330    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9_odh-ai-gateway-infra(4062679d-3810-4a81-8da1-ea6761b78c68)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" podUID="4062679d-3810-4a81-8da1-ea6761b78c68"
Jul 16 21:58:12.238751 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:12.238720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:15.550299 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.550262    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:15.555285 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.555267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:15.567009 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.566983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:15.681978 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.681948    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-47jpx\" (UID: \"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:15.782857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.782827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-47jpx\" (UID: \"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:15.783477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.783459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-47jpx\" (UID: \"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:15.865994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:15.865925    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:16.054686 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:16.054656    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:16.057172 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:16.057135    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88dfb6c8_f211_4ba1_b2f5_3d52a06420c9.slice/crio-8828312842d051db5a83a451a0ecfc0ddc04761c15e126b64afe2f200963cd52 WatchSource:0}: Error finding container 8828312842d051db5a83a451a0ecfc0ddc04761c15e126b64afe2f200963cd52: Status 404 returned error can't find the container with id 8828312842d051db5a83a451a0ecfc0ddc04761c15e126b64afe2f200963cd52
Jul 16 21:58:16.589214 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:16.589136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerStarted","Data":"4b095fc474d59e32df630a1df478315f99012f3062bb2dab79a775320563cfcc"}
Jul 16 21:58:16.589214 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:16.589193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerStarted","Data":"8828312842d051db5a83a451a0ecfc0ddc04761c15e126b64afe2f200963cd52"}
Jul 16 21:58:16.611692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:16.611641    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" podStartSLOduration=1.6116259849999999 podStartE2EDuration="1.611625985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:16.609672778 +0000 UTC m=+2959.460290154" watchObservedRunningTime="2026-07-16 21:58:16.611625985 +0000 UTC m=+2959.462243362"
Jul 16 21:58:17.338241 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.338204    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:17.341871 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.341852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:17.360191 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.360166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:17.497048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.497017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl\" (UID: \"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:17.595723 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.595646    2559 generic.go:356] "Generic (PLEG): container finished" podID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerID="4b095fc474d59e32df630a1df478315f99012f3062bb2dab79a775320563cfcc" exitCode=6
Jul 16 21:58:17.596061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.595716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerDied","Data":"4b095fc474d59e32df630a1df478315f99012f3062bb2dab79a775320563cfcc"}
Jul 16 21:58:17.596061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.595857    2559 scope.go:117] "RemoveContainer" containerID="4b095fc474d59e32df630a1df478315f99012f3062bb2dab79a775320563cfcc"
Jul 16 21:58:17.598069 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.598049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl\" (UID: \"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:17.598634 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.598616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl\" (UID: \"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:17.652880 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.652852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:17.793508 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:17.793425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:17.849414 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:17.849346    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d575ebe_f88d_4e62_9fd3_fd5fd098c2c1.slice/crio-24f6b541edca7dad4ff9931bfb04d10b56eac51b7603ed6cbafb023bdcb16e73 WatchSource:0}: Error finding container 24f6b541edca7dad4ff9931bfb04d10b56eac51b7603ed6cbafb023bdcb16e73: Status 404 returned error can't find the container with id 24f6b541edca7dad4ff9931bfb04d10b56eac51b7603ed6cbafb023bdcb16e73
Jul 16 21:58:18.602715 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.602681    2559 generic.go:356] "Generic (PLEG): container finished" podID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerID="fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce" exitCode=6
Jul 16 21:58:18.603212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.602767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerDied","Data":"fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce"}
Jul 16 21:58:18.603212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.602888    2559 scope.go:117] "RemoveContainer" containerID="4b095fc474d59e32df630a1df478315f99012f3062bb2dab79a775320563cfcc"
Jul 16 21:58:18.603212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.602954    2559 scope.go:117] "RemoveContainer" containerID="fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce"
Jul 16 21:58:18.603370 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:18.603210    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-47jpx_odh-ai-gateway-infra(88dfb6c8-f211-4ba1-b2f5-3d52a06420c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9"
Jul 16 21:58:18.604490 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.604469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerStarted","Data":"d53c198097c920b82a99db2e7d542a4ae8b578a367642b628889917eafd3adc6"}
Jul 16 21:58:18.604561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.604512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerStarted","Data":"24f6b541edca7dad4ff9931bfb04d10b56eac51b7603ed6cbafb023bdcb16e73"}
Jul 16 21:58:18.637584 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:18.637500    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" podStartSLOduration=1.637481183 podStartE2EDuration="1.637481183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:18.637445313 +0000 UTC m=+2961.488062691" watchObservedRunningTime="2026-07-16 21:58:18.637481183 +0000 UTC m=+2961.488098561"
Jul 16 21:58:19.612457 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:19.612425    2559 scope.go:117] "RemoveContainer" containerID="fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce"
Jul 16 21:58:19.612937 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:19.612655    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-47jpx_odh-ai-gateway-infra(88dfb6c8-f211-4ba1-b2f5-3d52a06420c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9"
Jul 16 21:58:19.613729 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:19.613706    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerID="d53c198097c920b82a99db2e7d542a4ae8b578a367642b628889917eafd3adc6" exitCode=6
Jul 16 21:58:19.613794 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:19.613738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerDied","Data":"d53c198097c920b82a99db2e7d542a4ae8b578a367642b628889917eafd3adc6"}
Jul 16 21:58:19.613909 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:19.613897    2559 scope.go:117] "RemoveContainer" containerID="d53c198097c920b82a99db2e7d542a4ae8b578a367642b628889917eafd3adc6"
Jul 16 21:58:20.621025 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:20.620987    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerID="e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a" exitCode=6
Jul 16 21:58:20.621515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:20.621080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerDied","Data":"e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a"}
Jul 16 21:58:20.621515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:20.621163    2559 scope.go:117] "RemoveContainer" containerID="d53c198097c920b82a99db2e7d542a4ae8b578a367642b628889917eafd3adc6"
Jul 16 21:58:20.621515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:20.621340    2559 scope.go:117] "RemoveContainer" containerID="e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a"
Jul 16 21:58:20.621641 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:20.621542    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl_odh-ai-gateway-infra(8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1"
Jul 16 21:58:20.672948 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:20.672921    2559 scope.go:117] "RemoveContainer" containerID="e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9"
Jul 16 21:58:21.628782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:21.628697    2559 generic.go:356] "Generic (PLEG): container finished" podID="4062679d-3810-4a81-8da1-ea6761b78c68" containerID="2605ca18c7eec85fdffbc684a8d30dbdd64c5a463383e656fd60f38b5937f33f" exitCode=6
Jul 16 21:58:21.628782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:21.628773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" event={"ID":"4062679d-3810-4a81-8da1-ea6761b78c68","Type":"ContainerDied","Data":"2605ca18c7eec85fdffbc684a8d30dbdd64c5a463383e656fd60f38b5937f33f"}
Jul 16 21:58:21.629331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:21.628830    2559 scope.go:117] "RemoveContainer" containerID="e703dfb4ed2566050bbbaff96066f9305ece697a96ba8707ce193665750ce8a9"
Jul 16 21:58:21.629331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:21.629179    2559 scope.go:117] "RemoveContainer" containerID="2605ca18c7eec85fdffbc684a8d30dbdd64c5a463383e656fd60f38b5937f33f"
Jul 16 21:58:21.629446 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:21.629422    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9_odh-ai-gateway-infra(4062679d-3810-4a81-8da1-ea6761b78c68)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" podUID="4062679d-3810-4a81-8da1-ea6761b78c68"
Jul 16 21:58:21.630743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:21.630725    2559 scope.go:117] "RemoveContainer" containerID="e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a"
Jul 16 21:58:21.630939 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:21.630912    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl_odh-ai-gateway-infra(8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1"
Jul 16 21:58:22.664424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:22.664387    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:22.673055 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:22.673033    2559 scope.go:117] "RemoveContainer" containerID="a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050"
Jul 16 21:58:22.810068 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:22.810044    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:22.941493 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:22.941435    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca\") pod \"4062679d-3810-4a81-8da1-ea6761b78c68\" (UID: \"4062679d-3810-4a81-8da1-ea6761b78c68\") "
Jul 16 21:58:22.941756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:22.941735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4062679d-3810-4a81-8da1-ea6761b78c68" (UID: "4062679d-3810-4a81-8da1-ea6761b78c68"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:23.042936 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.042912    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4062679d-3810-4a81-8da1-ea6761b78c68-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:23.182277 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.182241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:23.645625 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.645544    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"
Jul 16 21:58:23.645625 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.645577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9" event={"ID":"4062679d-3810-4a81-8da1-ea6761b78c68","Type":"ContainerDied","Data":"2c53d1e09b3cf763171db2949386e5ad90b4d69d75f933eddb030c2f271d215c"}
Jul 16 21:58:23.645853 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.645680    2559 scope.go:117] "RemoveContainer" containerID="2605ca18c7eec85fdffbc684a8d30dbdd64c5a463383e656fd60f38b5937f33f"
Jul 16 21:58:23.647717 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.647690    2559 generic.go:356] "Generic (PLEG): container finished" podID="caf58011-be11-489c-ac48-d3c0a41257f7" containerID="6271bcf51c4823014dd9b05d169d71c98fbb60ca4f27b0b3d63e931c34c34464" exitCode=6
Jul 16 21:58:23.647835 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.647738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerDied","Data":"6271bcf51c4823014dd9b05d169d71c98fbb60ca4f27b0b3d63e931c34c34464"}
Jul 16 21:58:23.648068 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.648053    2559 scope.go:117] "RemoveContainer" containerID="6271bcf51c4823014dd9b05d169d71c98fbb60ca4f27b0b3d63e931c34c34464"
Jul 16 21:58:23.648357 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:23.648334    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74_odh-ai-gateway-infra(caf58011-be11-489c-ac48-d3c0a41257f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" podUID="caf58011-be11-489c-ac48-d3c0a41257f7"
Jul 16 21:58:23.659524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.659506    2559 scope.go:117] "RemoveContainer" containerID="a3b754be60941eb1c9a3087039ff2e0f66f44639e397972bd401a961d57f9050"
Jul 16 21:58:23.686976 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.686953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:23.688962 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:23.688941    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-q9hb9"]
Jul 16 21:58:24.273859 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.273824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:24.365719 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.365681    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"]
Jul 16 21:58:24.366353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366333    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366357    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366412 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366404    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366413    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366426    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366477 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366435    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366572 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366528    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366572 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366542    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.366572 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.366555    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" containerName="revoke-keys"
Jul 16 21:58:24.371311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.371287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:24.377756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.377733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"]
Jul 16 21:58:24.456443 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.456404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k\" (UID: \"215a5674-00d9-431a-9622-2f62ee0b5299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:24.557756 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.557674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k\" (UID: \"215a5674-00d9-431a-9622-2f62ee0b5299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:24.558353 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.558332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k\" (UID: \"215a5674-00d9-431a-9622-2f62ee0b5299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:24.683868 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.683840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:24.686222 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.686201    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:24.858560 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.858540    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:24.960216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.960188    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca\") pod \"caf58011-be11-489c-ac48-d3c0a41257f7\" (UID: \"caf58011-be11-489c-ac48-d3c0a41257f7\") "
Jul 16 21:58:24.960551 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:24.960530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "caf58011-be11-489c-ac48-d3c0a41257f7" (UID: "caf58011-be11-489c-ac48-d3c0a41257f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:25.061121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.061078    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf58011-be11-489c-ac48-d3c0a41257f7-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:25.062331 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.062310    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"]
Jul 16 21:58:25.064649 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:25.064625    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215a5674_00d9_431a_9622_2f62ee0b5299.slice/crio-035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1 WatchSource:0}: Error finding container 035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1: Status 404 returned error can't find the container with id 035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1
Jul 16 21:58:25.168543 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.168512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:25.273249 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.273215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:25.666381 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.666286    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"
Jul 16 21:58:25.666381 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.666290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74" event={"ID":"caf58011-be11-489c-ac48-d3c0a41257f7","Type":"ContainerDied","Data":"02dcef255f874ed37a4c5d6205362fd2190decbc17221e18d123e5547a35cb27"}
Jul 16 21:58:25.666610 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.666433    2559 scope.go:117] "RemoveContainer" containerID="6271bcf51c4823014dd9b05d169d71c98fbb60ca4f27b0b3d63e931c34c34464"
Jul 16 21:58:25.668065 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.668037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k" event={"ID":"215a5674-00d9-431a-9622-2f62ee0b5299","Type":"ContainerStarted","Data":"afca8eca205845ce268b8333d4beb4de1173fb51776e8d446aecdb3f2d4fa3eb"}
Jul 16 21:58:25.668216 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.668108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k" event={"ID":"215a5674-00d9-431a-9622-2f62ee0b5299","Type":"ContainerStarted","Data":"035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1"}
Jul 16 21:58:25.679634 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.679614    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4062679d-3810-4a81-8da1-ea6761b78c68" path="/var/lib/kubelet/pods/4062679d-3810-4a81-8da1-ea6761b78c68/volumes"
Jul 16 21:58:25.690590 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.690553    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k" podStartSLOduration=1.690539883 podStartE2EDuration="1.690539883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:25.69007959 +0000 UTC m=+2968.540696967" watchObservedRunningTime="2026-07-16 21:58:25.690539883 +0000 UTC m=+2968.541157260"
Jul 16 21:58:25.710870 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.710847    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:25.715647 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:25.715626    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-sgz74"]
Jul 16 21:58:26.674163 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:26.674128    2559 generic.go:356] "Generic (PLEG): container finished" podID="215a5674-00d9-431a-9622-2f62ee0b5299" containerID="afca8eca205845ce268b8333d4beb4de1173fb51776e8d446aecdb3f2d4fa3eb" exitCode=0
Jul 16 21:58:26.674588 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:26.674218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k" event={"ID":"215a5674-00d9-431a-9622-2f62ee0b5299","Type":"ContainerDied","Data":"afca8eca205845ce268b8333d4beb4de1173fb51776e8d446aecdb3f2d4fa3eb"}
Jul 16 21:58:27.681779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:27.681749    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" path="/var/lib/kubelet/pods/caf58011-be11-489c-ac48-d3c0a41257f7/volumes"
Jul 16 21:58:27.825955 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:27.825931    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:27.986267 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:27.986233    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca\") pod \"215a5674-00d9-431a-9622-2f62ee0b5299\" (UID: \"215a5674-00d9-431a-9622-2f62ee0b5299\") "
Jul 16 21:58:27.986556 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:27.986535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "215a5674-00d9-431a-9622-2f62ee0b5299" (UID: "215a5674-00d9-431a-9622-2f62ee0b5299"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:28.087245 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:28.087210    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/215a5674-00d9-431a-9622-2f62ee0b5299-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:28.687256 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:28.687230    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k"
Jul 16 21:58:28.687637 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:28.687273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k" event={"ID":"215a5674-00d9-431a-9622-2f62ee0b5299","Type":"ContainerDied","Data":"035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1"}
Jul 16 21:58:28.687637 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:28.687320    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="035041a434ea652346e6e20c7ff01d40d218ac539e4eba600710e91b340dcce1"
Jul 16 21:58:33.673108 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:33.673060    2559 scope.go:117] "RemoveContainer" containerID="fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce"
Jul 16 21:58:33.673506 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:33.673440    2559 scope.go:117] "RemoveContainer" containerID="e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a"
Jul 16 21:58:34.718309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.718281    2559 generic.go:356] "Generic (PLEG): container finished" podID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerID="0d81a1750c5e92868960ec3f36a1b1bce58161572e5931b34595de3f8df60a83" exitCode=6
Jul 16 21:58:34.718713 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.718357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerDied","Data":"0d81a1750c5e92868960ec3f36a1b1bce58161572e5931b34595de3f8df60a83"}
Jul 16 21:58:34.718713 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.718421    2559 scope.go:117] "RemoveContainer" containerID="fb2179f67caff2f37fbc25168ef353d6ae1433405d77f368a552b9ec8303c3ce"
Jul 16 21:58:34.718821 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.718761    2559 scope.go:117] "RemoveContainer" containerID="0d81a1750c5e92868960ec3f36a1b1bce58161572e5931b34595de3f8df60a83"
Jul 16 21:58:34.718980 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:34.718957    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-47jpx_odh-ai-gateway-infra(88dfb6c8-f211-4ba1-b2f5-3d52a06420c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9"
Jul 16 21:58:34.720287 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.720266    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerID="5ecb63bc1351ce38317fffe5e4ff743c4ca20a4223f078121eee2591f23e47ca" exitCode=6
Jul 16 21:58:34.720397 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.720349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerDied","Data":"5ecb63bc1351ce38317fffe5e4ff743c4ca20a4223f078121eee2591f23e47ca"}
Jul 16 21:58:34.720630 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.720613    2559 scope.go:117] "RemoveContainer" containerID="5ecb63bc1351ce38317fffe5e4ff743c4ca20a4223f078121eee2591f23e47ca"
Jul 16 21:58:34.720800 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:34.720781    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl_odh-ai-gateway-infra(8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1"
Jul 16 21:58:34.730562 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.730545    2559 scope.go:117] "RemoveContainer" containerID="e72bf11b64539b497907209890ecd253e4bc2f01e82b2af0d1eee9be3f04dd9a"
Jul 16 21:58:34.904141 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:34.904111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:35.751796 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.751764    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:35.766571 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.766540    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:35.907867 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.907842    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:35.938261 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.938237    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:35.956063 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.956025    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca\") pod \"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9\" (UID: \"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9\") "
Jul 16 21:58:35.956196 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.956119    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca\") pod \"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1\" (UID: \"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1\") "
Jul 16 21:58:35.956515 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.956490    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" (UID: "8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:35.956627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:35.956515    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" (UID: "88dfb6c8-f211-4ba1-b2f5-3d52a06420c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:36.056857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.056760    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:36.056857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.056787    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:36.735151 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.735120    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"
Jul 16 21:58:36.735151 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.735146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx" event={"ID":"88dfb6c8-f211-4ba1-b2f5-3d52a06420c9","Type":"ContainerDied","Data":"8828312842d051db5a83a451a0ecfc0ddc04761c15e126b64afe2f200963cd52"}
Jul 16 21:58:36.735405 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.735203    2559 scope.go:117] "RemoveContainer" containerID="0d81a1750c5e92868960ec3f36a1b1bce58161572e5931b34595de3f8df60a83"
Jul 16 21:58:36.736540 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.736516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl" event={"ID":"8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1","Type":"ContainerDied","Data":"24f6b541edca7dad4ff9931bfb04d10b56eac51b7603ed6cbafb023bdcb16e73"}
Jul 16 21:58:36.736667 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.736523    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"
Jul 16 21:58:36.745345 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.745330    2559 scope.go:117] "RemoveContainer" containerID="5ecb63bc1351ce38317fffe5e4ff743c4ca20a4223f078121eee2591f23e47ca"
Jul 16 21:58:36.759652 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.759626    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:36.767297 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.767274    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-47jpx"]
Jul 16 21:58:36.780831 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.780808    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:36.796435 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:36.796411    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2x2vl"]
Jul 16 21:58:37.678815 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:37.678772    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" path="/var/lib/kubelet/pods/88dfb6c8-f211-4ba1-b2f5-3d52a06420c9/volumes"
Jul 16 21:58:37.679229 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:37.679207    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" path="/var/lib/kubelet/pods/8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1/volumes"
Jul 16 21:58:39.466689 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:39.466658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:46.717516 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:46.717484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:46.935627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:46.935595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:50.305399 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:50.305369    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:58:50.305802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:50.305566    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy" containerID="cri-o://e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2" gracePeriod=30
Jul 16 21:58:50.362113 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:50.362056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:50.587541 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:50.587452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:51.453848 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:51.453798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:51.615155 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:51.615121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:58:55.566906 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.566882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:58:55.636214 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636149    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636211    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw2km\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636265    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636341 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636319    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636391    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636436    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636458    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:55.636573 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636469    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data\") pod \"54008504-a8e7-4e65-b88e-10b22e79b2fc\" (UID: \"54008504-a8e7-4e65-b88e-10b22e79b2fc\") "
Jul 16 21:58:55.636873 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636836    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:55.636936 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636897    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.636994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.636925    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:58:55.637265 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.637228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:55.637265 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.637240    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:55.638737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.638707    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 21:58:55.638875 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.638857    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:58:55.638993 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.638971    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km" (OuterVolumeSpecName: "kube-api-access-nw2km") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "kube-api-access-nw2km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:58:55.639120 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.638997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54008504-a8e7-4e65-b88e-10b22e79b2fc" (UID: "54008504-a8e7-4e65-b88e-10b22e79b2fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:58:55.737752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737726    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737752 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737748    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737759    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737767    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737775    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw2km\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-kube-api-access-nw2km\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737784    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737793    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54008504-a8e7-4e65-b88e-10b22e79b2fc-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.737893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.737800    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54008504-a8e7-4e65-b88e-10b22e79b2fc-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:58:55.839015 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.838984    2559 generic.go:356] "Generic (PLEG): container finished" podID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerID="e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2" exitCode=0
Jul 16 21:58:55.839199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.839035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"
Jul 16 21:58:55.839199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.839054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerDied","Data":"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"}
Jul 16 21:58:55.839199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.839123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz" event={"ID":"54008504-a8e7-4e65-b88e-10b22e79b2fc","Type":"ContainerDied","Data":"6cb47bd7498b059a47fe5394b4676ad3c17c4c773b224dc9dadb3e3fffae8d4e"}
Jul 16 21:58:55.839199 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.839156    2559 scope.go:117] "RemoveContainer" containerID="e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"
Jul 16 21:58:55.850400 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.850376    2559 scope.go:117] "RemoveContainer" containerID="12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"
Jul 16 21:58:55.860627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.860604    2559 scope.go:117] "RemoveContainer" containerID="e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"
Jul 16 21:58:55.860895 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:55.860872    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2\": container with ID starting with e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2 not found: ID does not exist" containerID="e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"
Jul 16 21:58:55.860964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.860908    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2"} err="failed to get container status \"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2\": rpc error: code = NotFound desc = could not find container \"e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2\": container with ID starting with e39f1465d199a62552fc7c4879a9cf46b6b421ae7969922c672f651f539f05b2 not found: ID does not exist"
Jul 16 21:58:55.860964 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.860932    2559 scope.go:117] "RemoveContainer" containerID="12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"
Jul 16 21:58:55.861255 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:55.861237    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3\": container with ID starting with 12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3 not found: ID does not exist" containerID="12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"
Jul 16 21:58:55.861302 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.861261    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3"} err="failed to get container status \"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3\": rpc error: code = NotFound desc = could not find container \"12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3\": container with ID starting with 12c50677cdd4b29acd6996e3a0730a9dfa24e9b594a46a44ffb6d6e647b9c8b3 not found: ID does not exist"
Jul 16 21:58:55.868187 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.868164    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:58:55.872658 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:55.872638    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f53605-openshift-default-66bf789547-b7bmz"]
Jul 16 21:58:56.190857 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.190822    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:58:56.191251 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191237    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191253    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191261    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191266    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191275    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191280    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191290    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191295    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191303    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191310    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191324    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191327 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191329    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191341    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191345    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191353    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215a5674-00d9-431a-9622-2f62ee0b5299" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191358    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="215a5674-00d9-431a-9622-2f62ee0b5299" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191411    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191420    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="215a5674-00d9-431a-9622-2f62ee0b5299" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191427    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191434    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191439    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191444    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191449    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191454    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191460    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191464    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:58:56.191693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.191470    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:58:56.196209 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.196192    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:58:56.201140 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.201124    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:58:56.215111 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.215067    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:58:56.342414 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.342376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g\" (UID: \"0958e87d-6c05-4ba8-b76b-c93c11d9f995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:58:56.443170 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.443059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g\" (UID: \"0958e87d-6c05-4ba8-b76b-c93c11d9f995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:58:56.443678 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.443657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g\" (UID: \"0958e87d-6c05-4ba8-b76b-c93c11d9f995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:58:56.505615 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.505587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:58:56.648871 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.648845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:58:56.651634 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:58:56.651604    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0958e87d_6c05_4ba8_b76b_c93c11d9f995.slice/crio-1dfa9e40588ca20235df33755f882946f7098a0296a917900bcb67a8c143877f WatchSource:0}: Error finding container 1dfa9e40588ca20235df33755f882946f7098a0296a917900bcb67a8c143877f: Status 404 returned error can't find the container with id 1dfa9e40588ca20235df33755f882946f7098a0296a917900bcb67a8c143877f
Jul 16 21:58:56.845990 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:56.845956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" event={"ID":"0958e87d-6c05-4ba8-b76b-c93c11d9f995","Type":"ContainerStarted","Data":"1dfa9e40588ca20235df33755f882946f7098a0296a917900bcb67a8c143877f"}
Jul 16 21:58:57.679617 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.679545    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" path="/var/lib/kubelet/pods/54008504-a8e7-4e65-b88e-10b22e79b2fc/volumes"
Jul 16 21:58:57.854476 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.854436    2559 generic.go:356] "Generic (PLEG): container finished" podID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerID="d9fdab795d1245eeaeccaf456788834ff6f4660a245b7390a716d11469d00c67" exitCode=6
Jul 16 21:58:57.854644 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.854474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" event={"ID":"0958e87d-6c05-4ba8-b76b-c93c11d9f995","Type":"ContainerDied","Data":"d9fdab795d1245eeaeccaf456788834ff6f4660a245b7390a716d11469d00c67"}
Jul 16 21:58:57.854754 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.854731    2559 scope.go:117] "RemoveContainer" containerID="d9fdab795d1245eeaeccaf456788834ff6f4660a245b7390a716d11469d00c67"
Jul 16 21:58:57.862795 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.862779    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:58:57.885303 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:57.885287    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 21:58:58.861774 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:58.861741    2559 generic.go:356] "Generic (PLEG): container finished" podID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerID="49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0" exitCode=6
Jul 16 21:58:58.862227 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:58.861798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" event={"ID":"0958e87d-6c05-4ba8-b76b-c93c11d9f995","Type":"ContainerDied","Data":"49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0"}
Jul 16 21:58:58.862227 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:58.861846    2559 scope.go:117] "RemoveContainer" containerID="d9fdab795d1245eeaeccaf456788834ff6f4660a245b7390a716d11469d00c67"
Jul 16 21:58:58.862227 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:58.862009    2559 scope.go:117] "RemoveContainer" containerID="49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0"
Jul 16 21:58:58.862356 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:58.862248    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g_odh-ai-gateway-infra(0958e87d-6c05-4ba8-b76b-c93c11d9f995)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995"
Jul 16 21:58:59.868472 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:58:59.868443    2559 scope.go:117] "RemoveContainer" containerID="49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0"
Jul 16 21:58:59.868830 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:58:59.868633    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g_odh-ai-gateway-infra(0958e87d-6c05-4ba8-b76b-c93c11d9f995)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995"
Jul 16 21:59:01.187678 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:01.187638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:03.817142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817108    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:03.817522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:59:03.817522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817493    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:59:03.817522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817505    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:59:03.817522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817511    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88dfb6c8-f211-4ba1-b2f5-3d52a06420c9" containerName="revoke-keys"
Jul 16 21:59:03.817522 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817522    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:59:03.817724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817528    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d575ebe-f88d-4e62-9fd3-fd5fd098c2c1" containerName="revoke-keys"
Jul 16 21:59:03.817724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817535    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:59:03.817724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817540    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54008504-a8e7-4e65-b88e-10b22e79b2fc" containerName="istio-proxy"
Jul 16 21:59:03.817724 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.817602    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf58011-be11-489c-ac48-d3c0a41257f7" containerName="revoke-keys"
Jul 16 21:59:03.821902 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.821883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:03.828459 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.828434    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:03.908843 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:03.908806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9\" (UID: \"30c95c61-b79e-4b72-9b68-ec9102caa875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:04.009617 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.009582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9\" (UID: \"30c95c61-b79e-4b72-9b68-ec9102caa875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:04.010231 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.010213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9\" (UID: \"30c95c61-b79e-4b72-9b68-ec9102caa875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:04.134267 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.134183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:04.288741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.288718    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:04.290656 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:04.290622    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c95c61_b79e_4b72_9b68_ec9102caa875.slice/crio-2b22af66eea231e9b06b98830ef47f00a3479a104686a473992de794f9b7c6be WatchSource:0}: Error finding container 2b22af66eea231e9b06b98830ef47f00a3479a104686a473992de794f9b7c6be: Status 404 returned error can't find the container with id 2b22af66eea231e9b06b98830ef47f00a3479a104686a473992de794f9b7c6be
Jul 16 21:59:04.807737 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.807705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:04.896884 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.896847    2559 generic.go:356] "Generic (PLEG): container finished" podID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerID="cf1f01daa1c91d9ee4700e76e2d08b680dce026c3434becfe79e06d30a10c3bf" exitCode=6
Jul 16 21:59:04.897200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.896903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerDied","Data":"cf1f01daa1c91d9ee4700e76e2d08b680dce026c3434becfe79e06d30a10c3bf"}
Jul 16 21:59:04.897200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.896959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerStarted","Data":"2b22af66eea231e9b06b98830ef47f00a3479a104686a473992de794f9b7c6be"}
Jul 16 21:59:04.897200 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:04.897167    2559 scope.go:117] "RemoveContainer" containerID="cf1f01daa1c91d9ee4700e76e2d08b680dce026c3434becfe79e06d30a10c3bf"
Jul 16 21:59:05.777554 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:05.777522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:05.904233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:05.904144    2559 generic.go:356] "Generic (PLEG): container finished" podID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerID="b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93" exitCode=6
Jul 16 21:59:05.904233 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:05.904216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerDied","Data":"b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93"}
Jul 16 21:59:05.904704 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:05.904273    2559 scope.go:117] "RemoveContainer" containerID="cf1f01daa1c91d9ee4700e76e2d08b680dce026c3434becfe79e06d30a10c3bf"
Jul 16 21:59:05.904704 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:05.904422    2559 scope.go:117] "RemoveContainer" containerID="b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93"
Jul 16 21:59:05.904704 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:05.904667    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9_odh-ai-gateway-infra(30c95c61-b79e-4b72-9b68-ec9102caa875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875"
Jul 16 21:59:06.911274 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:06.911252    2559 scope.go:117] "RemoveContainer" containerID="b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93"
Jul 16 21:59:06.911620 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:06.911416    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9_odh-ai-gateway-infra(30c95c61-b79e-4b72-9b68-ec9102caa875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875"
Jul 16 21:59:12.051838 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:12.051796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:12.152809 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:12.152771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:12.673386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:12.673355    2559 scope.go:117] "RemoveContainer" containerID="49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0"
Jul 16 21:59:13.948364 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:13.948328    2559 generic.go:356] "Generic (PLEG): container finished" podID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerID="19fc9bf3ec2c542b0e13b927e8bc2a6ea10c1d1c7e2b5a4b6130024989a33882" exitCode=6
Jul 16 21:59:13.948788 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:13.948413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" event={"ID":"0958e87d-6c05-4ba8-b76b-c93c11d9f995","Type":"ContainerDied","Data":"19fc9bf3ec2c542b0e13b927e8bc2a6ea10c1d1c7e2b5a4b6130024989a33882"}
Jul 16 21:59:13.948788 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:13.948481    2559 scope.go:117] "RemoveContainer" containerID="49cae8d74e10610f6287030cd18b5d899b9c6d5bc1355227a5b45bf9f25a77b0"
Jul 16 21:59:13.948887 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:13.948790    2559 scope.go:117] "RemoveContainer" containerID="19fc9bf3ec2c542b0e13b927e8bc2a6ea10c1d1c7e2b5a4b6130024989a33882"
Jul 16 21:59:13.949057 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:13.949038    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g_odh-ai-gateway-infra(0958e87d-6c05-4ba8-b76b-c93c11d9f995)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995"
Jul 16 21:59:13.971054 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:13.971032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:14.042154 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:14.042132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:14.977205 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:14.977175    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:59:15.119762 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.119741    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:59:15.210370 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.210341    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca\") pod \"0958e87d-6c05-4ba8-b76b-c93c11d9f995\" (UID: \"0958e87d-6c05-4ba8-b76b-c93c11d9f995\") "
Jul 16 21:59:15.210683 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.210663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0958e87d-6c05-4ba8-b76b-c93c11d9f995" (UID: "0958e87d-6c05-4ba8-b76b-c93c11d9f995"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:59:15.311866 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.311802    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0958e87d-6c05-4ba8-b76b-c93c11d9f995-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:59:15.645558 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645480    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:15.645918 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645903    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.645965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645921    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.645965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645930    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.645965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645936    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.645965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645945    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.645965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.645950    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.646141 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.646020    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.646141 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.646029    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:15.649217 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.649201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:15.658693 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.658669    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:15.816457 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.816424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc\" (UID: \"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:15.917551 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.917453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc\" (UID: \"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:15.918076 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.918056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc\" (UID: \"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:15.960085 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.960059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:15.962802 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.962774    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"
Jul 16 21:59:15.962939 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.962818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g" event={"ID":"0958e87d-6c05-4ba8-b76b-c93c11d9f995","Type":"ContainerDied","Data":"1dfa9e40588ca20235df33755f882946f7098a0296a917900bcb67a8c143877f"}
Jul 16 21:59:15.962939 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.962890    2559 scope.go:117] "RemoveContainer" containerID="19fc9bf3ec2c542b0e13b927e8bc2a6ea10c1d1c7e2b5a4b6130024989a33882"
Jul 16 21:59:15.986081 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.986045    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:59:15.992453 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:15.992425    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-ztd8g"]
Jul 16 21:59:16.311810 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.311782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:16.313789 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:16.313755    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9748a2f2_d9cc_48b3_8d68_57f9ee7c94e1.slice/crio-76420f3f25b1c1bb65c70b1965d0c1ddd96067a79292c7b7f9d4ac336ac65adc WatchSource:0}: Error finding container 76420f3f25b1c1bb65c70b1965d0c1ddd96067a79292c7b7f9d4ac336ac65adc: Status 404 returned error can't find the container with id 76420f3f25b1c1bb65c70b1965d0c1ddd96067a79292c7b7f9d4ac336ac65adc
Jul 16 21:59:16.501906 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.501875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:16.744749 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.744714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:16.970081 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.970048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerStarted","Data":"e04732ebb256adb96bcfa4e0523098f672b642cd0fbf48f9d26aa3f1a77bb426"}
Jul 16 21:59:16.970255 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.970128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerStarted","Data":"76420f3f25b1c1bb65c70b1965d0c1ddd96067a79292c7b7f9d4ac336ac65adc"}
Jul 16 21:59:16.989855 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:16.989809    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" podStartSLOduration=1.989791911 podStartE2EDuration="1.989791911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:16.98665769 +0000 UTC m=+3019.837275066" watchObservedRunningTime="2026-07-16 21:59:16.989791911 +0000 UTC m=+3019.840409290"
Jul 16 21:59:17.292965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.292941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:17.680370 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.680276    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" path="/var/lib/kubelet/pods/0958e87d-6c05-4ba8-b76b-c93c11d9f995/volumes"
Jul 16 21:59:17.714369 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.714341    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 21:59:17.714823 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.714810    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0958e87d-6c05-4ba8-b76b-c93c11d9f995" containerName="revoke-keys"
Jul 16 21:59:17.718461 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.718442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.722834 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.722816    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f90d76-openshift-default-dockercfg-lbm9m\""
Jul 16 21:59:17.745965 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.745940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 21:59:17.804590 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.804555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:17.834912 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.834879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.834925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.834945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.834998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835061 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.835024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.835154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.835181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcbb\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835269 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.835215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.835376 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.835330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936177 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936177 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936384 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcbb\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.936818 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.936702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.937116 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.937066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.938763 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.938742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.938997 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.938981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.946432 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.946403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.946624 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.946602    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcbb\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb\") pod \"e2e-api-a-f90d76-openshift-default-89bdf9955-clv75\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") " pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:17.977393 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.977366    2559 generic.go:356] "Generic (PLEG): container finished" podID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerID="e04732ebb256adb96bcfa4e0523098f672b642cd0fbf48f9d26aa3f1a77bb426" exitCode=6
Jul 16 21:59:17.977535 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.977420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerDied","Data":"e04732ebb256adb96bcfa4e0523098f672b642cd0fbf48f9d26aa3f1a77bb426"}
Jul 16 21:59:17.977675 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:17.977659    2559 scope.go:117] "RemoveContainer" containerID="e04732ebb256adb96bcfa4e0523098f672b642cd0fbf48f9d26aa3f1a77bb426"
Jul 16 21:59:18.029043 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.029009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:18.174264 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.174241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 21:59:18.176116 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:18.176066    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5d9bf5_3a6b_4cb7_bc55_5a9cb3d39506.slice/crio-c2f3574f43e0ce5f30f577dac2d9b1119166f0094c164f2c28b34aea0a85e549 WatchSource:0}: Error finding container c2f3574f43e0ce5f30f577dac2d9b1119166f0094c164f2c28b34aea0a85e549: Status 404 returned error can't find the container with id c2f3574f43e0ce5f30f577dac2d9b1119166f0094c164f2c28b34aea0a85e549
Jul 16 21:59:18.178280 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.178253    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:18.178361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.178314    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:18.178361 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.178339    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:18.184048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.184020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:18.984792 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.984758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerStarted","Data":"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"}
Jul 16 21:59:18.984967 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.984820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerStarted","Data":"c2f3574f43e0ce5f30f577dac2d9b1119166f0094c164f2c28b34aea0a85e549"}
Jul 16 21:59:18.986510 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.986486    2559 generic.go:356] "Generic (PLEG): container finished" podID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerID="554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb" exitCode=6
Jul 16 21:59:18.986627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.986531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerDied","Data":"554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb"}
Jul 16 21:59:18.986627 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.986576    2559 scope.go:117] "RemoveContainer" containerID="e04732ebb256adb96bcfa4e0523098f672b642cd0fbf48f9d26aa3f1a77bb426"
Jul 16 21:59:18.986779 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:18.986760    2559 scope.go:117] "RemoveContainer" containerID="554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb"
Jul 16 21:59:18.986986 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:18.986965    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc_odh-ai-gateway-infra(9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1"
Jul 16 21:59:19.009325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.009286    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podStartSLOduration=2.009269865 podStartE2EDuration="2.009269865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:19.009233036 +0000 UTC m=+3021.859850413" watchObservedRunningTime="2026-07-16 21:59:19.009269865 +0000 UTC m=+3021.859887244"
Jul 16 21:59:19.033142 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.032053    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:19.038528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.038508    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:19.994580 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.994547    2559 scope.go:117] "RemoveContainer" containerID="554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb"
Jul 16 21:59:19.994781 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.994581    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:19.994781 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:19.994722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc_odh-ai-gateway-infra(9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1"
Jul 16 21:59:19.995572 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:19.995557    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:20.672851 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:20.672821    2559 scope.go:117] "RemoveContainer" containerID="b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93"
Jul 16 21:59:21.002262 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.002236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerStarted","Data":"e9ad569b9490d99db65388d56a55b221d06b62bf9cf7a21c90dd798084c20329"}
Jul 16 21:59:21.027435 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.027382    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" podStartSLOduration=18.027362821 podStartE2EDuration="18.027362821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:21.026781122 +0000 UTC m=+3023.877398501" watchObservedRunningTime="2026-07-16 21:59:21.027362821 +0000 UTC m=+3023.877980199"
Jul 16 21:59:21.028105 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.028054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:21.124454 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.124424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:21.227743 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.227704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:21.595863 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.595775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:21.798494 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.798451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:21.898598 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:21.898520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:22.008741 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:22.008707    2559 generic.go:356] "Generic (PLEG): container finished" podID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerID="e9ad569b9490d99db65388d56a55b221d06b62bf9cf7a21c90dd798084c20329" exitCode=6
Jul 16 21:59:22.008929 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:22.008784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerDied","Data":"e9ad569b9490d99db65388d56a55b221d06b62bf9cf7a21c90dd798084c20329"}
Jul 16 21:59:22.008929 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:22.008840    2559 scope.go:117] "RemoveContainer" containerID="b79afc5464a21826dc37509f8bf22bba08ebc28d09a656d21889e0e4922eff93"
Jul 16 21:59:22.009270 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:22.009254    2559 scope.go:117] "RemoveContainer" containerID="e9ad569b9490d99db65388d56a55b221d06b62bf9cf7a21c90dd798084c20329"
Jul 16 21:59:22.009500 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:22.009475    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9_odh-ai-gateway-infra(30c95c61-b79e-4b72-9b68-ec9102caa875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875"
Jul 16 21:59:22.038676 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:22.038653    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:23.161452 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:23.161429    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:23.183438 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:23.183400    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca\") pod \"30c95c61-b79e-4b72-9b68-ec9102caa875\" (UID: \"30c95c61-b79e-4b72-9b68-ec9102caa875\") "
Jul 16 21:59:23.184033 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:23.183993    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30c95c61-b79e-4b72-9b68-ec9102caa875" (UID: "30c95c61-b79e-4b72-9b68-ec9102caa875"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:59:23.284351 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:23.284262    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c95c61-b79e-4b72-9b68-ec9102caa875-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:59:24.023162 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:24.023137    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"
Jul 16 21:59:24.023311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:24.023153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9" event={"ID":"30c95c61-b79e-4b72-9b68-ec9102caa875","Type":"ContainerDied","Data":"2b22af66eea231e9b06b98830ef47f00a3479a104686a473992de794f9b7c6be"}
Jul 16 21:59:24.023311 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:24.023217    2559 scope.go:117] "RemoveContainer" containerID="e9ad569b9490d99db65388d56a55b221d06b62bf9cf7a21c90dd798084c20329"
Jul 16 21:59:24.042282 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:24.042259    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:24.046424 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:24.046403    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-vjvk9"]
Jul 16 21:59:25.586896 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:25.586839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:25.679048 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:25.679017    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" path="/var/lib/kubelet/pods/30c95c61-b79e-4b72-9b68-ec9102caa875/volumes"
Jul 16 21:59:26.226678 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:26.226644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:26.534188 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:26.534073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:26.797501 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:26.797402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:29.475898 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:29.475857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:29.700464 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:29.700437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:29.879448 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:29.879365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:30.488500 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:30.488472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:30.611423 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:30.611387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:33.672829 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:33.672736    2559 scope.go:117] "RemoveContainer" containerID="554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb"
Jul 16 21:59:33.913319 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:33.913285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:34.083528 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.083495    2559 generic.go:356] "Generic (PLEG): container finished" podID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerID="f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2" exitCode=0
Jul 16 21:59:34.083705 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.083568    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerDied","Data":"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"}
Jul 16 21:59:34.084027 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.084001    2559 scope.go:117] "RemoveContainer" containerID="f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"
Jul 16 21:59:34.085128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.085085    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:34.085263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.085187    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:34.085263 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.085237    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:59:34.085620 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.085600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerStarted","Data":"31f32464e5967271334e3ae0378d9539db1458912ee2effe504ff8a015f81936"}
Jul 16 21:59:34.994958 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:34.994919    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:35.093155 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.093123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerStarted","Data":"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"}
Jul 16 21:59:35.094893 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.094870    2559 generic.go:356] "Generic (PLEG): container finished" podID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerID="31f32464e5967271334e3ae0378d9539db1458912ee2effe504ff8a015f81936" exitCode=6
Jul 16 21:59:35.094995 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.094938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerDied","Data":"31f32464e5967271334e3ae0378d9539db1458912ee2effe504ff8a015f81936"}
Jul 16 21:59:35.094995 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.094989    2559 scope.go:117] "RemoveContainer" containerID="554ac60e6e91347d011c6095c21a1fe6e88d6655a34e0d06781131b087df3adb"
Jul 16 21:59:35.095328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.095307    2559 scope.go:117] "RemoveContainer" containerID="31f32464e5967271334e3ae0378d9539db1458912ee2effe504ff8a015f81936"
Jul 16 21:59:35.095551 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:35.095529    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc_odh-ai-gateway-infra(9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1"
Jul 16 21:59:35.138626 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:35.138596    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:36.029519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.029484    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:36.030736 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.030710    2559 patch_prober.go:28] interesting pod/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 16 21:59:36.030840 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.030761    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 16 21:59:36.292195 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.292123    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:36.417176 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.417144    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca\") pod \"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1\" (UID: \"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1\") "
Jul 16 21:59:36.417482 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.417461    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" (UID: "9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:59:36.518421 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:36.518389    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:59:37.029662 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.029622    2559 patch_prober.go:28] interesting pod/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 16 21:59:37.030040 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.029681    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 16 21:59:37.107860 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.107822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc" event={"ID":"9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1","Type":"ContainerDied","Data":"76420f3f25b1c1bb65c70b1965d0c1ddd96067a79292c7b7f9d4ac336ac65adc"}
Jul 16 21:59:37.107860 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.107843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"
Jul 16 21:59:37.108128 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.107888    2559 scope.go:117] "RemoveContainer" containerID="31f32464e5967271334e3ae0378d9539db1458912ee2effe504ff8a015f81936"
Jul 16 21:59:37.130204 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.130175    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:37.134578 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.134560    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-s6tpc"]
Jul 16 21:59:37.680633 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:37.680602    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" path="/var/lib/kubelet/pods/9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1/volumes"
Jul 16 21:59:38.030362 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:38.030330    2559 patch_prober.go:28] interesting pod/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 16 21:59:38.030785 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:38.030383    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 16 21:59:39.029706 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:39.029664    2559 patch_prober.go:28] interesting pod/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 16 21:59:39.029887 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:39.029721    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 16 21:59:40.033700 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:40.033670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:40.034068 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:40.033942    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:40.034565 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:40.034549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 21:59:42.054465 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.054429    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"]
Jul 16 21:59:42.055042 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055025    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055046    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055064    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055073    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055107    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055121 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055116    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055131    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055139    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055148    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055156    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055257    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055269    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055278    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:42.055310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.055291    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:42.060211 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.060194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:42.063328 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.063303    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:59:42.066231 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.066205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"]
Jul 16 21:59:42.167502 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.167467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr\" (UID: \"5fcd7da9-c45c-43a8-afe6-15d2826798ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:42.267929 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.267897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr\" (UID: \"5fcd7da9-c45c-43a8-afe6-15d2826798ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:42.268519 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.268497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr\" (UID: \"5fcd7da9-c45c-43a8-afe6-15d2826798ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:42.373474 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.373401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:42.515074 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:42.515039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"]
Jul 16 21:59:42.516266 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:42.516239    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcd7da9_c45c_43a8_afe6_15d2826798ae.slice/crio-2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066 WatchSource:0}: Error finding container 2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066: Status 404 returned error can't find the container with id 2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066
Jul 16 21:59:43.143527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:43.143437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr" event={"ID":"5fcd7da9-c45c-43a8-afe6-15d2826798ae","Type":"ContainerStarted","Data":"20f996bc5ade74b39efa3f7e261c12945137e9782678204f3e3510364df5c34d"}
Jul 16 21:59:43.143527 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:43.143501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr" event={"ID":"5fcd7da9-c45c-43a8-afe6-15d2826798ae","Type":"ContainerStarted","Data":"2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066"}
Jul 16 21:59:43.155571 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:43.155537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:43.163911 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:43.163861    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr" podStartSLOduration=1.163843952 podStartE2EDuration="1.163843952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:43.161109605 +0000 UTC m=+3046.011726979" watchObservedRunningTime="2026-07-16 21:59:43.163843952 +0000 UTC m=+3046.014461334"
Jul 16 21:59:43.256886 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:43.256857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:44.150618 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:44.150585    2559 generic.go:356] "Generic (PLEG): container finished" podID="5fcd7da9-c45c-43a8-afe6-15d2826798ae" containerID="20f996bc5ade74b39efa3f7e261c12945137e9782678204f3e3510364df5c34d" exitCode=0
Jul 16 21:59:44.151127 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:44.150668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr" event={"ID":"5fcd7da9-c45c-43a8-afe6-15d2826798ae","Type":"ContainerDied","Data":"20f996bc5ade74b39efa3f7e261c12945137e9782678204f3e3510364df5c34d"}
Jul 16 21:59:45.298294 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:45.298271    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:45.396489 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:45.396462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca\") pod \"5fcd7da9-c45c-43a8-afe6-15d2826798ae\" (UID: \"5fcd7da9-c45c-43a8-afe6-15d2826798ae\") "
Jul 16 21:59:45.396782 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:45.396761    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fcd7da9-c45c-43a8-afe6-15d2826798ae" (UID: "5fcd7da9-c45c-43a8-afe6-15d2826798ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:59:45.497524 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:45.497492    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcd7da9-c45c-43a8-afe6-15d2826798ae-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 21:59:46.162386 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.162360    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr"
Jul 16 21:59:46.162561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.162401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr" event={"ID":"5fcd7da9-c45c-43a8-afe6-15d2826798ae","Type":"ContainerDied","Data":"2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066"}
Jul 16 21:59:46.162561 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.162447    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b213f6153d1bb44616b5476aa24a0125942bc0203f828bcf57fa4ea58e67066"
Jul 16 21:59:46.240692 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.240665    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 21:59:46.241113 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241081    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:46.241113 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241108    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:46.241212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241117    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcd7da9-c45c-43a8-afe6-15d2826798ae" containerName="revoke-keys"
Jul 16 21:59:46.241212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241123    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcd7da9-c45c-43a8-afe6-15d2826798ae" containerName="revoke-keys"
Jul 16 21:59:46.241212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241184    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fcd7da9-c45c-43a8-afe6-15d2826798ae" containerName="revoke-keys"
Jul 16 21:59:46.241212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241194    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c95c61-b79e-4b72-9b68-ec9102caa875" containerName="revoke-keys"
Jul 16 21:59:46.241212 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.241202    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9748a2f2-d9cc-48b3-8d68-57f9ee7c94e1" containerName="revoke-keys"
Jul 16 21:59:46.244215 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.244199    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 21:59:46.247309 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.247286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 21:59:46.253232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.253211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 21:59:46.303977 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.303916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr\" (UID: \"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 21:59:46.404881 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.404852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr\" (UID: \"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 21:59:46.405442 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.405425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr\" (UID: \"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 21:59:46.556501 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.556478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 21:59:46.897157 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:46.897130    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 21:59:46.899735 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:46.899705    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e4180f_773e_4fb8_98e4_ae7b8fddbbe1.slice/crio-347d5d74960c58f1cb4497b1ddc95584c8b74b4882af52b65569c58a5a425c1e WatchSource:0}: Error finding container 347d5d74960c58f1cb4497b1ddc95584c8b74b4882af52b65569c58a5a425c1e: Status 404 returned error can't find the container with id 347d5d74960c58f1cb4497b1ddc95584c8b74b4882af52b65569c58a5a425c1e
Jul 16 21:59:47.168858 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:47.168829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerStarted","Data":"725107b2b65faf16d81e0efad9a6321d5af38eae9f5f84f5c296e4a70d4a68a0"}
Jul 16 21:59:47.168970 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:47.168881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerStarted","Data":"347d5d74960c58f1cb4497b1ddc95584c8b74b4882af52b65569c58a5a425c1e"}
Jul 16 21:59:48.176833 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:48.176793    2559 generic.go:356] "Generic (PLEG): container finished" podID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerID="725107b2b65faf16d81e0efad9a6321d5af38eae9f5f84f5c296e4a70d4a68a0" exitCode=6
Jul 16 21:59:48.177232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:48.176879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerDied","Data":"725107b2b65faf16d81e0efad9a6321d5af38eae9f5f84f5c296e4a70d4a68a0"}
Jul 16 21:59:48.177232 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:48.177039    2559 scope.go:117] "RemoveContainer" containerID="725107b2b65faf16d81e0efad9a6321d5af38eae9f5f84f5c296e4a70d4a68a0"
Jul 16 21:59:49.184799 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:49.184693    2559 generic.go:356] "Generic (PLEG): container finished" podID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerID="8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7" exitCode=6
Jul 16 21:59:49.184799 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:49.184780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerDied","Data":"8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7"}
Jul 16 21:59:49.185301 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:49.184847    2559 scope.go:117] "RemoveContainer" containerID="725107b2b65faf16d81e0efad9a6321d5af38eae9f5f84f5c296e4a70d4a68a0"
Jul 16 21:59:49.185301 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:49.185077    2559 scope.go:117] "RemoveContainer" containerID="8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7"
Jul 16 21:59:49.185369 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:49.185324    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr_odh-ai-gateway-infra(d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1"
Jul 16 21:59:50.192050 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:50.192024    2559 scope.go:117] "RemoveContainer" containerID="8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7"
Jul 16 21:59:50.192449 ip-10-0-132-95 kubenswrapper[2559]: E0716 21:59:50.192243    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr_odh-ai-gateway-infra(d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1"
Jul 16 21:59:51.310325 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:51.310285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:51.410404 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:51.410372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:52.345406 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:52.345371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:57.280635 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.280601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:57.428994 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.428961    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 21:59:57.433921 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.433902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 21:59:57.441108 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.441060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 21:59:57.606272 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.606186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6\" (UID: \"c15767d4-4374-4475-8fa0-3b7891f6db7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 21:59:57.707351 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.707319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6\" (UID: \"c15767d4-4374-4475-8fa0-3b7891f6db7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 21:59:57.707903 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.707884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6\" (UID: \"c15767d4-4374-4475-8fa0-3b7891f6db7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 21:59:57.746310 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.746289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 21:59:57.915026 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:57.914997    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 21:59:57.916932 ip-10-0-132-95 kubenswrapper[2559]: W0716 21:59:57.916906    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15767d4_4374_4475_8fa0_3b7891f6db7c.slice/crio-28779fac581e5f85cd9f28832ce09b5c87bb706fa4a53ca0cd733000079c83c1 WatchSource:0}: Error finding container 28779fac581e5f85cd9f28832ce09b5c87bb706fa4a53ca0cd733000079c83c1: Status 404 returned error can't find the container with id 28779fac581e5f85cd9f28832ce09b5c87bb706fa4a53ca0cd733000079c83c1
Jul 16 21:59:58.127641 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:58.127605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 21:59:58.237197 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:58.237167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerStarted","Data":"28779fac581e5f85cd9f28832ce09b5c87bb706fa4a53ca0cd733000079c83c1"}
Jul 16 21:59:59.245152 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:59.245119    2559 generic.go:356] "Generic (PLEG): container finished" podID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerID="99ee0030b5e97f02faf0e3cf716dbd4249dbf5c40e2ab9535dcbd1401ddc32cc" exitCode=6
Jul 16 21:59:59.245564 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:59.245188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerDied","Data":"99ee0030b5e97f02faf0e3cf716dbd4249dbf5c40e2ab9535dcbd1401ddc32cc"}
Jul 16 21:59:59.245564 ip-10-0-132-95 kubenswrapper[2559]: I0716 21:59:59.245429    2559 scope.go:117] "RemoveContainer" containerID="99ee0030b5e97f02faf0e3cf716dbd4249dbf5c40e2ab9535dcbd1401ddc32cc"
Jul 16 22:00:00.133505 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.133440    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"]
Jul 16 22:00:00.137004 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.136984    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"
Jul 16 22:00:00.147174 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.147138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"
Jul 16 22:00:00.150254 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.150021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"]
Jul 16 22:00:00.253905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.253875    2559 generic.go:356] "Generic (PLEG): container finished" podID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerID="803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11" exitCode=6
Jul 16 22:00:00.254439 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.253932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerDied","Data":"803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11"}
Jul 16 22:00:00.254439 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.254007    2559 scope.go:117] "RemoveContainer" containerID="99ee0030b5e97f02faf0e3cf716dbd4249dbf5c40e2ab9535dcbd1401ddc32cc"
Jul 16 22:00:00.254439 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.254215    2559 scope.go:117] "RemoveContainer" containerID="803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11"
Jul 16 22:00:00.254569 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:00.254500    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6_odh-ai-gateway-infra(c15767d4-4374-4475-8fa0-3b7891f6db7c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c"
Jul 16 22:00:00.292533 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:00.292510    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"]
Jul 16 22:00:00.293975 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:00.293948    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389b02bd_73dc_4a49_9db9_e528dce16533.slice/crio-e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784 WatchSource:0}: Error finding container e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784: Status 404 returned error can't find the container with id e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784
Jul 16 22:00:01.260557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:01.260522    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv" event={"ID":"389b02bd-73dc-4a49-9db9-e528dce16533","Type":"ContainerStarted","Data":"3cf2bd6d2abc71621bba8deceb53b784bfccd0c304f1b07e1c15b6017c06bd5a"}
Jul 16 22:00:01.261000 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:01.260590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv" event={"ID":"389b02bd-73dc-4a49-9db9-e528dce16533","Type":"ContainerStarted","Data":"e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784"}
Jul 16 22:00:01.262343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:01.262324    2559 scope.go:117] "RemoveContainer" containerID="803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11"
Jul 16 22:00:01.262495 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:01.262478    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6_odh-ai-gateway-infra(c15767d4-4374-4475-8fa0-3b7891f6db7c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c"
Jul 16 22:00:01.278574 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:01.278536    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv" podStartSLOduration=1.2785213149999999 podStartE2EDuration="1.278521315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:01.27574305 +0000 UTC m=+3064.126360428" watchObservedRunningTime="2026-07-16 22:00:01.278521315 +0000 UTC m=+3064.129138691"
Jul 16 22:00:02.268653 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:02.268616    2559 generic.go:356] "Generic (PLEG): container finished" podID="389b02bd-73dc-4a49-9db9-e528dce16533" containerID="3cf2bd6d2abc71621bba8deceb53b784bfccd0c304f1b07e1c15b6017c06bd5a" exitCode=0
Jul 16 22:00:02.269025 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:02.268699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv" event={"ID":"389b02bd-73dc-4a49-9db9-e528dce16533","Type":"ContainerDied","Data":"3cf2bd6d2abc71621bba8deceb53b784bfccd0c304f1b07e1c15b6017c06bd5a"}
Jul 16 22:00:02.672647 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:02.672573    2559 scope.go:117] "RemoveContainer" containerID="8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7"
Jul 16 22:00:03.276234 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.276203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerStarted","Data":"3d32b58b7c12279c1dc272d6ac9022a419c2b44fe06d84cfbc83f85f0f3f563c"}
Jul 16 22:00:03.295271 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.295223    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" podStartSLOduration=17.295207068 podStartE2EDuration="17.295207068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:47.193942526 +0000 UTC m=+3050.044559902" watchObservedRunningTime="2026-07-16 22:00:03.295207068 +0000 UTC m=+3066.145824477"
Jul 16 22:00:03.427216 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.427197    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"
Jul 16 22:00:03.693323 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.693287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:03.893788 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.893755    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:03.894228 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.894214    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389b02bd-73dc-4a49-9db9-e528dce16533" containerName="cleanup"
Jul 16 22:00:03.894272 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.894230    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="389b02bd-73dc-4a49-9db9-e528dce16533" containerName="cleanup"
Jul 16 22:00:03.894304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.894294    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="389b02bd-73dc-4a49-9db9-e528dce16533" containerName="cleanup"
Jul 16 22:00:03.897279 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.897263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:03.910904 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:03.910866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:04.067442 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.067407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-75994\" (UID: \"4e633c90-fe70-4fdf-a417-9597a6863ec3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:04.135433 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.135407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:04.168494 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.168465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-75994\" (UID: \"4e633c90-fe70-4fdf-a417-9597a6863ec3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:04.169065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.169046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-75994\" (UID: \"4e633c90-fe70-4fdf-a417-9597a6863ec3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:04.207953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.207929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:04.282821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.282791    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"
Jul 16 22:00:04.282821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.282809    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv" event={"ID":"389b02bd-73dc-4a49-9db9-e528dce16533","Type":"ContainerDied","Data":"e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784"}
Jul 16 22:00:04.283230 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.282854    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e88624bbed0ecd828a301660b4b7a3957fcd83e22a98aa4350c4894d18cb9784"
Jul 16 22:00:04.285130 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.285085    2559 generic.go:356] "Generic (PLEG): container finished" podID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerID="3d32b58b7c12279c1dc272d6ac9022a419c2b44fe06d84cfbc83f85f0f3f563c" exitCode=6
Jul 16 22:00:04.285263 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.285167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerDied","Data":"3d32b58b7c12279c1dc272d6ac9022a419c2b44fe06d84cfbc83f85f0f3f563c"}
Jul 16 22:00:04.285263 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.285212    2559 scope.go:117] "RemoveContainer" containerID="8f2e8a74841983fe5ccf70f22796fa6377c8c1d48e5d1107f08f4115051744c7"
Jul 16 22:00:04.285989 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.285506    2559 scope.go:117] "RemoveContainer" containerID="3d32b58b7c12279c1dc272d6ac9022a419c2b44fe06d84cfbc83f85f0f3f563c"
Jul 16 22:00:04.285989 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:04.285707    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr_odh-ai-gateway-infra(d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1"
Jul 16 22:00:04.307296 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.307270    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 22:00:04.356800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:04.356777    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:04.358566 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:04.358540    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e633c90_fe70_4fdf_a417_9597a6863ec3.slice/crio-121b220b89b50ca392455c19562322e912e1f872d5a1b771880fa14683bf4db0 WatchSource:0}: Error finding container 121b220b89b50ca392455c19562322e912e1f872d5a1b771880fa14683bf4db0: Status 404 returned error can't find the container with id 121b220b89b50ca392455c19562322e912e1f872d5a1b771880fa14683bf4db0
Jul 16 22:00:05.292442 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.292406    2559 generic.go:356] "Generic (PLEG): container finished" podID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerID="16c4d32cce9b19d372a2f0ac28aeed5bc99e36681e4e2cd08722006241f946c1" exitCode=6
Jul 16 22:00:05.292923 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.292495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" event={"ID":"4e633c90-fe70-4fdf-a417-9597a6863ec3","Type":"ContainerDied","Data":"16c4d32cce9b19d372a2f0ac28aeed5bc99e36681e4e2cd08722006241f946c1"}
Jul 16 22:00:05.292923 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.292589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" event={"ID":"4e633c90-fe70-4fdf-a417-9597a6863ec3","Type":"ContainerStarted","Data":"121b220b89b50ca392455c19562322e912e1f872d5a1b771880fa14683bf4db0"}
Jul 16 22:00:05.292923 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.292696    2559 scope.go:117] "RemoveContainer" containerID="16c4d32cce9b19d372a2f0ac28aeed5bc99e36681e4e2cd08722006241f946c1"
Jul 16 22:00:05.446295 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.446271    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 22:00:05.583139 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.583117    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca\") pod \"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1\" (UID: \"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1\") "
Jul 16 22:00:05.583375 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.583355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" (UID: "d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:05.683878 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:05.683849    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:06.301697 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.301664    2559 generic.go:356] "Generic (PLEG): container finished" podID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerID="89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0" exitCode=6
Jul 16 22:00:06.302169 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.301753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" event={"ID":"4e633c90-fe70-4fdf-a417-9597a6863ec3","Type":"ContainerDied","Data":"89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0"}
Jul 16 22:00:06.302169 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.301813    2559 scope.go:117] "RemoveContainer" containerID="16c4d32cce9b19d372a2f0ac28aeed5bc99e36681e4e2cd08722006241f946c1"
Jul 16 22:00:06.302169 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.301954    2559 scope.go:117] "RemoveContainer" containerID="89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0"
Jul 16 22:00:06.302359 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:06.302223    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-75994_odh-ai-gateway-infra(4e633c90-fe70-4fdf-a417-9597a6863ec3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3"
Jul 16 22:00:06.303280 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.303267    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"
Jul 16 22:00:06.303362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.303312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr" event={"ID":"d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1","Type":"ContainerDied","Data":"347d5d74960c58f1cb4497b1ddc95584c8b74b4882af52b65569c58a5a425c1e"}
Jul 16 22:00:06.313481 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.313461    2559 scope.go:117] "RemoveContainer" containerID="3d32b58b7c12279c1dc272d6ac9022a419c2b44fe06d84cfbc83f85f0f3f563c"
Jul 16 22:00:06.332871 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.332848    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 22:00:06.339153 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:06.339132    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-7s5cr"]
Jul 16 22:00:07.310809 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:07.310782    2559 scope.go:117] "RemoveContainer" containerID="89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0"
Jul 16 22:00:07.311305 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:07.311030    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-75994_odh-ai-gateway-infra(4e633c90-fe70-4fdf-a417-9597a6863ec3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3"
Jul 16 22:00:07.680082 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:07.680005    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" path="/var/lib/kubelet/pods/d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1/volumes"
Jul 16 22:00:07.921160 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:07.921126    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 22:00:07.921360 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:07.921336    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" containerID="cri-o://c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a" gracePeriod=30
Jul 16 22:00:07.940582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:07.940514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:08.159700 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.159638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:08.279029 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.278987    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"]
Jul 16 22:00:08.279493 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279471    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.279493 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279495    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.279642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279516    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.279642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279522    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.279642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279592    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.279642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.279599    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:08.282821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.282800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:08.291572 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.291547    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"]
Jul 16 22:00:08.307395 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.307373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn\" (UID: \"cc094478-43ad-4775-a21e-9480a718270e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:08.408881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.408847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn\" (UID: \"cc094478-43ad-4775-a21e-9480a718270e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:08.409460 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.409440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn\" (UID: \"cc094478-43ad-4775-a21e-9480a718270e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:08.594978 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.594898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:08.743756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:08.743727    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"]
Jul 16 22:00:08.745286 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:08.745253    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc094478_43ad_4775_a21e_9480a718270e.slice/crio-0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045 WatchSource:0}: Error finding container 0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045: Status 404 returned error can't find the container with id 0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045
Jul 16 22:00:09.323532 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:09.323427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn" event={"ID":"cc094478-43ad-4775-a21e-9480a718270e","Type":"ContainerStarted","Data":"c2a2e54b4988b3e1b476acd6d40174a0f795aacb28cda9bf2deaea909a74c2c1"}
Jul 16 22:00:09.323532 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:09.323484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn" event={"ID":"cc094478-43ad-4775-a21e-9480a718270e","Type":"ContainerStarted","Data":"0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045"}
Jul 16 22:00:09.345779 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:09.345735    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn" podStartSLOduration=1.345720161 podStartE2EDuration="1.345720161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:09.34464219 +0000 UTC m=+3072.195259569" watchObservedRunningTime="2026-07-16 22:00:09.345720161 +0000 UTC m=+3072.196337538"
Jul 16 22:00:10.037005 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:10.036970    2559 patch_prober.go:28] interesting pod/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:00:10.037428 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:10.037027    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:00:10.330054 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:10.329975    2559 generic.go:356] "Generic (PLEG): container finished" podID="cc094478-43ad-4775-a21e-9480a718270e" containerID="c2a2e54b4988b3e1b476acd6d40174a0f795aacb28cda9bf2deaea909a74c2c1" exitCode=0
Jul 16 22:00:10.330211 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:10.330063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn" event={"ID":"cc094478-43ad-4775-a21e-9480a718270e","Type":"ContainerDied","Data":"c2a2e54b4988b3e1b476acd6d40174a0f795aacb28cda9bf2deaea909a74c2c1"}
Jul 16 22:00:11.479869 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:11.479844    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:11.536817 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:11.536792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca\") pod \"cc094478-43ad-4775-a21e-9480a718270e\" (UID: \"cc094478-43ad-4775-a21e-9480a718270e\") "
Jul 16 22:00:11.537165 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:11.537143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc094478-43ad-4775-a21e-9480a718270e" (UID: "cc094478-43ad-4775-a21e-9480a718270e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:11.638028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:11.637965    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc094478-43ad-4775-a21e-9480a718270e-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:11.673270 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:11.673247    2559 scope.go:117] "RemoveContainer" containerID="803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11"
Jul 16 22:00:12.343132 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:12.343035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn"
Jul 16 22:00:12.343132 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:12.343065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn" event={"ID":"cc094478-43ad-4775-a21e-9480a718270e","Type":"ContainerDied","Data":"0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045"}
Jul 16 22:00:12.343132 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:12.343127    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0751f275a41dc7aa8b12e06989fe4550c3510fa350a3ed698c760591b52c1045"
Jul 16 22:00:12.345142 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:12.345113    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerStarted","Data":"af41801f5a4b72cae071a01d0d830ac1e64ecef5ccfa9be7853e38b817777658"}
Jul 16 22:00:12.363964 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:12.363910    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" podStartSLOduration=15.363896204 podStartE2EDuration="15.363896204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:12.362027329 +0000 UTC m=+3075.212644705" watchObservedRunningTime="2026-07-16 22:00:12.363896204 +0000 UTC m=+3075.214513585"
Jul 16 22:00:13.196968 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.196912    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 22:00:13.251378 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251502 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251403    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251502 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251502 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxcbb\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.251659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:00:13.251916 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.251729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token\") pod \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\" (UID: \"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506\") "
Jul 16 22:00:13.252252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.252036    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.252252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.252110    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:00:13.252252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.252140    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:00:13.252446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.252353    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:13.253038 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.253011    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data" (OuterVolumeSpecName: "istio-data") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:00:13.254561 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.254518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:00:13.254675 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.254657    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token" (OuterVolumeSpecName: "istio-token") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:00:13.255027 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.255006    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:00:13.255117 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.255032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb" (OuterVolumeSpecName: "kube-api-access-jxcbb") pod "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" (UID: "de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506"). InnerVolumeSpecName "kube-api-access-jxcbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:00:13.352142 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352079    2559 generic.go:356] "Generic (PLEG): container finished" podID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerID="c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a" exitCode=0
Jul 16 22:00:13.352297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352154    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"
Jul 16 22:00:13.352297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352184    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerDied","Data":"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"}
Jul 16 22:00:13.352297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75" event={"ID":"de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506","Type":"ContainerDied","Data":"c2f3574f43e0ce5f30f577dac2d9b1119166f0094c164f2c28b34aea0a85e549"}
Jul 16 22:00:13.352297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352286    2559 scope.go:117] "RemoveContainer" containerID="c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"
Jul 16 22:00:13.352759 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352742    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352827 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352764    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352827 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352776    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352827 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352790    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352827 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352801    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352827 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352815    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxcbb\" (UniqueName: \"kubernetes.io/projected/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-kube-api-access-jxcbb\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352828    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.352992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.352842    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:13.355008 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.354981    2559 generic.go:356] "Generic (PLEG): container finished" podID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerID="af41801f5a4b72cae071a01d0d830ac1e64ecef5ccfa9be7853e38b817777658" exitCode=6
Jul 16 22:00:13.355189 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.355020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerDied","Data":"af41801f5a4b72cae071a01d0d830ac1e64ecef5ccfa9be7853e38b817777658"}
Jul 16 22:00:13.355429 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.355411    2559 scope.go:117] "RemoveContainer" containerID="af41801f5a4b72cae071a01d0d830ac1e64ecef5ccfa9be7853e38b817777658"
Jul 16 22:00:13.355663 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:13.355641    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6_odh-ai-gateway-infra(c15767d4-4374-4475-8fa0-3b7891f6db7c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c"
Jul 16 22:00:13.362880 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.362864    2559 scope.go:117] "RemoveContainer" containerID="f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"
Jul 16 22:00:13.370974 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.370958    2559 scope.go:117] "RemoveContainer" containerID="c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"
Jul 16 22:00:13.371281 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:13.371260    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a\": container with ID starting with c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a not found: ID does not exist" containerID="c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"
Jul 16 22:00:13.371341 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.371289    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a"} err="failed to get container status \"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a\": rpc error: code = NotFound desc = could not find container \"c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a\": container with ID starting with c1611699465a5fb239fbee8b414696da244da72f1ce3db2b3cf53a2847df343a not found: ID does not exist"
Jul 16 22:00:13.371341 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.371305    2559 scope.go:117] "RemoveContainer" containerID="f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"
Jul 16 22:00:13.371545 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:13.371528    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2\": container with ID starting with f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2 not found: ID does not exist" containerID="f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"
Jul 16 22:00:13.371591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.371552    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2"} err="failed to get container status \"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2\": rpc error: code = NotFound desc = could not find container \"f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2\": container with ID starting with f201401b32bedd6b361c52eb590d5d5e9f065f732aaeb368c956339cd0c609c2 not found: ID does not exist"
Jul 16 22:00:13.371591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.371567    2559 scope.go:117] "RemoveContainer" containerID="803283da0b4dd6294309fc9cbd45eea42f96da7ce9bd44552dba238201410a11"
Jul 16 22:00:13.378543 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.378523    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 22:00:13.413238 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.413198    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 22:00:13.417202 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.417181    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f90d76-openshift-default-89bdf9955-clv75"]
Jul 16 22:00:13.678974 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:13.678947    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" path="/var/lib/kubelet/pods/de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506/volumes"
Jul 16 22:00:14.501887 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:14.501865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 22:00:14.563646 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:14.563619    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca\") pod \"c15767d4-4374-4475-8fa0-3b7891f6db7c\" (UID: \"c15767d4-4374-4475-8fa0-3b7891f6db7c\") "
Jul 16 22:00:14.563965 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:14.563944    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c15767d4-4374-4475-8fa0-3b7891f6db7c" (UID: "c15767d4-4374-4475-8fa0-3b7891f6db7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:14.664569 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:14.664491    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15767d4-4374-4475-8fa0-3b7891f6db7c-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:15.371171 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.371140    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"
Jul 16 22:00:15.371171 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.371161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6" event={"ID":"c15767d4-4374-4475-8fa0-3b7891f6db7c","Type":"ContainerDied","Data":"28779fac581e5f85cd9f28832ce09b5c87bb706fa4a53ca0cd733000079c83c1"}
Jul 16 22:00:15.371442 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.371242    2559 scope.go:117] "RemoveContainer" containerID="af41801f5a4b72cae071a01d0d830ac1e64ecef5ccfa9be7853e38b817777658"
Jul 16 22:00:15.398213 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.398192    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 22:00:15.400325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.400305    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-7hsw6"]
Jul 16 22:00:15.678962 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.678875    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" path="/var/lib/kubelet/pods/c15767d4-4374-4475-8fa0-3b7891f6db7c/volumes"
Jul 16 22:00:15.715171 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715149    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:15.715543 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715531    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:15.715582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715545    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:15.715582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715556    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715562    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715570    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715575    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715585    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715591    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715602    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715607    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715618    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc094478-43ad-4775-a21e-9480a718270e" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715623    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc094478-43ad-4775-a21e-9480a718270e" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715679    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc094478-43ad-4775-a21e-9480a718270e" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715688    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715694    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715701    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:15.715763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.715707    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e4180f-773e-4fb8-98e4-ae7b8fddbbe1" containerName="revoke-keys"
Jul 16 22:00:15.720033 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.720016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:15.725993 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.725966    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:15.773100 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.773070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq\" (UID: \"aa43ca1b-a01d-4b4a-aff1-473d08844c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:15.873981 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.873953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq\" (UID: \"aa43ca1b-a01d-4b4a-aff1-473d08844c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:15.874549 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:15.874530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq\" (UID: \"aa43ca1b-a01d-4b4a-aff1-473d08844c09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:16.033634 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.033602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:16.170642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.170616    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:16.172189 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:16.172160    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa43ca1b_a01d_4b4a_aff1_473d08844c09.slice/crio-492b2af67e1ebba2667e2863e51a2f5d666db254abf38fa65ad63bb743b31310 WatchSource:0}: Error finding container 492b2af67e1ebba2667e2863e51a2f5d666db254abf38fa65ad63bb743b31310: Status 404 returned error can't find the container with id 492b2af67e1ebba2667e2863e51a2f5d666db254abf38fa65ad63bb743b31310
Jul 16 22:00:16.378270 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.378244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerStarted","Data":"044cb629e4211fb156cb4ebbc135c398eec708c3b142c3d805eeb95d6e660050"}
Jul 16 22:00:16.378383 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.378290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerStarted","Data":"492b2af67e1ebba2667e2863e51a2f5d666db254abf38fa65ad63bb743b31310"}
Jul 16 22:00:16.399198 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.399157    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" podStartSLOduration=1.399142981 podStartE2EDuration="1.399142981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:16.396962525 +0000 UTC m=+3079.247579901" watchObservedRunningTime="2026-07-16 22:00:16.399142981 +0000 UTC m=+3079.249760355"
Jul 16 22:00:16.566081 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:16.566044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:17.384911 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:17.384882    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerID="044cb629e4211fb156cb4ebbc135c398eec708c3b142c3d805eeb95d6e660050" exitCode=6
Jul 16 22:00:17.385362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:17.384969    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerDied","Data":"044cb629e4211fb156cb4ebbc135c398eec708c3b142c3d805eeb95d6e660050"}
Jul 16 22:00:17.385362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:17.385146    2559 scope.go:117] "RemoveContainer" containerID="044cb629e4211fb156cb4ebbc135c398eec708c3b142c3d805eeb95d6e660050"
Jul 16 22:00:17.921585 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:17.921534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:18.395197 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:18.395168    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerID="1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc" exitCode=6
Jul 16 22:00:18.395572 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:18.395251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerDied","Data":"1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc"}
Jul 16 22:00:18.395572 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:18.395332    2559 scope.go:117] "RemoveContainer" containerID="044cb629e4211fb156cb4ebbc135c398eec708c3b142c3d805eeb95d6e660050"
Jul 16 22:00:18.395572 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:18.395504    2559 scope.go:117] "RemoveContainer" containerID="1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc"
Jul 16 22:00:18.395732 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:18.395712    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq_odh-ai-gateway-infra(aa43ca1b-a01d-4b4a-aff1-473d08844c09)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09"
Jul 16 22:00:18.958348 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:18.958305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:19.060515 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.060482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:19.257647 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.257615    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"]
Jul 16 22:00:19.263939 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.263909    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ef3576-29737320-xr9lv"]
Jul 16 22:00:19.292340 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.292309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:19.402769 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.402742    2559 scope.go:117] "RemoveContainer" containerID="1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc"
Jul 16 22:00:19.403145 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:19.402921    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq_odh-ai-gateway-infra(aa43ca1b-a01d-4b4a-aff1-473d08844c09)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09"
Jul 16 22:00:19.679547 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:19.679473    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389b02bd-73dc-4a49-9db9-e528dce16533" path="/var/lib/kubelet/pods/389b02bd-73dc-4a49-9db9-e528dce16533/volumes"
Jul 16 22:00:21.672778 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:21.672750    2559 scope.go:117] "RemoveContainer" containerID="89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0"
Jul 16 22:00:22.420620 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:22.420592    2559 generic.go:356] "Generic (PLEG): container finished" podID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerID="4bb487ee2b53474828e5aba868c5f5e45c4a280235d0c0b26c91fa12ce0a6405" exitCode=6
Jul 16 22:00:22.420783 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:22.420661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" event={"ID":"4e633c90-fe70-4fdf-a417-9597a6863ec3","Type":"ContainerDied","Data":"4bb487ee2b53474828e5aba868c5f5e45c4a280235d0c0b26c91fa12ce0a6405"}
Jul 16 22:00:22.420783 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:22.420721    2559 scope.go:117] "RemoveContainer" containerID="89c8e0cd247f991b145f7d113169b1b62c1b4f8a1ef6e48a8b1ae3c7718810f0"
Jul 16 22:00:22.421005 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:22.420984    2559 scope.go:117] "RemoveContainer" containerID="4bb487ee2b53474828e5aba868c5f5e45c4a280235d0c0b26c91fa12ce0a6405"
Jul 16 22:00:22.421244 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:22.421221    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-75994_odh-ai-gateway-infra(4e633c90-fe70-4fdf-a417-9597a6863ec3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3"
Jul 16 22:00:23.371756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.371721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:23.449179 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.449141    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:23.599791 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.599762    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:23.642150 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.642049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca\") pod \"4e633c90-fe70-4fdf-a417-9597a6863ec3\" (UID: \"4e633c90-fe70-4fdf-a417-9597a6863ec3\") "
Jul 16 22:00:23.642388 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.642356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e633c90-fe70-4fdf-a417-9597a6863ec3" (UID: "4e633c90-fe70-4fdf-a417-9597a6863ec3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:23.742957 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:23.742927    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e633c90-fe70-4fdf-a417-9597a6863ec3-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:24.441637 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:24.441606    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"
Jul 16 22:00:24.441637 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:24.441622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994" event={"ID":"4e633c90-fe70-4fdf-a417-9597a6863ec3","Type":"ContainerDied","Data":"121b220b89b50ca392455c19562322e912e1f872d5a1b771880fa14683bf4db0"}
Jul 16 22:00:24.442143 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:24.441714    2559 scope.go:117] "RemoveContainer" containerID="4bb487ee2b53474828e5aba868c5f5e45c4a280235d0c0b26c91fa12ce0a6405"
Jul 16 22:00:24.462444 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:24.462416    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:24.468516 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:24.468495    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-75994"]
Jul 16 22:00:25.678750 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:25.678720    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" path="/var/lib/kubelet/pods/4e633c90-fe70-4fdf-a417-9597a6863ec3/volumes"
Jul 16 22:00:29.609799 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:29.609768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:31.279755 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:31.279710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:33.672897 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:33.672867    2559 scope.go:117] "RemoveContainer" containerID="1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc"
Jul 16 22:00:34.057745 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.057706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:34.309142 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.309046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:34.497341 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.497309    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerID="9a96e36e189742b2f27d07d5107c00414de13f9e1d29d1866b0150b89638822c" exitCode=6
Jul 16 22:00:34.497501 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.497379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerDied","Data":"9a96e36e189742b2f27d07d5107c00414de13f9e1d29d1866b0150b89638822c"}
Jul 16 22:00:34.497501 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.497437    2559 scope.go:117] "RemoveContainer" containerID="1c8c34f752591c2fe4a211c4057decd67ac60494380fbcee82b1fc21d37f7bbc"
Jul 16 22:00:34.497752 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.497736    2559 scope.go:117] "RemoveContainer" containerID="9a96e36e189742b2f27d07d5107c00414de13f9e1d29d1866b0150b89638822c"
Jul 16 22:00:34.497972 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:34.497952    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq_odh-ai-gateway-infra(aa43ca1b-a01d-4b4a-aff1-473d08844c09)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09"
Jul 16 22:00:34.608589 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.608528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:34.874299 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874184    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:00:34.874864 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874845    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.874905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874869    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.874905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874882    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:34.874905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874891    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:34.874996 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874909    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.874996 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.874918    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.875065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.875004    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="de5d9bf5-3a6b-4cb7-bc55-5a9cb3d39506" containerName="istio-proxy"
Jul 16 22:00:34.875065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.875015    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.875065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.875026    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.875065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.875034    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:34.875065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.875047    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15767d4-4374-4475-8fa0-3b7891f6db7c" containerName="revoke-keys"
Jul 16 22:00:34.879766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.879746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.883122 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.883104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2140ea-openshift-default-dockercfg-h2w9c\""
Jul 16 22:00:34.890224 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.890195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:00:34.905660 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.905637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:34.939831 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.939809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.939970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.939848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.939970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.939870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.939970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.939940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.939970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.939964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.940192 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.940005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.940192 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.940026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.940192 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.940064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:34.940192 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:34.940112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041226 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041226 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041484 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.041967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.041888    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.042276 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.042252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.043881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.043847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.043979 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.043911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.051405 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.051381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.051514 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.051487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token\") pod \"e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") " pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.088058 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.088035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:35.191615 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.191534    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:35.352601 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:35.352566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f73d42d_f469_4167_b27c_bf6ddccfefc5.slice/crio-e1aa8996e6df36465884d115e8f001731df22aa4060a41c6ef082443cdc90fdb WatchSource:0}: Error finding container e1aa8996e6df36465884d115e8f001731df22aa4060a41c6ef082443cdc90fdb: Status 404 returned error can't find the container with id e1aa8996e6df36465884d115e8f001731df22aa4060a41c6ef082443cdc90fdb
Jul 16 22:00:35.353118 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.353067    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:00:35.355552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.355511    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:35.355667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.355595    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:35.355667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.355636    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:35.505685 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.505643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerStarted","Data":"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"}
Jul 16 22:00:35.505904 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.505702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerStarted","Data":"e1aa8996e6df36465884d115e8f001731df22aa4060a41c6ef082443cdc90fdb"}
Jul 16 22:00:35.529401 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.529356    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:35.532438 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.532383    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podStartSLOduration=1.532365406 podStartE2EDuration="1.532365406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:35.528554541 +0000 UTC m=+3098.379171919" watchObservedRunningTime="2026-07-16 22:00:35.532365406 +0000 UTC m=+3098.382982783"
Jul 16 22:00:35.678607 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.678572    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:35.749506 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.749474    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca\") pod \"aa43ca1b-a01d-4b4a-aff1-473d08844c09\" (UID: \"aa43ca1b-a01d-4b4a-aff1-473d08844c09\") "
Jul 16 22:00:35.749843 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.749825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa43ca1b-a01d-4b4a-aff1-473d08844c09" (UID: "aa43ca1b-a01d-4b4a-aff1-473d08844c09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:00:35.850703 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:35.850630    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa43ca1b-a01d-4b4a-aff1-473d08844c09-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:00:36.192042 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.191970    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:36.197139 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.197116    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:36.514758 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.514734    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"
Jul 16 22:00:36.514923 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.514776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq" event={"ID":"aa43ca1b-a01d-4b4a-aff1-473d08844c09","Type":"ContainerDied","Data":"492b2af67e1ebba2667e2863e51a2f5d666db254abf38fa65ad63bb743b31310"}
Jul 16 22:00:36.514923 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.514840    2559 scope.go:117] "RemoveContainer" containerID="9a96e36e189742b2f27d07d5107c00414de13f9e1d29d1866b0150b89638822c"
Jul 16 22:00:36.515144 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.515120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:36.516230 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.516148    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:36.558125 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.558078    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:36.565220 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:36.565194    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-7sbpq"]
Jul 16 22:00:37.529859 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:37.529812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:37.636142 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:37.636105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:37.679509 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:37.679477    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" path="/var/lib/kubelet/pods/aa43ca1b-a01d-4b4a-aff1-473d08844c09/volumes"
Jul 16 22:00:37.729565 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:37.729539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:37.837296 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:37.837195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:38.387130 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:38.387071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:38.457439 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:38.457398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:40.563360 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:40.563323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:40.665551 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:40.665517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:41.922810 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:41.922775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:42.237874 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:42.237843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:42.554065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:42.553984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:42.854440 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:42.854344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:45.719615 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:45.719582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:45.860438 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:45.860407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:45.964557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:45.964523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:46.120555 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.120467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:46.301515 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.301481    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:00:46.301963 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.301944    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:46.302019 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.301968    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e633c90-fe70-4fdf-a417-9597a6863ec3" containerName="revoke-keys"
Jul 16 22:00:46.302019 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.301997    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302019 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302007    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302175 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302034    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302175 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302043    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302175 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302147    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302175 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302158    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.302175 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.302164    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:46.306509 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.306489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:00:46.309560 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.309540    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:00:46.313118 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.313076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:00:46.468364 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.468324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l\" (UID: \"a2a74c2d-c06d-432e-a214-8a559a72dadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:00:46.513850 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.513820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:46.569499 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.569465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l\" (UID: \"a2a74c2d-c06d-432e-a214-8a559a72dadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:00:46.570664 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.570632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l\" (UID: \"a2a74c2d-c06d-432e-a214-8a559a72dadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:00:46.612605 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.612569    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:46.620166 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.620146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:00:46.823272 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:46.823188    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:00:46.824950 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:46.824924    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a74c2d_c06d_432e_a214_8a559a72dadd.slice/crio-c8d3b8bdfcf62eb99324780f18c895c2d8296cbd4998bf8ace12c05463aefc40 WatchSource:0}: Error finding container c8d3b8bdfcf62eb99324780f18c895c2d8296cbd4998bf8ace12c05463aefc40: Status 404 returned error can't find the container with id c8d3b8bdfcf62eb99324780f18c895c2d8296cbd4998bf8ace12c05463aefc40
Jul 16 22:00:47.486757 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.486716    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:00:47.487200 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.487185    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:47.487200 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.487201    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa43ca1b-a01d-4b4a-aff1-473d08844c09" containerName="revoke-keys"
Jul 16 22:00:47.490404 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.490387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:00:47.505304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.501555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:00:47.586421 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.586388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6\" (UID: \"1195d9de-e112-4f03-973a-934215b692ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:00:47.587507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.587483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerStarted","Data":"614b6cd101605f40e13c5d19b79e489c1937678cfb63313c4d7d845c0c303230"}
Jul 16 22:00:47.587553 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.587533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerStarted","Data":"c8d3b8bdfcf62eb99324780f18c895c2d8296cbd4998bf8ace12c05463aefc40"}
Jul 16 22:00:47.606390 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.606342    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" podStartSLOduration=1.606328526 podStartE2EDuration="1.606328526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:47.604248471 +0000 UTC m=+3110.454865848" watchObservedRunningTime="2026-07-16 22:00:47.606328526 +0000 UTC m=+3110.456945902"
Jul 16 22:00:47.687576 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.687542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6\" (UID: \"1195d9de-e112-4f03-973a-934215b692ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:00:47.688079 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.688060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6\" (UID: \"1195d9de-e112-4f03-973a-934215b692ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:00:47.807615 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:47.807586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:00:48.006340 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.006228    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:00:48.006340 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:00:48.006237    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1195d9de_e112_4f03_973a_934215b692ea.slice/crio-b8e4d3af994bb9d483d2fbe0e940ea56f33ffc4b0c792a3aa246771940fc3e6e WatchSource:0}: Error finding container b8e4d3af994bb9d483d2fbe0e940ea56f33ffc4b0c792a3aa246771940fc3e6e: Status 404 returned error can't find the container with id b8e4d3af994bb9d483d2fbe0e940ea56f33ffc4b0c792a3aa246771940fc3e6e
Jul 16 22:00:48.594862 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.594823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerStarted","Data":"f8b2ec3dbd4e4dddfa27eb3276c595777e4eea2707a99a6fd4b2b5d51621d753"}
Jul 16 22:00:48.595020 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.594884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerStarted","Data":"b8e4d3af994bb9d483d2fbe0e940ea56f33ffc4b0c792a3aa246771940fc3e6e"}
Jul 16 22:00:48.596371 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.596337    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerID="614b6cd101605f40e13c5d19b79e489c1937678cfb63313c4d7d845c0c303230" exitCode=6
Jul 16 22:00:48.596486 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.596382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerDied","Data":"614b6cd101605f40e13c5d19b79e489c1937678cfb63313c4d7d845c0c303230"}
Jul 16 22:00:48.596569 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.596558    2559 scope.go:117] "RemoveContainer" containerID="614b6cd101605f40e13c5d19b79e489c1937678cfb63313c4d7d845c0c303230"
Jul 16 22:00:48.613446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:48.613392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" podStartSLOduration=1.6133718240000001 podStartE2EDuration="1.613371824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:48.612439695 +0000 UTC m=+3111.463057073" watchObservedRunningTime="2026-07-16 22:00:48.613371824 +0000 UTC m=+3111.463989201"
Jul 16 22:00:49.604388 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.604348    2559 generic.go:356] "Generic (PLEG): container finished" podID="1195d9de-e112-4f03-973a-934215b692ea" containerID="f8b2ec3dbd4e4dddfa27eb3276c595777e4eea2707a99a6fd4b2b5d51621d753" exitCode=6
Jul 16 22:00:49.604837 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.604434    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerDied","Data":"f8b2ec3dbd4e4dddfa27eb3276c595777e4eea2707a99a6fd4b2b5d51621d753"}
Jul 16 22:00:49.604837 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.604665    2559 scope.go:117] "RemoveContainer" containerID="f8b2ec3dbd4e4dddfa27eb3276c595777e4eea2707a99a6fd4b2b5d51621d753"
Jul 16 22:00:49.606683 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.606661    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerID="af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987" exitCode=6
Jul 16 22:00:49.606821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.606728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerDied","Data":"af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987"}
Jul 16 22:00:49.606821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.606793    2559 scope.go:117] "RemoveContainer" containerID="614b6cd101605f40e13c5d19b79e489c1937678cfb63313c4d7d845c0c303230"
Jul 16 22:00:49.607047 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:49.607029    2559 scope.go:117] "RemoveContainer" containerID="af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987"
Jul 16 22:00:49.607349 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:49.607300    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l_odh-ai-gateway-infra(a2a74c2d-c06d-432e-a214-8a559a72dadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd"
Jul 16 22:00:50.181141 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.181035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:50.615187 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.615153    2559 generic.go:356] "Generic (PLEG): container finished" podID="1195d9de-e112-4f03-973a-934215b692ea" containerID="5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004" exitCode=6
Jul 16 22:00:50.615632 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.615244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerDied","Data":"5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004"}
Jul 16 22:00:50.615632 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.615318    2559 scope.go:117] "RemoveContainer" containerID="f8b2ec3dbd4e4dddfa27eb3276c595777e4eea2707a99a6fd4b2b5d51621d753"
Jul 16 22:00:50.615632 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.615560    2559 scope.go:117] "RemoveContainer" containerID="5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004"
Jul 16 22:00:50.615818 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:50.615797    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6_odh-ai-gateway-infra(1195d9de-e112-4f03-973a-934215b692ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" podUID="1195d9de-e112-4f03-973a-934215b692ea"
Jul 16 22:00:50.617351 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:50.617333    2559 scope.go:117] "RemoveContainer" containerID="af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987"
Jul 16 22:00:50.617503 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:50.617487    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l_odh-ai-gateway-infra(a2a74c2d-c06d-432e-a214-8a559a72dadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd"
Jul 16 22:00:51.551140 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.550770    2559 patch_prober.go:28] interesting pod/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": read tcp 10.132.0.2:51860->10.132.0.91:15021: read: connection reset by peer" start-of-body=
Jul 16 22:00:51.551140 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.550840    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": read tcp 10.132.0.2:51860->10.132.0.91:15021: read: connection reset by peer"
Jul 16 22:00:51.624045 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.624017    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerID="53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b" exitCode=0
Jul 16 22:00:51.624487 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.624123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerDied","Data":"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"}
Jul 16 22:00:51.624567 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.624549    2559 scope.go:117] "RemoveContainer" containerID="53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"
Jul 16 22:00:51.625662 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.625631    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:51.625773 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.625721    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:51.625833 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.625793    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:00:51.626181 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:51.626153    2559 scope.go:117] "RemoveContainer" containerID="5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004"
Jul 16 22:00:51.626337 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:00:51.626317    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6_odh-ai-gateway-infra(1195d9de-e112-4f03-973a-934215b692ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" podUID="1195d9de-e112-4f03-973a-934215b692ea"
Jul 16 22:00:52.638195 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:52.638156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerStarted","Data":"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"}
Jul 16 22:00:53.191991 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:53.191956    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:53.192227 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:53.192187    2559 patch_prober.go:28] interesting pod/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 16 22:00:53.192319 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:53.192253    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 16 22:00:54.192260 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:54.192228    2559 patch_prober.go:28] interesting pod/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 16 22:00:54.192651 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:54.192310    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 16 22:00:55.192072 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:55.192038    2559 patch_prober.go:28] interesting pod/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 16 22:00:55.192328 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:55.192115    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 16 22:00:56.192813 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:56.192776    2559 patch_prober.go:28] interesting pod/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Jul 16 22:00:56.193269 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:56.192841    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Jul 16 22:00:57.195686 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:57.195658    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:57.196114 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:57.196050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:57.196778 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:57.196759    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:00:59.173546 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:59.173511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:00:59.273451 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:00:59.273417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:03.919855 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:03.919819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:03.924836 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:03.924819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:03.931173 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:03.931144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:04.036362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.036331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr\" (UID: \"802f1109-1893-42a8-8d73-679b0abb629f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:04.137168 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.137131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr\" (UID: \"802f1109-1893-42a8-8d73-679b0abb629f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:04.137704 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.137686    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr\" (UID: \"802f1109-1893-42a8-8d73-679b0abb629f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:04.238240 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.238208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:04.588261 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.588233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:04.589777 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:01:04.589753    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802f1109_1893_42a8_8d73_679b0abb629f.slice/crio-e6056644275b4cb244188496e60fdc16280b5b43e8b59d199871d86a04505cf8 WatchSource:0}: Error finding container e6056644275b4cb244188496e60fdc16280b5b43e8b59d199871d86a04505cf8: Status 404 returned error can't find the container with id e6056644275b4cb244188496e60fdc16280b5b43e8b59d199871d86a04505cf8
Jul 16 22:01:04.704442 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:04.704411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" event={"ID":"802f1109-1893-42a8-8d73-679b0abb629f","Type":"ContainerStarted","Data":"e6056644275b4cb244188496e60fdc16280b5b43e8b59d199871d86a04505cf8"}
Jul 16 22:01:05.672605 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:05.672578    2559 scope.go:117] "RemoveContainer" containerID="af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987"
Jul 16 22:01:05.710906 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:05.710879    2559 generic.go:356] "Generic (PLEG): container finished" podID="802f1109-1893-42a8-8d73-679b0abb629f" containerID="ad3a19dc8b10ca43c627b9061b32a7eb93f0a2f52e8b974f1ed120c60cf999e0" exitCode=6
Jul 16 22:01:05.711009 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:05.710989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" event={"ID":"802f1109-1893-42a8-8d73-679b0abb629f","Type":"ContainerDied","Data":"ad3a19dc8b10ca43c627b9061b32a7eb93f0a2f52e8b974f1ed120c60cf999e0"}
Jul 16 22:01:05.711186 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:05.711169    2559 scope.go:117] "RemoveContainer" containerID="ad3a19dc8b10ca43c627b9061b32a7eb93f0a2f52e8b974f1ed120c60cf999e0"
Jul 16 22:01:06.672532 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.672500    2559 scope.go:117] "RemoveContainer" containerID="5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004"
Jul 16 22:01:06.717899 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.717876    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerID="0a680f199e4033d4e589b487d337155d245f29be1be3e8709fae461daa113ae7" exitCode=6
Jul 16 22:01:06.718242 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.717957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerDied","Data":"0a680f199e4033d4e589b487d337155d245f29be1be3e8709fae461daa113ae7"}
Jul 16 22:01:06.718242 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.718022    2559 scope.go:117] "RemoveContainer" containerID="af1b04397e76ada964dad7340967a42fad4592844aa8dc84f878a5bb6767a987"
Jul 16 22:01:06.718378 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.718358    2559 scope.go:117] "RemoveContainer" containerID="0a680f199e4033d4e589b487d337155d245f29be1be3e8709fae461daa113ae7"
Jul 16 22:01:06.718588 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:06.718570    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l_odh-ai-gateway-infra(a2a74c2d-c06d-432e-a214-8a559a72dadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd"
Jul 16 22:01:06.719801 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.719781    2559 generic.go:356] "Generic (PLEG): container finished" podID="802f1109-1893-42a8-8d73-679b0abb629f" containerID="d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20" exitCode=6
Jul 16 22:01:06.719885 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.719861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" event={"ID":"802f1109-1893-42a8-8d73-679b0abb629f","Type":"ContainerDied","Data":"d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20"}
Jul 16 22:01:06.719998 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.719985    2559 scope.go:117] "RemoveContainer" containerID="d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20"
Jul 16 22:01:06.720164 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:06.720148    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr_odh-ai-gateway-infra(802f1109-1893-42a8-8d73-679b0abb629f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" podUID="802f1109-1893-42a8-8d73-679b0abb629f"
Jul 16 22:01:06.730361 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:06.730346    2559 scope.go:117] "RemoveContainer" containerID="ad3a19dc8b10ca43c627b9061b32a7eb93f0a2f52e8b974f1ed120c60cf999e0"
Jul 16 22:01:07.041831 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.041798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:07.547211 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.547169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:07.647124 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.647014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:07.736179 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.736148    2559 generic.go:356] "Generic (PLEG): container finished" podID="1195d9de-e112-4f03-973a-934215b692ea" containerID="bbb94a1bf87ba5deff3a0a26c6cb7b81c360ad5d05be95b1ee0cfebc40df4280" exitCode=6
Jul 16 22:01:07.736625 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.736226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerDied","Data":"bbb94a1bf87ba5deff3a0a26c6cb7b81c360ad5d05be95b1ee0cfebc40df4280"}
Jul 16 22:01:07.736625 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.736324    2559 scope.go:117] "RemoveContainer" containerID="5a7eacdd05783d0718c7ad0041f75260daeaaad049f7386ee3a980503ed7d004"
Jul 16 22:01:07.736728 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.736630    2559 scope.go:117] "RemoveContainer" containerID="bbb94a1bf87ba5deff3a0a26c6cb7b81c360ad5d05be95b1ee0cfebc40df4280"
Jul 16 22:01:07.736836 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:07.736817    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6_odh-ai-gateway-infra(1195d9de-e112-4f03-973a-934215b692ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" podUID="1195d9de-e112-4f03-973a-934215b692ea"
Jul 16 22:01:07.739794 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.739776    2559 scope.go:117] "RemoveContainer" containerID="d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20"
Jul 16 22:01:07.740007 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:07.739983    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr_odh-ai-gateway-infra(802f1109-1893-42a8-8d73-679b0abb629f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" podUID="802f1109-1893-42a8-8d73-679b0abb629f"
Jul 16 22:01:07.748881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.748854    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:01:07.901246 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.901185    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:01:07.973758 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.973730    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca\") pod \"a2a74c2d-c06d-432e-a214-8a559a72dadd\" (UID: \"a2a74c2d-c06d-432e-a214-8a559a72dadd\") "
Jul 16 22:01:07.974146 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:07.974124    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2a74c2d-c06d-432e-a214-8a559a72dadd" (UID: "a2a74c2d-c06d-432e-a214-8a559a72dadd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:08.074841 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.074807    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a74c2d-c06d-432e-a214-8a559a72dadd-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:01:08.748069 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.748034    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"
Jul 16 22:01:08.748557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.748065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l" event={"ID":"a2a74c2d-c06d-432e-a214-8a559a72dadd","Type":"ContainerDied","Data":"c8d3b8bdfcf62eb99324780f18c895c2d8296cbd4998bf8ace12c05463aefc40"}
Jul 16 22:01:08.748557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.748158    2559 scope.go:117] "RemoveContainer" containerID="0a680f199e4033d4e589b487d337155d245f29be1be3e8709fae461daa113ae7"
Jul 16 22:01:08.767707 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.767680    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:01:08.778823 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.778798    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:01:08.784174 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.784148    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-dmj2l"]
Jul 16 22:01:08.912728 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.912706    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:01:08.983638 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.983604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca\") pod \"1195d9de-e112-4f03-973a-934215b692ea\" (UID: \"1195d9de-e112-4f03-973a-934215b692ea\") "
Jul 16 22:01:08.983971 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:08.983947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1195d9de-e112-4f03-973a-934215b692ea" (UID: "1195d9de-e112-4f03-973a-934215b692ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:09.085239 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.085169    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1195d9de-e112-4f03-973a-934215b692ea-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:01:09.678615 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.678584    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" path="/var/lib/kubelet/pods/a2a74c2d-c06d-432e-a214-8a559a72dadd/volumes"
Jul 16 22:01:09.755453 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.755430    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"
Jul 16 22:01:09.755872 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.755471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6" event={"ID":"1195d9de-e112-4f03-973a-934215b692ea","Type":"ContainerDied","Data":"b8e4d3af994bb9d483d2fbe0e940ea56f33ffc4b0c792a3aa246771940fc3e6e"}
Jul 16 22:01:09.755872 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.755527    2559 scope.go:117] "RemoveContainer" containerID="bbb94a1bf87ba5deff3a0a26c6cb7b81c360ad5d05be95b1ee0cfebc40df4280"
Jul 16 22:01:09.780642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.780619    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:01:09.784761 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:09.784739    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-5mbg6"]
Jul 16 22:01:11.679369 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:11.679335    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1195d9de-e112-4f03-973a-934215b692ea" path="/var/lib/kubelet/pods/1195d9de-e112-4f03-973a-934215b692ea/volumes"
Jul 16 22:01:16.010740 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.010708    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:16.011343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011323    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011346    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011363    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011372    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011384    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011391    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011404    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.011441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011412    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.011787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011526    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011538    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.011787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011547    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:16.011787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.011556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:16.016173 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.016151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:16.023189 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.023166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:16.146081 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.146041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-skfpd\" (UID: \"8c43ee46-9cf9-4106-8c37-edeae22f8ae3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:16.247497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.247458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-skfpd\" (UID: \"8c43ee46-9cf9-4106-8c37-edeae22f8ae3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:16.248127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.248077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-skfpd\" (UID: \"8c43ee46-9cf9-4106-8c37-edeae22f8ae3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:16.330064 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.329996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:16.469031 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.469007    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:16.471036 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:01:16.471000    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c43ee46_9cf9_4106_8c37_edeae22f8ae3.slice/crio-b73b857ac632e8cadb9e459bb932b60ae906243f031f862171414acdb0ad6c6e WatchSource:0}: Error finding container b73b857ac632e8cadb9e459bb932b60ae906243f031f862171414acdb0ad6c6e: Status 404 returned error can't find the container with id b73b857ac632e8cadb9e459bb932b60ae906243f031f862171414acdb0ad6c6e
Jul 16 22:01:16.795972 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.795936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerStarted","Data":"bb1dc241c4c700946f874e80e2fdbd5e6ad48927c1bcb54b58b2d067c33ff9d5"}
Jul 16 22:01:16.796168 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.796008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerStarted","Data":"b73b857ac632e8cadb9e459bb932b60ae906243f031f862171414acdb0ad6c6e"}
Jul 16 22:01:16.813116 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:16.813047    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" podStartSLOduration=1.81302641 podStartE2EDuration="1.81302641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:16.812986506 +0000 UTC m=+3139.663603884" watchObservedRunningTime="2026-07-16 22:01:16.81302641 +0000 UTC m=+3139.663643789"
Jul 16 22:01:17.802835 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:17.802802    2559 generic.go:356] "Generic (PLEG): container finished" podID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerID="bb1dc241c4c700946f874e80e2fdbd5e6ad48927c1bcb54b58b2d067c33ff9d5" exitCode=6
Jul 16 22:01:17.803241 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:17.802868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerDied","Data":"bb1dc241c4c700946f874e80e2fdbd5e6ad48927c1bcb54b58b2d067c33ff9d5"}
Jul 16 22:01:17.803241 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:17.803044    2559 scope.go:117] "RemoveContainer" containerID="bb1dc241c4c700946f874e80e2fdbd5e6ad48927c1bcb54b58b2d067c33ff9d5"
Jul 16 22:01:18.809947 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:18.809915    2559 generic.go:356] "Generic (PLEG): container finished" podID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerID="95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b" exitCode=6
Jul 16 22:01:18.810390 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:18.810002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerDied","Data":"95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b"}
Jul 16 22:01:18.810390 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:18.810061    2559 scope.go:117] "RemoveContainer" containerID="bb1dc241c4c700946f874e80e2fdbd5e6ad48927c1bcb54b58b2d067c33ff9d5"
Jul 16 22:01:18.810390 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:18.810280    2559 scope.go:117] "RemoveContainer" containerID="95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b"
Jul 16 22:01:18.810560 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:18.810542    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-skfpd_odh-ai-gateway-infra(8c43ee46-9cf9-4106-8c37-edeae22f8ae3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3"
Jul 16 22:01:19.817182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:19.817151    2559 scope.go:117] "RemoveContainer" containerID="95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b"
Jul 16 22:01:19.817569 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:19.817337    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-skfpd_odh-ai-gateway-infra(8c43ee46-9cf9-4106-8c37-edeae22f8ae3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3"
Jul 16 22:01:20.673234 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:20.673203    2559 scope.go:117] "RemoveContainer" containerID="d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20"
Jul 16 22:01:21.829792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:21.829758    2559 generic.go:356] "Generic (PLEG): container finished" podID="802f1109-1893-42a8-8d73-679b0abb629f" containerID="7a050d4cfd46ed9c4b3abd69807c9cf9dc3613645d2a162c0a47b703a892a31b" exitCode=6
Jul 16 22:01:21.830261 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:21.829817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" event={"ID":"802f1109-1893-42a8-8d73-679b0abb629f","Type":"ContainerDied","Data":"7a050d4cfd46ed9c4b3abd69807c9cf9dc3613645d2a162c0a47b703a892a31b"}
Jul 16 22:01:21.830261 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:21.829865    2559 scope.go:117] "RemoveContainer" containerID="d39a3eeb48a59d83e4a3a54b4cb9b87daf6dae56e2528523a710a1d3969cbe20"
Jul 16 22:01:21.830261 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:21.830177    2559 scope.go:117] "RemoveContainer" containerID="7a050d4cfd46ed9c4b3abd69807c9cf9dc3613645d2a162c0a47b703a892a31b"
Jul 16 22:01:21.830432 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:21.830413    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr_odh-ai-gateway-infra(802f1109-1893-42a8-8d73-679b0abb629f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" podUID="802f1109-1893-42a8-8d73-679b0abb629f"
Jul 16 22:01:22.874404 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:22.874370    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:23.017232 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.017211    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:23.111066 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.111041    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca\") pod \"802f1109-1893-42a8-8d73-679b0abb629f\" (UID: \"802f1109-1893-42a8-8d73-679b0abb629f\") "
Jul 16 22:01:23.111848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.111808    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "802f1109-1893-42a8-8d73-679b0abb629f" (UID: "802f1109-1893-42a8-8d73-679b0abb629f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:23.212271 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.212187    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/802f1109-1893-42a8-8d73-679b0abb629f-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:01:23.843711 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.843682    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"
Jul 16 22:01:23.843877 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.843676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr" event={"ID":"802f1109-1893-42a8-8d73-679b0abb629f","Type":"ContainerDied","Data":"e6056644275b4cb244188496e60fdc16280b5b43e8b59d199871d86a04505cf8"}
Jul 16 22:01:23.843877 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.843809    2559 scope.go:117] "RemoveContainer" containerID="7a050d4cfd46ed9c4b3abd69807c9cf9dc3613645d2a162c0a47b703a892a31b"
Jul 16 22:01:23.862360 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.862311    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:23.864336 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:23.864317    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-qlhjr"]
Jul 16 22:01:25.678708 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:25.678677    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="802f1109-1893-42a8-8d73-679b0abb629f" path="/var/lib/kubelet/pods/802f1109-1893-42a8-8d73-679b0abb629f/volumes"
Jul 16 22:01:31.744357 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:31.744320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:01:32.673034 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:32.673006    2559 scope.go:117] "RemoveContainer" containerID="95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b"
Jul 16 22:01:33.899153 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:33.899118    2559 generic.go:356] "Generic (PLEG): container finished" podID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerID="11c075de5fc67161d2e1eabcbced085be6443a88dc37081edeac6d58555e5521" exitCode=6
Jul 16 22:01:33.899153 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:33.899134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerDied","Data":"11c075de5fc67161d2e1eabcbced085be6443a88dc37081edeac6d58555e5521"}
Jul 16 22:01:33.899702 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:33.899197    2559 scope.go:117] "RemoveContainer" containerID="95a441cbaea1e815904936c0d23e5abc023979321039a9d9e4782bdb4e99c08b"
Jul 16 22:01:33.899702 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:33.899508    2559 scope.go:117] "RemoveContainer" containerID="11c075de5fc67161d2e1eabcbced085be6443a88dc37081edeac6d58555e5521"
Jul 16 22:01:33.899806 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:33.899763    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-skfpd_odh-ai-gateway-infra(8c43ee46-9cf9-4106-8c37-edeae22f8ae3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3"
Jul 16 22:01:34.936695 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:34.936659    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:35.101054 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.101034    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:35.117663 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.117636    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca\") pod \"8c43ee46-9cf9-4106-8c37-edeae22f8ae3\" (UID: \"8c43ee46-9cf9-4106-8c37-edeae22f8ae3\") "
Jul 16 22:01:35.117941 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.117920    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c43ee46-9cf9-4106-8c37-edeae22f8ae3" (UID: "8c43ee46-9cf9-4106-8c37-edeae22f8ae3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:01:35.218285 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.218252    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c43ee46-9cf9-4106-8c37-edeae22f8ae3-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:01:35.913503 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.913477    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"
Jul 16 22:01:35.913503 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.913493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd" event={"ID":"8c43ee46-9cf9-4106-8c37-edeae22f8ae3","Type":"ContainerDied","Data":"b73b857ac632e8cadb9e459bb932b60ae906243f031f862171414acdb0ad6c6e"}
Jul 16 22:01:35.913724 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.913555    2559 scope.go:117] "RemoveContainer" containerID="11c075de5fc67161d2e1eabcbced085be6443a88dc37081edeac6d58555e5521"
Jul 16 22:01:35.932640 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.932614    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:35.936580 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:35.936560    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-skfpd"]
Jul 16 22:01:37.679883 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:37.679851    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" path="/var/lib/kubelet/pods/8c43ee46-9cf9-4106-8c37-edeae22f8ae3/volumes"
Jul 16 22:01:46.352206 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352172    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:01:46.352671 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352638    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352671 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352652    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352671 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352661    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352671 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352667    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352682    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352687    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352696    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352708    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352721    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352726    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352732    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352737    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352743    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352828    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.352832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352835    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.353297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352844    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.353297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352849    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c43ee46-9cf9-4106-8c37-edeae22f8ae3" containerName="revoke-keys"
Jul 16 22:01:46.353297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a74c2d-c06d-432e-a214-8a559a72dadd" containerName="revoke-keys"
Jul 16 22:01:46.353297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352862    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1195d9de-e112-4f03-973a-934215b692ea" containerName="revoke-keys"
Jul 16 22:01:46.353297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.352868    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:46.356047 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.356030    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:01:46.359144 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.359123    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:01:46.364016 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.363989    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:01:46.419386 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.419358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk\" (UID: \"bcf26341-37e1-4d8e-a113-ba65a6b528c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:01:46.520149 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.520120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk\" (UID: \"bcf26341-37e1-4d8e-a113-ba65a6b528c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:01:46.520761 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.520739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk\" (UID: \"bcf26341-37e1-4d8e-a113-ba65a6b528c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:01:46.667479 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.667390    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:01:46.811544 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.811511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:01:46.814630 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:01:46.814603    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf26341_37e1_4d8e_a113_ba65a6b528c4.slice/crio-3f904655b6035e75e63da0613ab5f1cdabbe263cfda8f75d3814c1fc8cace871 WatchSource:0}: Error finding container 3f904655b6035e75e63da0613ab5f1cdabbe263cfda8f75d3814c1fc8cace871: Status 404 returned error can't find the container with id 3f904655b6035e75e63da0613ab5f1cdabbe263cfda8f75d3814c1fc8cace871
Jul 16 22:01:46.975690 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:46.975655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerStarted","Data":"3f904655b6035e75e63da0613ab5f1cdabbe263cfda8f75d3814c1fc8cace871"}
Jul 16 22:01:47.558341 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.558312    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:01:47.559054 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.559036    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="802f1109-1893-42a8-8d73-679b0abb629f" containerName="revoke-keys"
Jul 16 22:01:47.562522 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.562503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:01:47.568936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.568914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:01:47.629434 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.629403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd\" (UID: \"46ab8bca-1c45-49aa-9ffa-52927c3b0b41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:01:47.730393 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.730363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd\" (UID: \"46ab8bca-1c45-49aa-9ffa-52927c3b0b41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:01:47.730924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.730907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd\" (UID: \"46ab8bca-1c45-49aa-9ffa-52927c3b0b41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:01:47.915617 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.915552    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:01:47.982959 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.982928    2559 generic.go:356] "Generic (PLEG): container finished" podID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerID="f49294caaa2eb47bc2f204879657068848d3595f8db3daf933a622d6c0bbb66d" exitCode=6
Jul 16 22:01:47.983114 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.982997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerDied","Data":"f49294caaa2eb47bc2f204879657068848d3595f8db3daf933a622d6c0bbb66d"}
Jul 16 22:01:47.983213 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:47.983201    2559 scope.go:117] "RemoveContainer" containerID="f49294caaa2eb47bc2f204879657068848d3595f8db3daf933a622d6c0bbb66d"
Jul 16 22:01:48.056283 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.056249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:01:48.057040 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:01:48.057015    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ab8bca_1c45_49aa_9ffa_52927c3b0b41.slice/crio-3ca8151f83b3bc18f548fb497c77460fbe6748e1cbf787f2dc3c1eabe1d7a9ff WatchSource:0}: Error finding container 3ca8151f83b3bc18f548fb497c77460fbe6748e1cbf787f2dc3c1eabe1d7a9ff: Status 404 returned error can't find the container with id 3ca8151f83b3bc18f548fb497c77460fbe6748e1cbf787f2dc3c1eabe1d7a9ff
Jul 16 22:01:48.990242 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.990215    2559 generic.go:356] "Generic (PLEG): container finished" podID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerID="f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de" exitCode=6
Jul 16 22:01:48.990630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.990310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerDied","Data":"f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de"}
Jul 16 22:01:48.990630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.990369    2559 scope.go:117] "RemoveContainer" containerID="f49294caaa2eb47bc2f204879657068848d3595f8db3daf933a622d6c0bbb66d"
Jul 16 22:01:48.990630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.990483    2559 scope.go:117] "RemoveContainer" containerID="f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de"
Jul 16 22:01:48.990793 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:48.990713    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk_odh-ai-gateway-infra(bcf26341-37e1-4d8e-a113-ba65a6b528c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4"
Jul 16 22:01:48.991875 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.991856    2559 generic.go:356] "Generic (PLEG): container finished" podID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerID="e945d5016a181081a6d8de8fbcdb6d69f9eda643ed4b4e2db88acc4c8fa78eb7" exitCode=6
Jul 16 22:01:48.991956 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.991882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerDied","Data":"e945d5016a181081a6d8de8fbcdb6d69f9eda643ed4b4e2db88acc4c8fa78eb7"}
Jul 16 22:01:48.991956 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.991927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerStarted","Data":"3ca8151f83b3bc18f548fb497c77460fbe6748e1cbf787f2dc3c1eabe1d7a9ff"}
Jul 16 22:01:48.992153 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:48.992137    2559 scope.go:117] "RemoveContainer" containerID="e945d5016a181081a6d8de8fbcdb6d69f9eda643ed4b4e2db88acc4c8fa78eb7"
Jul 16 22:01:49.998992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:49.998962    2559 scope.go:117] "RemoveContainer" containerID="f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de"
Jul 16 22:01:49.999401 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:49.999185    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk_odh-ai-gateway-infra(bcf26341-37e1-4d8e-a113-ba65a6b528c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4"
Jul 16 22:01:50.000585 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:50.000561    2559 generic.go:356] "Generic (PLEG): container finished" podID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerID="95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39" exitCode=6
Jul 16 22:01:50.000696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:50.000644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerDied","Data":"95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39"}
Jul 16 22:01:50.000696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:50.000682    2559 scope.go:117] "RemoveContainer" containerID="e945d5016a181081a6d8de8fbcdb6d69f9eda643ed4b4e2db88acc4c8fa78eb7"
Jul 16 22:01:50.000896 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:50.000877    2559 scope.go:117] "RemoveContainer" containerID="95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39"
Jul 16 22:01:50.001125 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:50.001104    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd_odh-ai-gateway-infra(46ab8bca-1c45-49aa-9ffa-52927c3b0b41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41"
Jul 16 22:01:51.007617 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:51.007588    2559 scope.go:117] "RemoveContainer" containerID="95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39"
Jul 16 22:01:51.008015 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:51.007836    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd_odh-ai-gateway-infra(46ab8bca-1c45-49aa-9ffa-52927c3b0b41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41"
Jul 16 22:01:53.964749 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:53.964716    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:01:53.969588 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:53.969569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:01:53.975616 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:53.975586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:01:54.083584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:54.083552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz\" (UID: \"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:01:54.184976 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:54.184951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz\" (UID: \"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:01:54.185568 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:54.185548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz\" (UID: \"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:01:54.282180 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:54.282103    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:01:54.421685 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:54.421661    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:01:54.423714 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:01:54.423686    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed507b1_0148_4bf0_b4f0_62ac88a54bfd.slice/crio-4b9ad079bc5d6ba8f09037b3923cb1988a1ebf58fcb3cf7ff034e31c3bf5d348 WatchSource:0}: Error finding container 4b9ad079bc5d6ba8f09037b3923cb1988a1ebf58fcb3cf7ff034e31c3bf5d348: Status 404 returned error can't find the container with id 4b9ad079bc5d6ba8f09037b3923cb1988a1ebf58fcb3cf7ff034e31c3bf5d348
Jul 16 22:01:55.030110 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:55.030058    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerStarted","Data":"19d259c389430fb3586ee8aca90b5630192745f6d158ea1b22e60fa9f9fe6263"}
Jul 16 22:01:55.030498 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:55.030134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerStarted","Data":"4b9ad079bc5d6ba8f09037b3923cb1988a1ebf58fcb3cf7ff034e31c3bf5d348"}
Jul 16 22:01:55.052492 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:55.052441    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" podStartSLOduration=2.05242093 podStartE2EDuration="2.05242093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:01:55.049906774 +0000 UTC m=+3177.900524152" watchObservedRunningTime="2026-07-16 22:01:55.05242093 +0000 UTC m=+3177.903038306"
Jul 16 22:01:56.037531 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:56.037490    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerID="19d259c389430fb3586ee8aca90b5630192745f6d158ea1b22e60fa9f9fe6263" exitCode=6
Jul 16 22:01:56.037918 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:56.037540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerDied","Data":"19d259c389430fb3586ee8aca90b5630192745f6d158ea1b22e60fa9f9fe6263"}
Jul 16 22:01:56.037918 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:56.037757    2559 scope.go:117] "RemoveContainer" containerID="19d259c389430fb3586ee8aca90b5630192745f6d158ea1b22e60fa9f9fe6263"
Jul 16 22:01:57.045631 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:57.045600    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerID="4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08" exitCode=6
Jul 16 22:01:57.046056 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:57.045696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerDied","Data":"4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08"}
Jul 16 22:01:57.046056 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:57.045758    2559 scope.go:117] "RemoveContainer" containerID="19d259c389430fb3586ee8aca90b5630192745f6d158ea1b22e60fa9f9fe6263"
Jul 16 22:01:57.046056 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:57.045967    2559 scope.go:117] "RemoveContainer" containerID="4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08"
Jul 16 22:01:57.046227 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:57.046192    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz_odh-ai-gateway-infra(1ed507b1-0148-4bf0-b4f0-62ac88a54bfd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd"
Jul 16 22:01:58.060663 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:01:58.060631    2559 scope.go:117] "RemoveContainer" containerID="4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08"
Jul 16 22:01:58.061143 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:01:58.060794    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz_odh-ai-gateway-infra(1ed507b1-0148-4bf0-b4f0-62ac88a54bfd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd"
Jul 16 22:02:00.672834 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:00.672799    2559 scope.go:117] "RemoveContainer" containerID="f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de"
Jul 16 22:02:01.078592 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:01.078560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerStarted","Data":"2034533c8ae146968873d2db1595967c3db2deb0ae16f32748fb628819014ebb"}
Jul 16 22:02:01.096289 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:01.096237    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" podStartSLOduration=15.096223132 podStartE2EDuration="15.096223132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:02:01.095507591 +0000 UTC m=+3183.946124967" watchObservedRunningTime="2026-07-16 22:02:01.096223132 +0000 UTC m=+3183.946840509"
Jul 16 22:02:02.085439 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:02.085405    2559 generic.go:356] "Generic (PLEG): container finished" podID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerID="2034533c8ae146968873d2db1595967c3db2deb0ae16f32748fb628819014ebb" exitCode=6
Jul 16 22:02:02.085888 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:02.085479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerDied","Data":"2034533c8ae146968873d2db1595967c3db2deb0ae16f32748fb628819014ebb"}
Jul 16 22:02:02.085888 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:02.085542    2559 scope.go:117] "RemoveContainer" containerID="f18ae5063550818dda8b03be6d4af8eb215d72b603f60492c387aa957ecb72de"
Jul 16 22:02:02.085888 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:02.085744    2559 scope.go:117] "RemoveContainer" containerID="2034533c8ae146968873d2db1595967c3db2deb0ae16f32748fb628819014ebb"
Jul 16 22:02:02.086018 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:02.085972    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk_odh-ai-gateway-infra(bcf26341-37e1-4d8e-a113-ba65a6b528c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4"
Jul 16 22:02:02.113036 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:02.113012    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:02:03.240924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:03.240897    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:02:03.373925 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:03.373848    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca\") pod \"bcf26341-37e1-4d8e-a113-ba65a6b528c4\" (UID: \"bcf26341-37e1-4d8e-a113-ba65a6b528c4\") "
Jul 16 22:02:03.374253 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:03.374231    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bcf26341-37e1-4d8e-a113-ba65a6b528c4" (UID: "bcf26341-37e1-4d8e-a113-ba65a6b528c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:03.474480 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:03.474452    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcf26341-37e1-4d8e-a113-ba65a6b528c4-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:03.678965 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:03.678894    2559 scope.go:117] "RemoveContainer" containerID="95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39"
Jul 16 22:02:04.100613 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.100584    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"
Jul 16 22:02:04.100613 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.100601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk" event={"ID":"bcf26341-37e1-4d8e-a113-ba65a6b528c4","Type":"ContainerDied","Data":"3f904655b6035e75e63da0613ab5f1cdabbe263cfda8f75d3814c1fc8cace871"}
Jul 16 22:02:04.100854 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.100672    2559 scope.go:117] "RemoveContainer" containerID="2034533c8ae146968873d2db1595967c3db2deb0ae16f32748fb628819014ebb"
Jul 16 22:02:04.102921 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.102886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerStarted","Data":"ac85471994854747f156e655a247798c21a6e35e3541a18bfffe7c64c59020a9"}
Jul 16 22:02:04.130244 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.130201    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" podStartSLOduration=17.130189057 podStartE2EDuration="17.130189057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:02:04.128117861 +0000 UTC m=+3186.978735240" watchObservedRunningTime="2026-07-16 22:02:04.130189057 +0000 UTC m=+3186.980806434"
Jul 16 22:02:04.143722 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.143697    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:02:04.147715 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:04.147690    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdclk"]
Jul 16 22:02:05.110586 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.110553    2559 generic.go:356] "Generic (PLEG): container finished" podID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerID="ac85471994854747f156e655a247798c21a6e35e3541a18bfffe7c64c59020a9" exitCode=6
Jul 16 22:02:05.111030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.110621    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerDied","Data":"ac85471994854747f156e655a247798c21a6e35e3541a18bfffe7c64c59020a9"}
Jul 16 22:02:05.111030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.110675    2559 scope.go:117] "RemoveContainer" containerID="95ae4f0c7d8230cc742c726bb5fad474e81b04081f9d1a1779e2dfb2b683cf39"
Jul 16 22:02:05.111030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.110912    2559 scope.go:117] "RemoveContainer" containerID="ac85471994854747f156e655a247798c21a6e35e3541a18bfffe7c64c59020a9"
Jul 16 22:02:05.111187 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:05.111165    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd_odh-ai-gateway-infra(46ab8bca-1c45-49aa-9ffa-52927c3b0b41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41"
Jul 16 22:02:05.137712 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.137689    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:02:05.679282 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:05.679245    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" path="/var/lib/kubelet/pods/bcf26341-37e1-4d8e-a113-ba65a6b528c4/volumes"
Jul 16 22:02:06.059648 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.059621    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:06.060043 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060030    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060124 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060045    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060124 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060069    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060124 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060074    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060224 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060179    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060224 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060188    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.060224 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.060196    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:06.064558 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.064542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:06.071669 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.071643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:06.199968 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.199937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7\" (UID: \"8a479278-d968-43b5-b4e3-a00655dcb80d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:06.261437 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.261414    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:02:06.300899 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.300870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7\" (UID: \"8a479278-d968-43b5-b4e3-a00655dcb80d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:06.301506 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.301484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7\" (UID: \"8a479278-d968-43b5-b4e3-a00655dcb80d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:06.376699 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.376622    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:06.401874 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.401846    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca\") pod \"46ab8bca-1c45-49aa-9ffa-52927c3b0b41\" (UID: \"46ab8bca-1c45-49aa-9ffa-52927c3b0b41\") "
Jul 16 22:02:06.402195 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.402173    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46ab8bca-1c45-49aa-9ffa-52927c3b0b41" (UID: "46ab8bca-1c45-49aa-9ffa-52927c3b0b41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:06.503559 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.503517    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ab8bca-1c45-49aa-9ffa-52927c3b0b41-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:06.517543 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:06.517515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:06.517917 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:06.517890    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a479278_d968_43b5_b4e3_a00655dcb80d.slice/crio-4d2e785def69dba87486aa76d51d7d4b935f7348219ddf91de80f6e6d3df14ce WatchSource:0}: Error finding container 4d2e785def69dba87486aa76d51d7d4b935f7348219ddf91de80f6e6d3df14ce: Status 404 returned error can't find the container with id 4d2e785def69dba87486aa76d51d7d4b935f7348219ddf91de80f6e6d3df14ce
Jul 16 22:02:07.123247 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.123167    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"
Jul 16 22:02:07.123247 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.123182    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd" event={"ID":"46ab8bca-1c45-49aa-9ffa-52927c3b0b41","Type":"ContainerDied","Data":"3ca8151f83b3bc18f548fb497c77460fbe6748e1cbf787f2dc3c1eabe1d7a9ff"}
Jul 16 22:02:07.123247 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.123244    2559 scope.go:117] "RemoveContainer" containerID="ac85471994854747f156e655a247798c21a6e35e3541a18bfffe7c64c59020a9"
Jul 16 22:02:07.124932 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.124905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerStarted","Data":"234cfbeb0575012cdb8b0d1b0dfa761fa9546de9d5a970f42ba2e3b6ef98c293"}
Jul 16 22:02:07.125077 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.124952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerStarted","Data":"4d2e785def69dba87486aa76d51d7d4b935f7348219ddf91de80f6e6d3df14ce"}
Jul 16 22:02:07.149992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.149938    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" podStartSLOduration=1.149925399 podStartE2EDuration="1.149925399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:02:07.147457752 +0000 UTC m=+3189.998075129" watchObservedRunningTime="2026-07-16 22:02:07.149925399 +0000 UTC m=+3190.000542776"
Jul 16 22:02:07.171084 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.171060    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:02:07.177629 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.177607    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-fntvd"]
Jul 16 22:02:07.685388 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:07.685357    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" path="/var/lib/kubelet/pods/46ab8bca-1c45-49aa-9ffa-52927c3b0b41/volumes"
Jul 16 22:02:08.132746 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:08.132715    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerID="234cfbeb0575012cdb8b0d1b0dfa761fa9546de9d5a970f42ba2e3b6ef98c293" exitCode=6
Jul 16 22:02:08.132942 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:08.132809    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerDied","Data":"234cfbeb0575012cdb8b0d1b0dfa761fa9546de9d5a970f42ba2e3b6ef98c293"}
Jul 16 22:02:08.133010 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:08.132966    2559 scope.go:117] "RemoveContainer" containerID="234cfbeb0575012cdb8b0d1b0dfa761fa9546de9d5a970f42ba2e3b6ef98c293"
Jul 16 22:02:09.140731 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:09.140653    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerID="f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c" exitCode=6
Jul 16 22:02:09.141164 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:09.140741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerDied","Data":"f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c"}
Jul 16 22:02:09.141164 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:09.140808    2559 scope.go:117] "RemoveContainer" containerID="234cfbeb0575012cdb8b0d1b0dfa761fa9546de9d5a970f42ba2e3b6ef98c293"
Jul 16 22:02:09.141164 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:09.140889    2559 scope.go:117] "RemoveContainer" containerID="f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c"
Jul 16 22:02:09.141164 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:09.141075    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7_odh-ai-gateway-infra(8a479278-d968-43b5-b4e3-a00655dcb80d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d"
Jul 16 22:02:10.147646 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:10.147616    2559 scope.go:117] "RemoveContainer" containerID="f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c"
Jul 16 22:02:10.148160 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:10.147813    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7_odh-ai-gateway-infra(8a479278-d968-43b5-b4e3-a00655dcb80d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d"
Jul 16 22:02:10.672696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:10.672667    2559 scope.go:117] "RemoveContainer" containerID="4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08"
Jul 16 22:02:11.156766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:11.156730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerStarted","Data":"045c048a8ab1075762a6de5411f798459e33a6fc7ede9f98f31e188badb841bf"}
Jul 16 22:02:12.164681 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:12.164653    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerID="045c048a8ab1075762a6de5411f798459e33a6fc7ede9f98f31e188badb841bf" exitCode=6
Jul 16 22:02:12.165127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:12.164728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerDied","Data":"045c048a8ab1075762a6de5411f798459e33a6fc7ede9f98f31e188badb841bf"}
Jul 16 22:02:12.165127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:12.164788    2559 scope.go:117] "RemoveContainer" containerID="4a92ccf6044f1d8c1fd6d64fd67c5c86807335bf9c787f782b0500afe74dea08"
Jul 16 22:02:12.165127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:12.165016    2559 scope.go:117] "RemoveContainer" containerID="045c048a8ab1075762a6de5411f798459e33a6fc7ede9f98f31e188badb841bf"
Jul 16 22:02:12.165283 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:12.165239    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz_odh-ai-gateway-infra(1ed507b1-0148-4bf0-b4f0-62ac88a54bfd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd"
Jul 16 22:02:12.183444 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:12.183425    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:02:13.310462 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:13.310436    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:02:13.466869 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:13.466840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca\") pod \"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd\" (UID: \"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd\") "
Jul 16 22:02:13.467233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:13.467209    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" (UID: "1ed507b1-0148-4bf0-b4f0-62ac88a54bfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:13.567875 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:13.567843    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:14.177900 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:14.177863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz" event={"ID":"1ed507b1-0148-4bf0-b4f0-62ac88a54bfd","Type":"ContainerDied","Data":"4b9ad079bc5d6ba8f09037b3923cb1988a1ebf58fcb3cf7ff034e31c3bf5d348"}
Jul 16 22:02:14.178130 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:14.177932    2559 scope.go:117] "RemoveContainer" containerID="045c048a8ab1075762a6de5411f798459e33a6fc7ede9f98f31e188badb841bf"
Jul 16 22:02:14.178130 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:14.177876    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"
Jul 16 22:02:14.197370 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:14.197347    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:02:14.200957 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:14.200938    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-wrmrz"]
Jul 16 22:02:15.679339 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:15.679308    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" path="/var/lib/kubelet/pods/1ed507b1-0148-4bf0-b4f0-62ac88a54bfd/volumes"
Jul 16 22:02:21.672891 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:21.672855    2559 scope.go:117] "RemoveContainer" containerID="f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c"
Jul 16 22:02:22.223759 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:22.223728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerStarted","Data":"03eed217d1f421bd01696f06e12384eb6fc8f75cf0058eca40d66d2276611127"}
Jul 16 22:02:23.238658 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:23.238625    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerID="03eed217d1f421bd01696f06e12384eb6fc8f75cf0058eca40d66d2276611127" exitCode=6
Jul 16 22:02:23.239026 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:23.238696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerDied","Data":"03eed217d1f421bd01696f06e12384eb6fc8f75cf0058eca40d66d2276611127"}
Jul 16 22:02:23.239026 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:23.238779    2559 scope.go:117] "RemoveContainer" containerID="f621b042ae732d9284b0d6d88a33134a18c7a748910cd09d25ebb5298e5dea2c"
Jul 16 22:02:23.239026 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:23.238990    2559 scope.go:117] "RemoveContainer" containerID="03eed217d1f421bd01696f06e12384eb6fc8f75cf0058eca40d66d2276611127"
Jul 16 22:02:23.239233 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:23.239216    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7_odh-ai-gateway-infra(8a479278-d968-43b5-b4e3-a00655dcb80d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d"
Jul 16 22:02:23.253700 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:23.253680    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:24.384888 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:24.384865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:24.466323 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:24.466297    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca\") pod \"8a479278-d968-43b5-b4e3-a00655dcb80d\" (UID: \"8a479278-d968-43b5-b4e3-a00655dcb80d\") "
Jul 16 22:02:24.466631 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:24.466610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a479278-d968-43b5-b4e3-a00655dcb80d" (UID: "8a479278-d968-43b5-b4e3-a00655dcb80d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:24.567474 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:24.567409    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a479278-d968-43b5-b4e3-a00655dcb80d-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:25.252073 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.252037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7" event={"ID":"8a479278-d968-43b5-b4e3-a00655dcb80d","Type":"ContainerDied","Data":"4d2e785def69dba87486aa76d51d7d4b935f7348219ddf91de80f6e6d3df14ce"}
Jul 16 22:02:25.252381 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.252116    2559 scope.go:117] "RemoveContainer" containerID="03eed217d1f421bd01696f06e12384eb6fc8f75cf0058eca40d66d2276611127"
Jul 16 22:02:25.252381 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.252048    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"
Jul 16 22:02:25.277369 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.277343    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:25.281082 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.281056    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-fr7d7"]
Jul 16 22:02:25.679432 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:25.679351    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" path="/var/lib/kubelet/pods/8a479278-d968-43b5-b4e3-a00655dcb80d/volumes"
Jul 16 22:02:31.509981 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:31.509946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:02:36.394278 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394241    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394638    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394649    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394658    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394664    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394676    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394681    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394692    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394697    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394704    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394710    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf26341-37e1-4d8e-a113-ba65a6b528c4" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394722    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394727    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394734    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394739    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394747    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394752    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394813    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394819    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394832    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394845    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.394881 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.394850    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a479278-d968-43b5-b4e3-a00655dcb80d" containerName="revoke-keys"
Jul 16 22:02:36.399562 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.399543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:36.402868 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.402848    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:02:36.405039 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.405012    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:36.473022 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.472995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6\" (UID: \"31e24dcd-c275-4525-ae1d-833c4c7f4249\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:36.573663 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.573637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6\" (UID: \"31e24dcd-c275-4525-ae1d-833c4c7f4249\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:36.574229 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.574210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6\" (UID: \"31e24dcd-c275-4525-ae1d-833c4c7f4249\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:36.712968 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.712897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:36.871612 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:36.871589    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:36.873895 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:36.873859    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e24dcd_c275_4525_ae1d_833c4c7f4249.slice/crio-32929428cd542260c63ef5a6c22f5a27713554d6bb72355e5bc7508389f470d0 WatchSource:0}: Error finding container 32929428cd542260c63ef5a6c22f5a27713554d6bb72355e5bc7508389f470d0: Status 404 returned error can't find the container with id 32929428cd542260c63ef5a6c22f5a27713554d6bb72355e5bc7508389f470d0
Jul 16 22:02:37.319140 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.319107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerStarted","Data":"eb5b31e212642d0014aedcfd119f792031e8ae62ec27065d996b3f70d727a2db"}
Jul 16 22:02:37.319292 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.319159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerStarted","Data":"32929428cd542260c63ef5a6c22f5a27713554d6bb72355e5bc7508389f470d0"}
Jul 16 22:02:37.320078 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320059    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:37.320493 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320456    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:37.320493 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320470    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:37.320566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320493    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:37.320566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320499    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:37.320566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320557    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed507b1-0148-4bf0-b4f0-62ac88a54bfd" containerName="revoke-keys"
Jul 16 22:02:37.320566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.320565    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ab8bca-1c45-49aa-9ffa-52927c3b0b41" containerName="revoke-keys"
Jul 16 22:02:37.323673 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.323660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:37.334868 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.334847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:37.346993 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.346952    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" podStartSLOduration=1.346938441 podStartE2EDuration="1.346938441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:02:37.342221684 +0000 UTC m=+3220.192839060" watchObservedRunningTime="2026-07-16 22:02:37.346938441 +0000 UTC m=+3220.197555817"
Jul 16 22:02:37.379856 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.379835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjwk\" (UniqueName: \"kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk\") pod \"kuadrant-operator-catalog-sbdj7\" (UID: \"b286ad0c-66b6-44f2-bdd9-067f36663199\") " pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:37.481278 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.481246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjwk\" (UniqueName: \"kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk\") pod \"kuadrant-operator-catalog-sbdj7\" (UID: \"b286ad0c-66b6-44f2-bdd9-067f36663199\") " pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:37.500854 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.500827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjwk\" (UniqueName: \"kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk\") pod \"kuadrant-operator-catalog-sbdj7\" (UID: \"b286ad0c-66b6-44f2-bdd9-067f36663199\") " pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:37.633301 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.633246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:37.652351 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.652324    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:37.656038 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.656021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:37.680898 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.680870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:37.784481 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.784446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-svd68\" (UID: \"a1b40e46-546a-44a6-8312-e214a6cb77d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:37.786338 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.786276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:37.789894 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:37.789867    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb286ad0c_66b6_44f2_bdd9_067f36663199.slice/crio-b77a5981d50a99bd03955f2cbc41ff0445eba2623927225fe7e6ed43a972435c WatchSource:0}: Error finding container b77a5981d50a99bd03955f2cbc41ff0445eba2623927225fe7e6ed43a972435c: Status 404 returned error can't find the container with id b77a5981d50a99bd03955f2cbc41ff0445eba2623927225fe7e6ed43a972435c
Jul 16 22:02:37.791502 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.791485    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:02:37.885454 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.885363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-svd68\" (UID: \"a1b40e46-546a-44a6-8312-e214a6cb77d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:37.885949 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.885929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-svd68\" (UID: \"a1b40e46-546a-44a6-8312-e214a6cb77d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:37.968551 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:37.968521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:38.126635 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.126609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:38.128327 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:38.128296    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b40e46_546a_44a6_8312_e214a6cb77d4.slice/crio-957447ea5287eaf6846eb31881f51a7ade0700d44105d55470c63079f2c01336 WatchSource:0}: Error finding container 957447ea5287eaf6846eb31881f51a7ade0700d44105d55470c63079f2c01336: Status 404 returned error can't find the container with id 957447ea5287eaf6846eb31881f51a7ade0700d44105d55470c63079f2c01336
Jul 16 22:02:38.325156 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.325121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" event={"ID":"a1b40e46-546a-44a6-8312-e214a6cb77d4","Type":"ContainerStarted","Data":"957447ea5287eaf6846eb31881f51a7ade0700d44105d55470c63079f2c01336"}
Jul 16 22:02:38.326745 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.326712    2559 generic.go:356] "Generic (PLEG): container finished" podID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerID="eb5b31e212642d0014aedcfd119f792031e8ae62ec27065d996b3f70d727a2db" exitCode=6
Jul 16 22:02:38.326905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.326769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerDied","Data":"eb5b31e212642d0014aedcfd119f792031e8ae62ec27065d996b3f70d727a2db"}
Jul 16 22:02:38.327045 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.327027    2559 scope.go:117] "RemoveContainer" containerID="eb5b31e212642d0014aedcfd119f792031e8ae62ec27065d996b3f70d727a2db"
Jul 16 22:02:38.336220 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:38.333999    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" event={"ID":"b286ad0c-66b6-44f2-bdd9-067f36663199","Type":"ContainerStarted","Data":"b77a5981d50a99bd03955f2cbc41ff0445eba2623927225fe7e6ed43a972435c"}
Jul 16 22:02:39.341104 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.341069    2559 generic.go:356] "Generic (PLEG): container finished" podID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerID="b377af023b9e3a30ee60d8cac7011cb430eebf0861690bbf9c6aa5ada1470c91" exitCode=6
Jul 16 22:02:39.341553 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.341154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" event={"ID":"a1b40e46-546a-44a6-8312-e214a6cb77d4","Type":"ContainerDied","Data":"b377af023b9e3a30ee60d8cac7011cb430eebf0861690bbf9c6aa5ada1470c91"}
Jul 16 22:02:39.341553 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.341337    2559 scope.go:117] "RemoveContainer" containerID="b377af023b9e3a30ee60d8cac7011cb430eebf0861690bbf9c6aa5ada1470c91"
Jul 16 22:02:39.343201 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.343171    2559 generic.go:356] "Generic (PLEG): container finished" podID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerID="c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc" exitCode=6
Jul 16 22:02:39.343310 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.343259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerDied","Data":"c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc"}
Jul 16 22:02:39.343394 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.343323    2559 scope.go:117] "RemoveContainer" containerID="eb5b31e212642d0014aedcfd119f792031e8ae62ec27065d996b3f70d727a2db"
Jul 16 22:02:39.343497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.343477    2559 scope.go:117] "RemoveContainer" containerID="c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc"
Jul 16 22:02:39.343769 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:39.343679    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6_odh-ai-gateway-infra(31e24dcd-c275-4525-ae1d-833c4c7f4249)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249"
Jul 16 22:02:39.345048 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.344990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" event={"ID":"b286ad0c-66b6-44f2-bdd9-067f36663199","Type":"ContainerStarted","Data":"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"}
Jul 16 22:02:39.378485 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:39.378441    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" podStartSLOduration=1.072628493 podStartE2EDuration="2.378427398s" totalImagesPullingTime="1.305798905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:02:39.376988791 +0000 UTC m=+3222.227606170" watchObservedRunningTime="2026-07-16 22:02:39.378427398 +0000 UTC m=+3222.229044775"
Jul 16 22:02:40.353261 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:40.353231    2559 scope.go:117] "RemoveContainer" containerID="c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc"
Jul 16 22:02:40.353715 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:40.353477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6_odh-ai-gateway-infra(31e24dcd-c275-4525-ae1d-833c4c7f4249)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249"
Jul 16 22:02:40.354967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:40.354945    2559 generic.go:356] "Generic (PLEG): container finished" podID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerID="a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0" exitCode=6
Jul 16 22:02:40.355119 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:40.355026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" event={"ID":"a1b40e46-546a-44a6-8312-e214a6cb77d4","Type":"ContainerDied","Data":"a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0"}
Jul 16 22:02:40.355119 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:40.355086    2559 scope.go:117] "RemoveContainer" containerID="b377af023b9e3a30ee60d8cac7011cb430eebf0861690bbf9c6aa5ada1470c91"
Jul 16 22:02:40.355305 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:40.355273    2559 scope.go:117] "RemoveContainer" containerID="a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0"
Jul 16 22:02:40.355517 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:40.355491    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-svd68_odh-ai-gateway-infra(a1b40e46-546a-44a6-8312-e214a6cb77d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4"
Jul 16 22:02:41.362650 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:41.362627    2559 scope.go:117] "RemoveContainer" containerID="a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0"
Jul 16 22:02:41.363109 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:41.362797    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-svd68_odh-ai-gateway-infra(a1b40e46-546a-44a6-8312-e214a6cb77d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4"
Jul 16 22:02:47.633972 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:47.633943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:47.634444 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:47.634191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:47.661188 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:47.661165    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:48.424695 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:48.424665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:48.464570 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:48.464544    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:50.413508 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.413404    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" podUID="b286ad0c-66b6-44f2-bdd9-067f36663199" containerName="registry-server" containerID="cri-o://1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d" gracePeriod=2
Jul 16 22:02:50.672619 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.672599    2559 scope.go:117] "RemoveContainer" containerID="c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc"
Jul 16 22:02:50.687160 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.687131    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:50.801994 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.801970    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxjwk\" (UniqueName: \"kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk\") pod \"b286ad0c-66b6-44f2-bdd9-067f36663199\" (UID: \"b286ad0c-66b6-44f2-bdd9-067f36663199\") "
Jul 16 22:02:50.804080 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.804048    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk" (OuterVolumeSpecName: "kube-api-access-wxjwk") pod "b286ad0c-66b6-44f2-bdd9-067f36663199" (UID: "b286ad0c-66b6-44f2-bdd9-067f36663199"). InnerVolumeSpecName "kube-api-access-wxjwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:02:50.903683 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:50.903660    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxjwk\" (UniqueName: \"kubernetes.io/projected/b286ad0c-66b6-44f2-bdd9-067f36663199-kube-api-access-wxjwk\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:51.421079 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.421051    2559 generic.go:356] "Generic (PLEG): container finished" podID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerID="7ea176ebf1609c20eac0daa86eeddac0ebca0f4a7dff451350d5ad6afc0b770a" exitCode=6
Jul 16 22:02:51.421521 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.421135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerDied","Data":"7ea176ebf1609c20eac0daa86eeddac0ebca0f4a7dff451350d5ad6afc0b770a"}
Jul 16 22:02:51.421521 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.421200    2559 scope.go:117] "RemoveContainer" containerID="c4f7c1337d701bc04f91f3286d84e9797bdfffa8b38a1a31730f43f57053e0bc"
Jul 16 22:02:51.421639 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.421574    2559 scope.go:117] "RemoveContainer" containerID="7ea176ebf1609c20eac0daa86eeddac0ebca0f4a7dff451350d5ad6afc0b770a"
Jul 16 22:02:51.421793 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:51.421773    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6_odh-ai-gateway-infra(31e24dcd-c275-4525-ae1d-833c4c7f4249)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249"
Jul 16 22:02:51.422547 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.422500    2559 generic.go:356] "Generic (PLEG): container finished" podID="b286ad0c-66b6-44f2-bdd9-067f36663199" containerID="1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d" exitCode=0
Jul 16 22:02:51.422603 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.422547    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7"
Jul 16 22:02:51.422650 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.422622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" event={"ID":"b286ad0c-66b6-44f2-bdd9-067f36663199","Type":"ContainerDied","Data":"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"}
Jul 16 22:02:51.422699 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.422658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbdj7" event={"ID":"b286ad0c-66b6-44f2-bdd9-067f36663199","Type":"ContainerDied","Data":"b77a5981d50a99bd03955f2cbc41ff0445eba2623927225fe7e6ed43a972435c"}
Jul 16 22:02:51.436757 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.436740    2559 scope.go:117] "RemoveContainer" containerID="1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"
Jul 16 22:02:51.448300 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.448279    2559 scope.go:117] "RemoveContainer" containerID="1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"
Jul 16 22:02:51.448585 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:51.448564    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d\": container with ID starting with 1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d not found: ID does not exist" containerID="1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"
Jul 16 22:02:51.448646 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.448596    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d"} err="failed to get container status \"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d\": rpc error: code = NotFound desc = could not find container \"1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d\": container with ID starting with 1f8e9f0416a7033f72ff98e038c8b232b76dedab4849e46ca00d9692838c3c0d not found: ID does not exist"
Jul 16 22:02:51.452315 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.452294    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:51.460477 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.460458    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbdj7"]
Jul 16 22:02:51.678709 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:51.678632    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b286ad0c-66b6-44f2-bdd9-067f36663199" path="/var/lib/kubelet/pods/b286ad0c-66b6-44f2-bdd9-067f36663199/volumes"
Jul 16 22:02:52.451845 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.451794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:52.601193 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.601167    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:52.672699 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.672670    2559 scope.go:117] "RemoveContainer" containerID="a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0"
Jul 16 22:02:52.718866 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.718841    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca\") pod \"31e24dcd-c275-4525-ae1d-833c4c7f4249\" (UID: \"31e24dcd-c275-4525-ae1d-833c4c7f4249\") "
Jul 16 22:02:52.719190 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.719169    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31e24dcd-c275-4525-ae1d-833c4c7f4249" (UID: "31e24dcd-c275-4525-ae1d-833c4c7f4249"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:52.820147 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:52.820113    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e24dcd-c275-4525-ae1d-833c4c7f4249-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:53.438116 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.438075    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"
Jul 16 22:02:53.438282 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.438119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6" event={"ID":"31e24dcd-c275-4525-ae1d-833c4c7f4249","Type":"ContainerDied","Data":"32929428cd542260c63ef5a6c22f5a27713554d6bb72355e5bc7508389f470d0"}
Jul 16 22:02:53.438282 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.438172    2559 scope.go:117] "RemoveContainer" containerID="7ea176ebf1609c20eac0daa86eeddac0ebca0f4a7dff451350d5ad6afc0b770a"
Jul 16 22:02:53.440272 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.440248    2559 generic.go:356] "Generic (PLEG): container finished" podID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerID="2cec54ff07d9fd982df040ca161cb33328a8acabda59f7ec8031a13162f4f525" exitCode=6
Jul 16 22:02:53.440371 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.440313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" event={"ID":"a1b40e46-546a-44a6-8312-e214a6cb77d4","Type":"ContainerDied","Data":"2cec54ff07d9fd982df040ca161cb33328a8acabda59f7ec8031a13162f4f525"}
Jul 16 22:02:53.440692 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.440675    2559 scope.go:117] "RemoveContainer" containerID="2cec54ff07d9fd982df040ca161cb33328a8acabda59f7ec8031a13162f4f525"
Jul 16 22:02:53.440921 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:53.440901    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-svd68_odh-ai-gateway-infra(a1b40e46-546a-44a6-8312-e214a6cb77d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4"
Jul 16 22:02:53.448138 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.448114    2559 scope.go:117] "RemoveContainer" containerID="a47a5f6263a80636b46809cda10910ed02a3e6a8d266af5d1c0efb18e82b4aa0"
Jul 16 22:02:53.475905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.475882    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:53.482594 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.482575    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-gtzc6"]
Jul 16 22:02:53.679454 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:53.679382    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" path="/var/lib/kubelet/pods/31e24dcd-c275-4525-ae1d-833c4c7f4249/volumes"
Jul 16 22:02:54.021001 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.020968    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:02:54.021495 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021478    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021495 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021496    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021513    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b286ad0c-66b6-44f2-bdd9-067f36663199" containerName="registry-server"
Jul 16 22:02:54.021591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021519    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b286ad0c-66b6-44f2-bdd9-067f36663199" containerName="registry-server"
Jul 16 22:02:54.021591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021530    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021535    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021734 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021599    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b286ad0c-66b6-44f2-bdd9-067f36663199" containerName="registry-server"
Jul 16 22:02:54.021734 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021608    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021734 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021613    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.021734 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.021621    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:54.025986 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.025970    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:02:54.032587 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.032560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:02:54.131694 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.131664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg\" (UID: \"7deabb1d-3c8e-4781-99df-5fe765138c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:02:54.233104 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.233072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg\" (UID: \"7deabb1d-3c8e-4781-99df-5fe765138c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:02:54.233681 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.233662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg\" (UID: \"7deabb1d-3c8e-4781-99df-5fe765138c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:02:54.339282 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.339214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:02:54.473957 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.473927    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:54.620925 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.620903    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:54.693231 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:54.693192    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7deabb1d_3c8e_4781_99df_5fe765138c69.slice/crio-2d0cc0bb400eccd2a107fed8cff8e0af0e4c890cf2b96ac46f3e73dcc6a24b43 WatchSource:0}: Error finding container 2d0cc0bb400eccd2a107fed8cff8e0af0e4c890cf2b96ac46f3e73dcc6a24b43: Status 404 returned error can't find the container with id 2d0cc0bb400eccd2a107fed8cff8e0af0e4c890cf2b96ac46f3e73dcc6a24b43
Jul 16 22:02:54.700077 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.700047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:02:54.739159 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.739131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca\") pod \"a1b40e46-546a-44a6-8312-e214a6cb77d4\" (UID: \"a1b40e46-546a-44a6-8312-e214a6cb77d4\") "
Jul 16 22:02:54.739446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.739425    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1b40e46-546a-44a6-8312-e214a6cb77d4" (UID: "a1b40e46-546a-44a6-8312-e214a6cb77d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:02:54.839789 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:54.839765    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b40e46-546a-44a6-8312-e214a6cb77d4-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:02:55.458643 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.458609    2559 generic.go:356] "Generic (PLEG): container finished" podID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerID="3a43d2324b1e2710b95c39314bfd0c5b66a3acc904612ec3a9cc8c9efc383fe3" exitCode=6
Jul 16 22:02:55.458814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.458691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" event={"ID":"7deabb1d-3c8e-4781-99df-5fe765138c69","Type":"ContainerDied","Data":"3a43d2324b1e2710b95c39314bfd0c5b66a3acc904612ec3a9cc8c9efc383fe3"}
Jul 16 22:02:55.458814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.458743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" event={"ID":"7deabb1d-3c8e-4781-99df-5fe765138c69","Type":"ContainerStarted","Data":"2d0cc0bb400eccd2a107fed8cff8e0af0e4c890cf2b96ac46f3e73dcc6a24b43"}
Jul 16 22:02:55.458924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.458862    2559 scope.go:117] "RemoveContainer" containerID="3a43d2324b1e2710b95c39314bfd0c5b66a3acc904612ec3a9cc8c9efc383fe3"
Jul 16 22:02:55.460300 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.460275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68" event={"ID":"a1b40e46-546a-44a6-8312-e214a6cb77d4","Type":"ContainerDied","Data":"957447ea5287eaf6846eb31881f51a7ade0700d44105d55470c63079f2c01336"}
Jul 16 22:02:55.460413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.460307    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"
Jul 16 22:02:55.460413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.460334    2559 scope.go:117] "RemoveContainer" containerID="2cec54ff07d9fd982df040ca161cb33328a8acabda59f7ec8031a13162f4f525"
Jul 16 22:02:55.496221 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.496199    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:55.505837 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.505788    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-svd68"]
Jul 16 22:02:55.679736 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:55.679709    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" path="/var/lib/kubelet/pods/a1b40e46-546a-44a6-8312-e214a6cb77d4/volumes"
Jul 16 22:02:56.104453 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104378    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:02:56.104847 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104833    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:56.104917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104850    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e24dcd-c275-4525-ae1d-833c4c7f4249" containerName="revoke-keys"
Jul 16 22:02:56.104917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104863    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.104917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104869    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.104917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104880    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.104917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104888    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.105125 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104965    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.105125 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.104972    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:02:56.108151 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.108135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:02:56.116946 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.116925    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:02:56.254416 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.254385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-5pddc\" (UID: \"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:02:56.355470 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.355401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-5pddc\" (UID: \"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:02:56.355971 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.355948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-5pddc\" (UID: \"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:02:56.420263 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.420238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:02:56.467950 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.467909    2559 generic.go:356] "Generic (PLEG): container finished" podID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerID="418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657" exitCode=6
Jul 16 22:02:56.468134 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.467961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" event={"ID":"7deabb1d-3c8e-4781-99df-5fe765138c69","Type":"ContainerDied","Data":"418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657"}
Jul 16 22:02:56.468134 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.468032    2559 scope.go:117] "RemoveContainer" containerID="3a43d2324b1e2710b95c39314bfd0c5b66a3acc904612ec3a9cc8c9efc383fe3"
Jul 16 22:02:56.468255 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.468219    2559 scope.go:117] "RemoveContainer" containerID="418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657"
Jul 16 22:02:56.468512 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:56.468484    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg_odh-ai-gateway-infra(7deabb1d-3c8e-4781-99df-5fe765138c69)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69"
Jul 16 22:02:56.767535 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:56.767509    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:02:56.769621 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:02:56.769593    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedfe5ae_794b_43a0_9cb5_3deff57e9d4d.slice/crio-3207caf58c17c9e6c7dc4b928bca4469a8488a6081835a4f9c017ed472730eed WatchSource:0}: Error finding container 3207caf58c17c9e6c7dc4b928bca4469a8488a6081835a4f9c017ed472730eed: Status 404 returned error can't find the container with id 3207caf58c17c9e6c7dc4b928bca4469a8488a6081835a4f9c017ed472730eed
Jul 16 22:02:57.476894 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:57.476860    2559 generic.go:356] "Generic (PLEG): container finished" podID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerID="5484efa0074d96a2fb25f7da544086a600aaf2981ccc087ed8e883c1538960bf" exitCode=6
Jul 16 22:02:57.477069 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:57.476911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" event={"ID":"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d","Type":"ContainerDied","Data":"5484efa0074d96a2fb25f7da544086a600aaf2981ccc087ed8e883c1538960bf"}
Jul 16 22:02:57.477069 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:57.476971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" event={"ID":"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d","Type":"ContainerStarted","Data":"3207caf58c17c9e6c7dc4b928bca4469a8488a6081835a4f9c017ed472730eed"}
Jul 16 22:02:57.477246 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:57.477230    2559 scope.go:117] "RemoveContainer" containerID="5484efa0074d96a2fb25f7da544086a600aaf2981ccc087ed8e883c1538960bf"
Jul 16 22:02:57.478977 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:57.478960    2559 scope.go:117] "RemoveContainer" containerID="418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657"
Jul 16 22:02:57.479144 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:57.479128    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg_odh-ai-gateway-infra(7deabb1d-3c8e-4781-99df-5fe765138c69)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69"
Jul 16 22:02:58.485590 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:58.485558    2559 generic.go:356] "Generic (PLEG): container finished" podID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerID="2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff" exitCode=6
Jul 16 22:02:58.485942 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:58.485624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" event={"ID":"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d","Type":"ContainerDied","Data":"2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff"}
Jul 16 22:02:58.485942 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:58.485703    2559 scope.go:117] "RemoveContainer" containerID="5484efa0074d96a2fb25f7da544086a600aaf2981ccc087ed8e883c1538960bf"
Jul 16 22:02:58.485942 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:58.485880    2559 scope.go:117] "RemoveContainer" containerID="2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff"
Jul 16 22:02:58.486121 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:58.486077    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-5pddc_odh-ai-gateway-infra(aedfe5ae-794b-43a0-9cb5-3deff57e9d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d"
Jul 16 22:02:59.493273 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:02:59.493248    2559 scope.go:117] "RemoveContainer" containerID="2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff"
Jul 16 22:02:59.493665 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:02:59.493420    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-5pddc_odh-ai-gateway-infra(aedfe5ae-794b-43a0-9cb5-3deff57e9d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d"
Jul 16 22:03:09.672785 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:09.672746    2559 scope.go:117] "RemoveContainer" containerID="418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657"
Jul 16 22:03:10.555841 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:10.555745    2559 generic.go:356] "Generic (PLEG): container finished" podID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerID="ed26bdbf0e829b4746cd80429d14d3e4a8585eb59107b0483500036b2b55117b" exitCode=6
Jul 16 22:03:10.555841 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:10.555819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" event={"ID":"7deabb1d-3c8e-4781-99df-5fe765138c69","Type":"ContainerDied","Data":"ed26bdbf0e829b4746cd80429d14d3e4a8585eb59107b0483500036b2b55117b"}
Jul 16 22:03:10.556102 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:10.555887    2559 scope.go:117] "RemoveContainer" containerID="418946dba43ab30ef6d551398ca47658cd8d48c3aeaaed18dfdcb6dec65e3657"
Jul 16 22:03:10.556226 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:10.556209    2559 scope.go:117] "RemoveContainer" containerID="ed26bdbf0e829b4746cd80429d14d3e4a8585eb59107b0483500036b2b55117b"
Jul 16 22:03:10.556484 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:10.556458    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg_odh-ai-gateway-infra(7deabb1d-3c8e-4781-99df-5fe765138c69)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69"
Jul 16 22:03:11.591903 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:11.591873    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:03:11.732066 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:11.732043    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:03:11.796430 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:11.796398    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca\") pod \"7deabb1d-3c8e-4781-99df-5fe765138c69\" (UID: \"7deabb1d-3c8e-4781-99df-5fe765138c69\") "
Jul 16 22:03:11.796755 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:11.796731    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7deabb1d-3c8e-4781-99df-5fe765138c69" (UID: "7deabb1d-3c8e-4781-99df-5fe765138c69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:03:11.897837 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:11.897761    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7deabb1d-3c8e-4781-99df-5fe765138c69-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:03:12.570316 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:12.570284    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"
Jul 16 22:03:12.570605 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:12.570315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg" event={"ID":"7deabb1d-3c8e-4781-99df-5fe765138c69","Type":"ContainerDied","Data":"2d0cc0bb400eccd2a107fed8cff8e0af0e4c890cf2b96ac46f3e73dcc6a24b43"}
Jul 16 22:03:12.570605 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:12.570382    2559 scope.go:117] "RemoveContainer" containerID="ed26bdbf0e829b4746cd80429d14d3e4a8585eb59107b0483500036b2b55117b"
Jul 16 22:03:12.620126 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:12.620082    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:03:12.623717 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:12.623696    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-v8csg"]
Jul 16 22:03:13.679939 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:13.679900    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" path="/var/lib/kubelet/pods/7deabb1d-3c8e-4781-99df-5fe765138c69/volumes"
Jul 16 22:03:14.673239 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:14.673210    2559 scope.go:117] "RemoveContainer" containerID="2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff"
Jul 16 22:03:15.588924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:15.588833    2559 generic.go:356] "Generic (PLEG): container finished" podID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerID="3613fe9bd57dddd8ed8cffe216a033d633521d4c2b668b7d42e7d13f337fba84" exitCode=6
Jul 16 22:03:15.588924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:15.588909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" event={"ID":"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d","Type":"ContainerDied","Data":"3613fe9bd57dddd8ed8cffe216a033d633521d4c2b668b7d42e7d13f337fba84"}
Jul 16 22:03:15.589421 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:15.589006    2559 scope.go:117] "RemoveContainer" containerID="2260a82b9c428e82a979088af0701fa106b2b168b0fc956ce90f89561ec0d4ff"
Jul 16 22:03:15.589421 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:15.589328    2559 scope.go:117] "RemoveContainer" containerID="3613fe9bd57dddd8ed8cffe216a033d633521d4c2b668b7d42e7d13f337fba84"
Jul 16 22:03:15.589569 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:15.589546    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-5pddc_odh-ai-gateway-infra(aedfe5ae-794b-43a0-9cb5-3deff57e9d4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d"
Jul 16 22:03:16.623238 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:16.623206    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:03:16.764968 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:16.764943    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:03:16.843665 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:16.843635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca\") pod \"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d\" (UID: \"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d\") "
Jul 16 22:03:16.843997 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:16.843974    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" (UID: "aedfe5ae-794b-43a0-9cb5-3deff57e9d4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:03:16.944365 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:16.944302    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:03:17.603680 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.603647    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"
Jul 16 22:03:17.603868 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.603688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc" event={"ID":"aedfe5ae-794b-43a0-9cb5-3deff57e9d4d","Type":"ContainerDied","Data":"3207caf58c17c9e6c7dc4b928bca4469a8488a6081835a4f9c017ed472730eed"}
Jul 16 22:03:17.603868 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.603750    2559 scope.go:117] "RemoveContainer" containerID="3613fe9bd57dddd8ed8cffe216a033d633521d4c2b668b7d42e7d13f337fba84"
Jul 16 22:03:17.626907 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.626876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:03:17.628992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.628970    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-5pddc"]
Jul 16 22:03:17.678763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:17.678741    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" path="/var/lib/kubelet/pods/aedfe5ae-794b-43a0-9cb5-3deff57e9d4d/volumes"
Jul 16 22:03:24.028954 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:24.028901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:26.443354 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443320    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:26.443744 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443735    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443760    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443765    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443772    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443777    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443784    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.443787 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443790    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443809    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443814    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443821    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443825    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443834    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443839    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443892    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443901    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443908    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:26.444015 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.443929    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b40e46-546a-44a6-8312-e214a6cb77d4" containerName="revoke-keys"
Jul 16 22:03:26.448451 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.448425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:26.452298 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.452278    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:03:26.464961 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.464932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:26.529713 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.529677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt\" (UID: \"50622481-14cf-4580-af8e-5a0feac75aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:26.630506 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.630472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt\" (UID: \"50622481-14cf-4580-af8e-5a0feac75aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:26.631069 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.631051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt\" (UID: \"50622481-14cf-4580-af8e-5a0feac75aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:26.760717 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.760692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:26.903036 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:26.903014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:26.905673 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:03:26.905642    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50622481_14cf_4580_af8e_5a0feac75aaf.slice/crio-7f8ed76811180262ff72f9f91a353757d06719a0cb25eee11e8fb256013fa419 WatchSource:0}: Error finding container 7f8ed76811180262ff72f9f91a353757d06719a0cb25eee11e8fb256013fa419: Status 404 returned error can't find the container with id 7f8ed76811180262ff72f9f91a353757d06719a0cb25eee11e8fb256013fa419
Jul 16 22:03:27.667664 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.667633    2559 generic.go:356] "Generic (PLEG): container finished" podID="50622481-14cf-4580-af8e-5a0feac75aaf" containerID="dfe2efb8600496a676f052b422733f808073d59dcc1e944228350537a07fd769" exitCode=6
Jul 16 22:03:27.668048 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.667773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" event={"ID":"50622481-14cf-4580-af8e-5a0feac75aaf","Type":"ContainerDied","Data":"dfe2efb8600496a676f052b422733f808073d59dcc1e944228350537a07fd769"}
Jul 16 22:03:27.668048 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.667877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" event={"ID":"50622481-14cf-4580-af8e-5a0feac75aaf","Type":"ContainerStarted","Data":"7f8ed76811180262ff72f9f91a353757d06719a0cb25eee11e8fb256013fa419"}
Jul 16 22:03:27.668048 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.668014    2559 scope.go:117] "RemoveContainer" containerID="dfe2efb8600496a676f052b422733f808073d59dcc1e944228350537a07fd769"
Jul 16 22:03:27.702450 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.702425    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:27.702935 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.702917    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aedfe5ae-794b-43a0-9cb5-3deff57e9d4d" containerName="revoke-keys"
Jul 16 22:03:27.703014 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.702940    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7deabb1d-3c8e-4781-99df-5fe765138c69" containerName="revoke-keys"
Jul 16 22:03:27.707066 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.707049    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:27.715518 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.715476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:27.851150 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.851047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2\" (UID: \"74c122c2-b62b-4826-91f0-f4a8c22ef4cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:27.952013 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.951966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2\" (UID: \"74c122c2-b62b-4826-91f0-f4a8c22ef4cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:27.952620 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:27.952600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2\" (UID: \"74c122c2-b62b-4826-91f0-f4a8c22ef4cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:28.019204 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.019182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:28.153992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.153809    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:28.156785 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:03:28.156759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c122c2_b62b_4826_91f0_f4a8c22ef4cc.slice/crio-b856fc53c5b58dcb8004285b99d35ed9bf4efadcc378ffc22ab14d861fc187e3 WatchSource:0}: Error finding container b856fc53c5b58dcb8004285b99d35ed9bf4efadcc378ffc22ab14d861fc187e3: Status 404 returned error can't find the container with id b856fc53c5b58dcb8004285b99d35ed9bf4efadcc378ffc22ab14d861fc187e3
Jul 16 22:03:28.675025 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.674956    2559 generic.go:356] "Generic (PLEG): container finished" podID="50622481-14cf-4580-af8e-5a0feac75aaf" containerID="a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9" exitCode=6
Jul 16 22:03:28.675487 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.675038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" event={"ID":"50622481-14cf-4580-af8e-5a0feac75aaf","Type":"ContainerDied","Data":"a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9"}
Jul 16 22:03:28.675487 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.675115    2559 scope.go:117] "RemoveContainer" containerID="dfe2efb8600496a676f052b422733f808073d59dcc1e944228350537a07fd769"
Jul 16 22:03:28.675487 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.675290    2559 scope.go:117] "RemoveContainer" containerID="a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9"
Jul 16 22:03:28.675487 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:28.675478    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt_odh-ai-gateway-infra(50622481-14cf-4580-af8e-5a0feac75aaf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" podUID="50622481-14cf-4580-af8e-5a0feac75aaf"
Jul 16 22:03:28.676795 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.676768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerStarted","Data":"91fa911e29459c3df13bc2bb26c37f263cb7e42b1d604870083ed24152b70e43"}
Jul 16 22:03:28.676898 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.676829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerStarted","Data":"b856fc53c5b58dcb8004285b99d35ed9bf4efadcc378ffc22ab14d861fc187e3"}
Jul 16 22:03:28.710421 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:28.710377    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" podStartSLOduration=1.710363649 podStartE2EDuration="1.710363649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:03:28.708497383 +0000 UTC m=+3271.559114760" watchObservedRunningTime="2026-07-16 22:03:28.710363649 +0000 UTC m=+3271.560981026"
Jul 16 22:03:29.683371 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:29.683332    2559 generic.go:356] "Generic (PLEG): container finished" podID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerID="91fa911e29459c3df13bc2bb26c37f263cb7e42b1d604870083ed24152b70e43" exitCode=6
Jul 16 22:03:29.683820 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:29.683417    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerDied","Data":"91fa911e29459c3df13bc2bb26c37f263cb7e42b1d604870083ed24152b70e43"}
Jul 16 22:03:29.683820 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:29.683580    2559 scope.go:117] "RemoveContainer" containerID="91fa911e29459c3df13bc2bb26c37f263cb7e42b1d604870083ed24152b70e43"
Jul 16 22:03:29.685426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:29.685410    2559 scope.go:117] "RemoveContainer" containerID="a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9"
Jul 16 22:03:29.685586 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:29.685570    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt_odh-ai-gateway-infra(50622481-14cf-4580-af8e-5a0feac75aaf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" podUID="50622481-14cf-4580-af8e-5a0feac75aaf"
Jul 16 22:03:30.691965 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:30.691872    2559 generic.go:356] "Generic (PLEG): container finished" podID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerID="d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0" exitCode=6
Jul 16 22:03:30.692379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:30.691961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerDied","Data":"d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0"}
Jul 16 22:03:30.692379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:30.692021    2559 scope.go:117] "RemoveContainer" containerID="91fa911e29459c3df13bc2bb26c37f263cb7e42b1d604870083ed24152b70e43"
Jul 16 22:03:30.692379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:30.692273    2559 scope.go:117] "RemoveContainer" containerID="d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0"
Jul 16 22:03:30.692508 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:30.692451    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2_odh-ai-gateway-infra(74c122c2-b62b-4826-91f0-f4a8c22ef4cc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc"
Jul 16 22:03:31.705024 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:31.704995    2559 scope.go:117] "RemoveContainer" containerID="d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0"
Jul 16 22:03:31.705450 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:31.705200    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2_odh-ai-gateway-infra(74c122c2-b62b-4826-91f0-f4a8c22ef4cc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc"
Jul 16 22:03:32.170847 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:32.170809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:33.521430 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:33.521392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:40.346748 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:40.346693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:03:40.672471 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:40.672335    2559 scope.go:117] "RemoveContainer" containerID="a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9"
Jul 16 22:03:41.761904 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:41.761875    2559 generic.go:356] "Generic (PLEG): container finished" podID="50622481-14cf-4580-af8e-5a0feac75aaf" containerID="2bf3efba6e1bbdc029f7ce7994ffbe0a1be85a2d522b5cad3a14286225354c05" exitCode=6
Jul 16 22:03:41.762303 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:41.761950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" event={"ID":"50622481-14cf-4580-af8e-5a0feac75aaf","Type":"ContainerDied","Data":"2bf3efba6e1bbdc029f7ce7994ffbe0a1be85a2d522b5cad3a14286225354c05"}
Jul 16 22:03:41.762303 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:41.762013    2559 scope.go:117] "RemoveContainer" containerID="a20784e548f34cd7f786d5bf134e4f0960cb4e6ef7d967f38231296cee465dd9"
Jul 16 22:03:41.762427 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:41.762347    2559 scope.go:117] "RemoveContainer" containerID="2bf3efba6e1bbdc029f7ce7994ffbe0a1be85a2d522b5cad3a14286225354c05"
Jul 16 22:03:41.762562 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:41.762545    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt_odh-ai-gateway-infra(50622481-14cf-4580-af8e-5a0feac75aaf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" podUID="50622481-14cf-4580-af8e-5a0feac75aaf"
Jul 16 22:03:42.790075 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:42.790034    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:42.929192 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:42.929161    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:43.092643 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.092563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca\") pod \"50622481-14cf-4580-af8e-5a0feac75aaf\" (UID: \"50622481-14cf-4580-af8e-5a0feac75aaf\") "
Jul 16 22:03:43.092940 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.092918    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50622481-14cf-4580-af8e-5a0feac75aaf" (UID: "50622481-14cf-4580-af8e-5a0feac75aaf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:03:43.193991 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.193961    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50622481-14cf-4580-af8e-5a0feac75aaf-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:03:43.775711 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.775680    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"
Jul 16 22:03:43.775950 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.775682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt" event={"ID":"50622481-14cf-4580-af8e-5a0feac75aaf","Type":"ContainerDied","Data":"7f8ed76811180262ff72f9f91a353757d06719a0cb25eee11e8fb256013fa419"}
Jul 16 22:03:43.775950 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.775819    2559 scope.go:117] "RemoveContainer" containerID="2bf3efba6e1bbdc029f7ce7994ffbe0a1be85a2d522b5cad3a14286225354c05"
Jul 16 22:03:43.795252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.795232    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:43.802344 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:43.802321    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-hdlqt"]
Jul 16 22:03:44.064992 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.064965    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:03:44.065386 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065374    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065388    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065396    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065402    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065410    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065441 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065416    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065601 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065487    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065601 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065499    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.065601 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.065505    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" containerName="revoke-keys"
Jul 16 22:03:44.069413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.069395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:03:44.080064 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.080041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:03:44.201483 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.201450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md\" (UID: \"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:03:44.302357 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.302324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md\" (UID: \"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:03:44.302943 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.302925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md\" (UID: \"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:03:44.380159 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.380061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:03:44.547106 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.547066    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:03:44.548937 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:03:44.548906    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc687b150_0a2e_4c3a_a5a7_0741f1ecbb5c.slice/crio-5cd0e427e835d2d9b7960c5bf5ec87d272295d271b6ef468803246e99709329b WatchSource:0}: Error finding container 5cd0e427e835d2d9b7960c5bf5ec87d272295d271b6ef468803246e99709329b: Status 404 returned error can't find the container with id 5cd0e427e835d2d9b7960c5bf5ec87d272295d271b6ef468803246e99709329b
Jul 16 22:03:44.783027 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:44.782997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerStarted","Data":"5cd0e427e835d2d9b7960c5bf5ec87d272295d271b6ef468803246e99709329b"}
Jul 16 22:03:45.678806 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:45.678729    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50622481-14cf-4580-af8e-5a0feac75aaf" path="/var/lib/kubelet/pods/50622481-14cf-4580-af8e-5a0feac75aaf/volumes"
Jul 16 22:03:45.789315 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:45.789282    2559 generic.go:356] "Generic (PLEG): container finished" podID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerID="fe249780b65edef6c3fa8b5d65b9a45798472da439c6a5ff690a04c96e1ad4e5" exitCode=6
Jul 16 22:03:45.789473 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:45.789357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerDied","Data":"fe249780b65edef6c3fa8b5d65b9a45798472da439c6a5ff690a04c96e1ad4e5"}
Jul 16 22:03:45.789556 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:45.789539    2559 scope.go:117] "RemoveContainer" containerID="fe249780b65edef6c3fa8b5d65b9a45798472da439c6a5ff690a04c96e1ad4e5"
Jul 16 22:03:46.673166 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:46.673138    2559 scope.go:117] "RemoveContainer" containerID="d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0"
Jul 16 22:03:46.796924 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:46.796897    2559 generic.go:356] "Generic (PLEG): container finished" podID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerID="1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5" exitCode=6
Jul 16 22:03:46.797355 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:46.796983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerDied","Data":"1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5"}
Jul 16 22:03:46.797355 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:46.797039    2559 scope.go:117] "RemoveContainer" containerID="fe249780b65edef6c3fa8b5d65b9a45798472da439c6a5ff690a04c96e1ad4e5"
Jul 16 22:03:46.797355 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:46.797292    2559 scope.go:117] "RemoveContainer" containerID="1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5"
Jul 16 22:03:46.797546 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:46.797524    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md_odh-ai-gateway-infra(c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c"
Jul 16 22:03:47.492929 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:47.492905    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c122c2_b62b_4826_91f0_f4a8c22ef4cc.slice/crio-aa9466c40a3d4f88145c3f6d10549a1213d777ac5b2de361850d39ea038cdd3a.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 22:03:47.803445 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:47.803407    2559 scope.go:117] "RemoveContainer" containerID="1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5"
Jul 16 22:03:47.803880 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:47.803630    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md_odh-ai-gateway-infra(c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c"
Jul 16 22:03:47.805017 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:47.804995    2559 generic.go:356] "Generic (PLEG): container finished" podID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerID="aa9466c40a3d4f88145c3f6d10549a1213d777ac5b2de361850d39ea038cdd3a" exitCode=6
Jul 16 22:03:47.805120 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:47.805069    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerDied","Data":"aa9466c40a3d4f88145c3f6d10549a1213d777ac5b2de361850d39ea038cdd3a"}
Jul 16 22:03:47.805163 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:47.805145    2559 scope.go:117] "RemoveContainer" containerID="d50800af4da2ef64fcf8dff4a60d530b3edbc10f34769279db074da88858e6c0"
Jul 16 22:03:47.805383 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:47.805369    2559 scope.go:117] "RemoveContainer" containerID="aa9466c40a3d4f88145c3f6d10549a1213d777ac5b2de361850d39ea038cdd3a"
Jul 16 22:03:47.805555 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:47.805532    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2_odh-ai-gateway-infra(74c122c2-b62b-4826-91f0-f4a8c22ef4cc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc"
Jul 16 22:03:48.848311 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:48.848281    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:48.999348 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:48.999324    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:49.035681 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.035650    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca\") pod \"74c122c2-b62b-4826-91f0-f4a8c22ef4cc\" (UID: \"74c122c2-b62b-4826-91f0-f4a8c22ef4cc\") "
Jul 16 22:03:49.036016 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.035988    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74c122c2-b62b-4826-91f0-f4a8c22ef4cc" (UID: "74c122c2-b62b-4826-91f0-f4a8c22ef4cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:03:49.137212 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.137149    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c122c2-b62b-4826-91f0-f4a8c22ef4cc-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:03:49.819904 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.819872    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"
Jul 16 22:03:49.819904 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.819891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2" event={"ID":"74c122c2-b62b-4826-91f0-f4a8c22ef4cc","Type":"ContainerDied","Data":"b856fc53c5b58dcb8004285b99d35ed9bf4efadcc378ffc22ab14d861fc187e3"}
Jul 16 22:03:49.820133 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.819962    2559 scope.go:117] "RemoveContainer" containerID="aa9466c40a3d4f88145c3f6d10549a1213d777ac5b2de361850d39ea038cdd3a"
Jul 16 22:03:49.840252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.840228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:49.845572 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:49.845547    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-n8rf2"]
Jul 16 22:03:51.679656 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:51.679614    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" path="/var/lib/kubelet/pods/74c122c2-b62b-4826-91f0-f4a8c22ef4cc/volumes"
Jul 16 22:03:56.158198 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158156    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:03:56.158737 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158719    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158740    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158753    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158758    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158769    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158776    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158844    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158851    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.158953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.158859    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c122c2-b62b-4826-91f0-f4a8c22ef4cc" containerName="revoke-keys"
Jul 16 22:03:56.163201 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.163182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:03:56.169454 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.169205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:03:56.198129 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.198086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xrttr\" (UID: \"9977e52d-9a1c-41b0-b854-3687ad8fe432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:03:56.299621 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.299588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xrttr\" (UID: \"9977e52d-9a1c-41b0-b854-3687ad8fe432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:03:56.300242 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.300224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-xrttr\" (UID: \"9977e52d-9a1c-41b0-b854-3687ad8fe432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:03:56.475746 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.475720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:03:56.615987 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.615959    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:03:56.617879 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:03:56.617838    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9977e52d_9a1c_41b0_b854_3687ad8fe432.slice/crio-9f2aab98afb54b2b9de9423cb86a6a2c7375f217f996d2aaa1bc168b110ef590 WatchSource:0}: Error finding container 9f2aab98afb54b2b9de9423cb86a6a2c7375f217f996d2aaa1bc168b110ef590: Status 404 returned error can't find the container with id 9f2aab98afb54b2b9de9423cb86a6a2c7375f217f996d2aaa1bc168b110ef590
Jul 16 22:03:56.867569 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:56.867497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" event={"ID":"9977e52d-9a1c-41b0-b854-3687ad8fe432","Type":"ContainerStarted","Data":"9f2aab98afb54b2b9de9423cb86a6a2c7375f217f996d2aaa1bc168b110ef590"}
Jul 16 22:03:57.874218 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:57.874183    2559 generic.go:356] "Generic (PLEG): container finished" podID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerID="68741da92d3efc9701200a3e8e36770f60b3ed339ee2174a13a5201ac071c6b4" exitCode=6
Jul 16 22:03:57.874593 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:57.874270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" event={"ID":"9977e52d-9a1c-41b0-b854-3687ad8fe432","Type":"ContainerDied","Data":"68741da92d3efc9701200a3e8e36770f60b3ed339ee2174a13a5201ac071c6b4"}
Jul 16 22:03:57.874593 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:57.874406    2559 scope.go:117] "RemoveContainer" containerID="68741da92d3efc9701200a3e8e36770f60b3ed339ee2174a13a5201ac071c6b4"
Jul 16 22:03:57.905937 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:57.905913    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 22:03:57.923602 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:57.923583    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 22:03:58.673363 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.673291    2559 scope.go:117] "RemoveContainer" containerID="1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5"
Jul 16 22:03:58.882415 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.882386    2559 generic.go:356] "Generic (PLEG): container finished" podID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerID="76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d" exitCode=6
Jul 16 22:03:58.882766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.882476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" event={"ID":"9977e52d-9a1c-41b0-b854-3687ad8fe432","Type":"ContainerDied","Data":"76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d"}
Jul 16 22:03:58.882766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.882540    2559 scope.go:117] "RemoveContainer" containerID="68741da92d3efc9701200a3e8e36770f60b3ed339ee2174a13a5201ac071c6b4"
Jul 16 22:03:58.882766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.882679    2559 scope.go:117] "RemoveContainer" containerID="76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d"
Jul 16 22:03:58.882952 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:58.882931    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xrttr_odh-ai-gateway-infra(9977e52d-9a1c-41b0-b854-3687ad8fe432)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432"
Jul 16 22:03:58.884820 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.884794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerStarted","Data":"2270ab59caab01def3722ba3bd3cb6d0722a937bf941527b1231a2323ab67e3b"}
Jul 16 22:03:58.918421 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:58.918379    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" podStartSLOduration=14.918368101 podStartE2EDuration="14.918368101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:03:58.917172492 +0000 UTC m=+3301.767789870" watchObservedRunningTime="2026-07-16 22:03:58.918368101 +0000 UTC m=+3301.768985477"
Jul 16 22:03:59.891569 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.891517    2559 scope.go:117] "RemoveContainer" containerID="76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d"
Jul 16 22:03:59.892057 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:59.891765    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xrttr_odh-ai-gateway-infra(9977e52d-9a1c-41b0-b854-3687ad8fe432)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432"
Jul 16 22:03:59.893129 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.893084    2559 generic.go:356] "Generic (PLEG): container finished" podID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerID="2270ab59caab01def3722ba3bd3cb6d0722a937bf941527b1231a2323ab67e3b" exitCode=6
Jul 16 22:03:59.893129 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.893124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerDied","Data":"2270ab59caab01def3722ba3bd3cb6d0722a937bf941527b1231a2323ab67e3b"}
Jul 16 22:03:59.893316 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.893175    2559 scope.go:117] "RemoveContainer" containerID="1f9cd8930ff19049d1032a30de18f63df5545fc3b320e8ff81c591056b357ed5"
Jul 16 22:03:59.893446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.893419    2559 scope.go:117] "RemoveContainer" containerID="2270ab59caab01def3722ba3bd3cb6d0722a937bf941527b1231a2323ab67e3b"
Jul 16 22:03:59.893622 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:03:59.893602    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md_odh-ai-gateway-infra(c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c"
Jul 16 22:03:59.926843 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:03:59.926820    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:04:01.051386 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.051361    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:04:01.144165 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.144139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca\") pod \"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c\" (UID: \"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c\") "
Jul 16 22:04:01.144485 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.144462    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" (UID: "c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:04:01.245106 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.245060    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:04:01.859381 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.859343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:01.907618 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.907581    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"
Jul 16 22:04:01.907798 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.907638    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md" event={"ID":"c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c","Type":"ContainerDied","Data":"5cd0e427e835d2d9b7960c5bf5ec87d272295d271b6ef468803246e99709329b"}
Jul 16 22:04:01.907798 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.907695    2559 scope.go:117] "RemoveContainer" containerID="2270ab59caab01def3722ba3bd3cb6d0722a937bf941527b1231a2323ab67e3b"
Jul 16 22:04:01.927822 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.927796    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:04:01.933472 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:01.933447    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-6v4md"]
Jul 16 22:04:03.682156 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:03.682124    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" path="/var/lib/kubelet/pods/c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c/volumes"
Jul 16 22:04:10.672635 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:10.672606    2559 scope.go:117] "RemoveContainer" containerID="76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d"
Jul 16 22:04:11.970562 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:11.970528    2559 generic.go:356] "Generic (PLEG): container finished" podID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerID="2818227ad06ea63af37b699927721825ad4af477199d8273a4ef1c2f2c1a2b3a" exitCode=6
Jul 16 22:04:11.970966 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:11.970602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" event={"ID":"9977e52d-9a1c-41b0-b854-3687ad8fe432","Type":"ContainerDied","Data":"2818227ad06ea63af37b699927721825ad4af477199d8273a4ef1c2f2c1a2b3a"}
Jul 16 22:04:11.970966 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:11.970660    2559 scope.go:117] "RemoveContainer" containerID="76d1e0399bd6cd20fa72de07eb1a4eb026dfeab23ddbaf61a81444e334889c2d"
Jul 16 22:04:11.970966 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:11.970880    2559 scope.go:117] "RemoveContainer" containerID="2818227ad06ea63af37b699927721825ad4af477199d8273a4ef1c2f2c1a2b3a"
Jul 16 22:04:11.971124 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:11.971107    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-xrttr_odh-ai-gateway-infra(9977e52d-9a1c-41b0-b854-3687ad8fe432)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432"
Jul 16 22:04:13.008449 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.008409    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:04:13.154035 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.154010    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:04:13.252306 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.252276    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca\") pod \"9977e52d-9a1c-41b0-b854-3687ad8fe432\" (UID: \"9977e52d-9a1c-41b0-b854-3687ad8fe432\") "
Jul 16 22:04:13.252622 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.252599    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9977e52d-9a1c-41b0-b854-3687ad8fe432" (UID: "9977e52d-9a1c-41b0-b854-3687ad8fe432"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:04:13.353120 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.353038    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9977e52d-9a1c-41b0-b854-3687ad8fe432-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:04:13.984860 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.984829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr" event={"ID":"9977e52d-9a1c-41b0-b854-3687ad8fe432","Type":"ContainerDied","Data":"9f2aab98afb54b2b9de9423cb86a6a2c7375f217f996d2aaa1bc168b110ef590"}
Jul 16 22:04:13.984860 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.984856    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"
Jul 16 22:04:13.985136 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:13.984893    2559 scope.go:117] "RemoveContainer" containerID="2818227ad06ea63af37b699927721825ad4af477199d8273a4ef1c2f2c1a2b3a"
Jul 16 22:04:14.003314 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:14.003289    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:04:14.011552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:14.011521    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-xrttr"]
Jul 16 22:04:15.679055 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:15.679019    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" path="/var/lib/kubelet/pods/9977e52d-9a1c-41b0-b854-3687ad8fe432/volumes"
Jul 16 22:04:16.492776 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.492749    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:16.493173 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493160    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493174    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493186    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493191    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493199    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493205    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493210    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493214    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493232    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493236    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493242    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493247    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493306    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493316    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493324    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:16.493507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.493329    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:16.498001 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.497981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:16.501676 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.501593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:04:16.504591 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.504568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:16.584579 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.584543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc\" (UID: \"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:16.686060 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.686026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc\" (UID: \"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:16.686765 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.686738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc\" (UID: \"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:16.812267 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.812182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:16.952673 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:16.952630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:16.953924 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:04:16.953898    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6f6e42_6e20_437a_9f9d_a35bae65fd4d.slice/crio-37aa162bbdad9741b73ed53202ac4d50cdc5c1b2ec12d0640cc200d64d14502e WatchSource:0}: Error finding container 37aa162bbdad9741b73ed53202ac4d50cdc5c1b2ec12d0640cc200d64d14502e: Status 404 returned error can't find the container with id 37aa162bbdad9741b73ed53202ac4d50cdc5c1b2ec12d0640cc200d64d14502e
Jul 16 22:04:17.002557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:17.002531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerStarted","Data":"37aa162bbdad9741b73ed53202ac4d50cdc5c1b2ec12d0640cc200d64d14502e"}
Jul 16 22:04:18.009170 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:18.009135    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerID="75b42906ce06e0a15d15fe9d064b1868fa43c365606c96af043a91afd65c772e" exitCode=6
Jul 16 22:04:18.009553 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:18.009219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerDied","Data":"75b42906ce06e0a15d15fe9d064b1868fa43c365606c96af043a91afd65c772e"}
Jul 16 22:04:18.009553 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:18.009356    2559 scope.go:117] "RemoveContainer" containerID="75b42906ce06e0a15d15fe9d064b1868fa43c365606c96af043a91afd65c772e"
Jul 16 22:04:19.016135 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:19.016084    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerID="9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592" exitCode=6
Jul 16 22:04:19.016594 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:19.016136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerDied","Data":"9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592"}
Jul 16 22:04:19.016594 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:19.016221    2559 scope.go:117] "RemoveContainer" containerID="75b42906ce06e0a15d15fe9d064b1868fa43c365606c96af043a91afd65c772e"
Jul 16 22:04:19.016594 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:19.016432    2559 scope.go:117] "RemoveContainer" containerID="9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592"
Jul 16 22:04:19.016763 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:19.016674    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc_odh-ai-gateway-infra(2a6f6e42-6e20-437a-9f9d-a35bae65fd4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d"
Jul 16 22:04:20.023270 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:20.023242    2559 scope.go:117] "RemoveContainer" containerID="9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592"
Jul 16 22:04:20.023689 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:20.023422    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc_odh-ai-gateway-infra(2a6f6e42-6e20-437a-9f9d-a35bae65fd4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d"
Jul 16 22:04:27.758233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.758196    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:27.758710 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.758644    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9977e52d-9a1c-41b0-b854-3687ad8fe432" containerName="revoke-keys"
Jul 16 22:04:27.758710 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.758658    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c687b150-0a2e-4c3a-a5a7-0741f1ecbb5c" containerName="revoke-keys"
Jul 16 22:04:27.763074 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.763053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:27.770437 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.770411    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:27.884233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.884206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4\" (UID: \"2c4f92fd-36c1-4392-a015-782095ff3a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:27.985267 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.985236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4\" (UID: \"2c4f92fd-36c1-4392-a015-782095ff3a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:27.985860 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:27.985840    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4\" (UID: \"2c4f92fd-36c1-4392-a015-782095ff3a2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:28.074434 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:28.074346    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:28.230570 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:28.230526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:28.232582 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:04:28.232556    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4f92fd_36c1_4392_a015_782095ff3a2f.slice/crio-ca56dcc370b745748311d621094f4b37b2c751bd56da490e5a8814b9b2cf4a09 WatchSource:0}: Error finding container ca56dcc370b745748311d621094f4b37b2c751bd56da490e5a8814b9b2cf4a09: Status 404 returned error can't find the container with id ca56dcc370b745748311d621094f4b37b2c751bd56da490e5a8814b9b2cf4a09
Jul 16 22:04:29.073171 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:29.073142    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerID="a0757d06ed1a1796f518b2a7c8adabb82a9875f215f21f5254d005998234641a" exitCode=6
Jul 16 22:04:29.073517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:29.073235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerDied","Data":"a0757d06ed1a1796f518b2a7c8adabb82a9875f215f21f5254d005998234641a"}
Jul 16 22:04:29.073517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:29.073291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerStarted","Data":"ca56dcc370b745748311d621094f4b37b2c751bd56da490e5a8814b9b2cf4a09"}
Jul 16 22:04:29.073517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:29.073375    2559 scope.go:117] "RemoveContainer" containerID="a0757d06ed1a1796f518b2a7c8adabb82a9875f215f21f5254d005998234641a"
Jul 16 22:04:30.080617 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:30.080583    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerID="2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2" exitCode=6
Jul 16 22:04:30.081028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:30.080654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerDied","Data":"2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2"}
Jul 16 22:04:30.081028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:30.080711    2559 scope.go:117] "RemoveContainer" containerID="a0757d06ed1a1796f518b2a7c8adabb82a9875f215f21f5254d005998234641a"
Jul 16 22:04:30.081028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:30.080883    2559 scope.go:117] "RemoveContainer" containerID="2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2"
Jul 16 22:04:30.081203 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:30.081135    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4_odh-ai-gateway-infra(2c4f92fd-36c1-4392-a015-782095ff3a2f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f"
Jul 16 22:04:31.088249 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:31.088211    2559 scope.go:117] "RemoveContainer" containerID="2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2"
Jul 16 22:04:31.088618 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:31.088393    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4_odh-ai-gateway-infra(2c4f92fd-36c1-4392-a015-782095ff3a2f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f"
Jul 16 22:04:33.673086 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:33.673051    2559 scope.go:117] "RemoveContainer" containerID="9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592"
Jul 16 22:04:34.106020 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.105988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerStarted","Data":"3e4f46abd96aefa6ae4d434e7ffd2d9f1e10d60f8384472c013484bcccf9ec35"}
Jul 16 22:04:34.107244 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.107223    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:34.110815 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.110796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:34.119519 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.119491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:34.138741 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.138696    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" podStartSLOduration=18.138683641 podStartE2EDuration="18.138683641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:34.122348363 +0000 UTC m=+3336.972965754" watchObservedRunningTime="2026-07-16 22:04:34.138683641 +0000 UTC m=+3336.989301017"
Jul 16 22:04:34.236696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.236669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6\" (UID: \"21f43562-e905-4794-987b-c92d3b7d77af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:34.337801 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.337774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6\" (UID: \"21f43562-e905-4794-987b-c92d3b7d77af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:34.338373 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.338355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6\" (UID: \"21f43562-e905-4794-987b-c92d3b7d77af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:34.423921 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.423875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:34.585185 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:34.585109    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:34.587609 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:04:34.587578    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f43562_e905_4794_987b_c92d3b7d77af.slice/crio-2d3eaaba75e9acd5a85067f1e302e790f435f3bcf2f53660ac9c635a94b5d825 WatchSource:0}: Error finding container 2d3eaaba75e9acd5a85067f1e302e790f435f3bcf2f53660ac9c635a94b5d825: Status 404 returned error can't find the container with id 2d3eaaba75e9acd5a85067f1e302e790f435f3bcf2f53660ac9c635a94b5d825
Jul 16 22:04:35.113714 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.113635    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerID="3e4f46abd96aefa6ae4d434e7ffd2d9f1e10d60f8384472c013484bcccf9ec35" exitCode=6
Jul 16 22:04:35.114128 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.113707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerDied","Data":"3e4f46abd96aefa6ae4d434e7ffd2d9f1e10d60f8384472c013484bcccf9ec35"}
Jul 16 22:04:35.114128 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.113765    2559 scope.go:117] "RemoveContainer" containerID="9380d659b043b3c4096582e39083a9ccd69b2b9f5ebb250bd61e2b7e5cd29592"
Jul 16 22:04:35.114128 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.114029    2559 scope.go:117] "RemoveContainer" containerID="3e4f46abd96aefa6ae4d434e7ffd2d9f1e10d60f8384472c013484bcccf9ec35"
Jul 16 22:04:35.114320 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:35.114298    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc_odh-ai-gateway-infra(2a6f6e42-6e20-437a-9f9d-a35bae65fd4d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d"
Jul 16 22:04:35.115513 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.115479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerStarted","Data":"e6da6b4df83f25457004af11a72ba82dad1e9a1eca1f537b990fd7553f0123a1"}
Jul 16 22:04:35.115623 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.115530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerStarted","Data":"2d3eaaba75e9acd5a85067f1e302e790f435f3bcf2f53660ac9c635a94b5d825"}
Jul 16 22:04:35.139468 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.139447    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:35.149824 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:35.149774    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" podStartSLOduration=1.149757284 podStartE2EDuration="1.149757284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:35.147862533 +0000 UTC m=+3337.998479912" watchObservedRunningTime="2026-07-16 22:04:35.149757284 +0000 UTC m=+3338.000374665"
Jul 16 22:04:36.125565 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.125535    2559 generic.go:356] "Generic (PLEG): container finished" podID="21f43562-e905-4794-987b-c92d3b7d77af" containerID="e6da6b4df83f25457004af11a72ba82dad1e9a1eca1f537b990fd7553f0123a1" exitCode=6
Jul 16 22:04:36.126007 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.125616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerDied","Data":"e6da6b4df83f25457004af11a72ba82dad1e9a1eca1f537b990fd7553f0123a1"}
Jul 16 22:04:36.126007 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.125797    2559 scope.go:117] "RemoveContainer" containerID="e6da6b4df83f25457004af11a72ba82dad1e9a1eca1f537b990fd7553f0123a1"
Jul 16 22:04:36.273558 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.273537    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:36.355773 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.355747    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca\") pod \"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d\" (UID: \"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d\") "
Jul 16 22:04:36.356196 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.356172    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" (UID: "2a6f6e42-6e20-437a-9f9d-a35bae65fd4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:04:36.456891 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:36.456822    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:04:37.134374 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.134294    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"
Jul 16 22:04:37.134374 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.134323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc" event={"ID":"2a6f6e42-6e20-437a-9f9d-a35bae65fd4d","Type":"ContainerDied","Data":"37aa162bbdad9741b73ed53202ac4d50cdc5c1b2ec12d0640cc200d64d14502e"}
Jul 16 22:04:37.134869 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.134388    2559 scope.go:117] "RemoveContainer" containerID="3e4f46abd96aefa6ae4d434e7ffd2d9f1e10d60f8384472c013484bcccf9ec35"
Jul 16 22:04:37.136386 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.136356    2559 generic.go:356] "Generic (PLEG): container finished" podID="21f43562-e905-4794-987b-c92d3b7d77af" containerID="fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8" exitCode=6
Jul 16 22:04:37.136600 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.136418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerDied","Data":"fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8"}
Jul 16 22:04:37.136600 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.136595    2559 scope.go:117] "RemoveContainer" containerID="fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8"
Jul 16 22:04:37.136795 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:37.136778    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6_odh-ai-gateway-infra(21f43562-e905-4794-987b-c92d3b7d77af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" podUID="21f43562-e905-4794-987b-c92d3b7d77af"
Jul 16 22:04:37.143948 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.143929    2559 scope.go:117] "RemoveContainer" containerID="e6da6b4df83f25457004af11a72ba82dad1e9a1eca1f537b990fd7553f0123a1"
Jul 16 22:04:37.170526 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.170502    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:37.176167 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.176143    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-jmxvc"]
Jul 16 22:04:37.679325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.679294    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" path="/var/lib/kubelet/pods/2a6f6e42-6e20-437a-9f9d-a35bae65fd4d/volumes"
Jul 16 22:04:37.691246 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:37.691206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:38.143000 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:38.142976    2559 scope.go:117] "RemoveContainer" containerID="fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8"
Jul 16 22:04:38.143461 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:38.143225    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6_odh-ai-gateway-infra(21f43562-e905-4794-987b-c92d3b7d77af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" podUID="21f43562-e905-4794-987b-c92d3b7d77af"
Jul 16 22:04:43.672773 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:43.672746    2559 scope.go:117] "RemoveContainer" containerID="2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2"
Jul 16 22:04:44.180576 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:44.180547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerStarted","Data":"f643375fe5d02c06b30cf0341d9ba2df0aad0d2335925a00e499f0040ec2225e"}
Jul 16 22:04:44.201838 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:44.201773    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" podStartSLOduration=17.201757834 podStartE2EDuration="17.201757834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:44.198913633 +0000 UTC m=+3347.049531011" watchObservedRunningTime="2026-07-16 22:04:44.201757834 +0000 UTC m=+3347.052375252"
Jul 16 22:04:45.188356 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:45.188326    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerID="f643375fe5d02c06b30cf0341d9ba2df0aad0d2335925a00e499f0040ec2225e" exitCode=6
Jul 16 22:04:45.188792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:45.188400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerDied","Data":"f643375fe5d02c06b30cf0341d9ba2df0aad0d2335925a00e499f0040ec2225e"}
Jul 16 22:04:45.188792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:45.188460    2559 scope.go:117] "RemoveContainer" containerID="2a4e74b424bb00db041f5639007daee99d087ea632cd29a56e331f760049d3b2"
Jul 16 22:04:45.188792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:45.188703    2559 scope.go:117] "RemoveContainer" containerID="f643375fe5d02c06b30cf0341d9ba2df0aad0d2335925a00e499f0040ec2225e"
Jul 16 22:04:45.188985 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:45.188904    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4_odh-ai-gateway-infra(2c4f92fd-36c1-4392-a015-782095ff3a2f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f"
Jul 16 22:04:45.215892 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:45.215868    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:46.208497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.208465    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:04:46.209060 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209039    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209062    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209114    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209124    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209135    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209144    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209257    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.209413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.209270    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:04:46.213701 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.213678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:04:46.219968 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.219940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:04:46.244653 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.244611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z\" (UID: \"6a00c980-1ed6-46c6-89c0-6b8b457d4774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:04:46.346281 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.346254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z\" (UID: \"6a00c980-1ed6-46c6-89c0-6b8b457d4774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:04:46.346786 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.346768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z\" (UID: \"6a00c980-1ed6-46c6-89c0-6b8b457d4774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:04:46.347124 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.347085    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:46.447265 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.447196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca\") pod \"2c4f92fd-36c1-4392-a015-782095ff3a2f\" (UID: \"2c4f92fd-36c1-4392-a015-782095ff3a2f\") "
Jul 16 22:04:46.447561 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.447534    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c4f92fd-36c1-4392-a015-782095ff3a2f" (UID: "2c4f92fd-36c1-4392-a015-782095ff3a2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:04:46.527008 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.526982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:04:46.548167 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.548140    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4f92fd-36c1-4392-a015-782095ff3a2f-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:04:46.867405 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:46.867376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:04:46.868741 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:04:46.868714    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a00c980_1ed6_46c6_89c0_6b8b457d4774.slice/crio-4e8d2c12097e9fcae877b3f3cb6c95c807450708de6eef0785357daf15ededd4 WatchSource:0}: Error finding container 4e8d2c12097e9fcae877b3f3cb6c95c807450708de6eef0785357daf15ededd4: Status 404 returned error can't find the container with id 4e8d2c12097e9fcae877b3f3cb6c95c807450708de6eef0785357daf15ededd4
Jul 16 22:04:47.201840 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.201763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerStarted","Data":"1ba901d0afc53106a31baa9735aaad1c01aa17b189580666ccbf490cb6753182"}
Jul 16 22:04:47.201840 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.201820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerStarted","Data":"4e8d2c12097e9fcae877b3f3cb6c95c807450708de6eef0785357daf15ededd4"}
Jul 16 22:04:47.203100 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.203069    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"
Jul 16 22:04:47.203195 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.203074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4" event={"ID":"2c4f92fd-36c1-4392-a015-782095ff3a2f","Type":"ContainerDied","Data":"ca56dcc370b745748311d621094f4b37b2c751bd56da490e5a8814b9b2cf4a09"}
Jul 16 22:04:47.203195 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.203153    2559 scope.go:117] "RemoveContainer" containerID="f643375fe5d02c06b30cf0341d9ba2df0aad0d2335925a00e499f0040ec2225e"
Jul 16 22:04:47.222642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.222601    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" podStartSLOduration=1.222587936 podStartE2EDuration="1.222587936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:47.220667121 +0000 UTC m=+3350.071284498" watchObservedRunningTime="2026-07-16 22:04:47.222587936 +0000 UTC m=+3350.073205312"
Jul 16 22:04:47.240916 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.240892    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:47.244165 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.244146    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2dpz4"]
Jul 16 22:04:47.686106 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:47.686054    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" path="/var/lib/kubelet/pods/2c4f92fd-36c1-4392-a015-782095ff3a2f/volumes"
Jul 16 22:04:48.210538 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:48.210500    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerID="1ba901d0afc53106a31baa9735aaad1c01aa17b189580666ccbf490cb6753182" exitCode=6
Jul 16 22:04:48.210757 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:48.210579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerDied","Data":"1ba901d0afc53106a31baa9735aaad1c01aa17b189580666ccbf490cb6753182"}
Jul 16 22:04:48.210836 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:48.210779    2559 scope.go:117] "RemoveContainer" containerID="1ba901d0afc53106a31baa9735aaad1c01aa17b189580666ccbf490cb6753182"
Jul 16 22:04:49.218834 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:49.218800    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerID="83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe" exitCode=6
Jul 16 22:04:49.219287 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:49.218890    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerDied","Data":"83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe"}
Jul 16 22:04:49.219287 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:49.218945    2559 scope.go:117] "RemoveContainer" containerID="1ba901d0afc53106a31baa9735aaad1c01aa17b189580666ccbf490cb6753182"
Jul 16 22:04:49.219287 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:49.219165    2559 scope.go:117] "RemoveContainer" containerID="83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe"
Jul 16 22:04:49.219456 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:49.219400    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z_odh-ai-gateway-infra(6a00c980-1ed6-46c6-89c0-6b8b457d4774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774"
Jul 16 22:04:50.226268 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:50.226245    2559 scope.go:117] "RemoveContainer" containerID="83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe"
Jul 16 22:04:50.226636 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:50.226448    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z_odh-ai-gateway-infra(6a00c980-1ed6-46c6-89c0-6b8b457d4774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774"
Jul 16 22:04:50.672848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:50.672766    2559 scope.go:117] "RemoveContainer" containerID="fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8"
Jul 16 22:04:51.234541 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:51.234507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerStarted","Data":"587cf009e2570fd2efa9377483ddc3ceb4af0fcb18ffc8be6e51dba92087de88"}
Jul 16 22:04:52.241877 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:52.241848    2559 generic.go:356] "Generic (PLEG): container finished" podID="21f43562-e905-4794-987b-c92d3b7d77af" containerID="587cf009e2570fd2efa9377483ddc3ceb4af0fcb18ffc8be6e51dba92087de88" exitCode=6
Jul 16 22:04:52.242304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:52.241908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerDied","Data":"587cf009e2570fd2efa9377483ddc3ceb4af0fcb18ffc8be6e51dba92087de88"}
Jul 16 22:04:52.242304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:52.241964    2559 scope.go:117] "RemoveContainer" containerID="fecd6c30977041dea79f06061c587f8fc1fa5de667c1290dbeeded459033eab8"
Jul 16 22:04:52.242304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:52.242263    2559 scope.go:117] "RemoveContainer" containerID="587cf009e2570fd2efa9377483ddc3ceb4af0fcb18ffc8be6e51dba92087de88"
Jul 16 22:04:52.242484 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:04:52.242460    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6_odh-ai-gateway-infra(21f43562-e905-4794-987b-c92d3b7d77af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" podUID="21f43562-e905-4794-987b-c92d3b7d77af"
Jul 16 22:04:52.271233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:52.271210    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:53.396361 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:53.396336    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:53.507038 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:53.506948    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca\") pod \"21f43562-e905-4794-987b-c92d3b7d77af\" (UID: \"21f43562-e905-4794-987b-c92d3b7d77af\") "
Jul 16 22:04:53.508791 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:53.508765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21f43562-e905-4794-987b-c92d3b7d77af" (UID: "21f43562-e905-4794-987b-c92d3b7d77af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:04:53.608646 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:53.608612    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f43562-e905-4794-987b-c92d3b7d77af-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:04:54.257643 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:54.257605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6" event={"ID":"21f43562-e905-4794-987b-c92d3b7d77af","Type":"ContainerDied","Data":"2d3eaaba75e9acd5a85067f1e302e790f435f3bcf2f53660ac9c635a94b5d825"}
Jul 16 22:04:54.257814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:54.257676    2559 scope.go:117] "RemoveContainer" containerID="587cf009e2570fd2efa9377483ddc3ceb4af0fcb18ffc8be6e51dba92087de88"
Jul 16 22:04:54.257814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:54.257619    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"
Jul 16 22:04:54.280134 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:54.280103    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:54.285477 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:54.285456    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-m64v6"]
Jul 16 22:04:55.678776 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:55.678736    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f43562-e905-4794-987b-c92d3b7d77af" path="/var/lib/kubelet/pods/21f43562-e905-4794-987b-c92d3b7d77af/volumes"
Jul 16 22:04:57.583777 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:57.583742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:04:58.878934 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:04:58.878895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:00.672836 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:00.672798    2559 scope.go:117] "RemoveContainer" containerID="83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe"
Jul 16 22:05:01.304164 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:01.304125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerStarted","Data":"617bf8511da03c437c009ad5a02cd5b9ba7da5e75defd07bc88dfe327f2fca5b"}
Jul 16 22:05:02.311428 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:02.311396    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerID="617bf8511da03c437c009ad5a02cd5b9ba7da5e75defd07bc88dfe327f2fca5b" exitCode=6
Jul 16 22:05:02.311844 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:02.311452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerDied","Data":"617bf8511da03c437c009ad5a02cd5b9ba7da5e75defd07bc88dfe327f2fca5b"}
Jul 16 22:05:02.311844 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:02.311515    2559 scope.go:117] "RemoveContainer" containerID="83561217a6044c1148ad1878743856848346032ddfc9b6cda63be934b97137fe"
Jul 16 22:05:02.311844 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:02.311793    2559 scope.go:117] "RemoveContainer" containerID="617bf8511da03c437c009ad5a02cd5b9ba7da5e75defd07bc88dfe327f2fca5b"
Jul 16 22:05:02.312024 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:02.312006    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z_odh-ai-gateway-infra(6a00c980-1ed6-46c6-89c0-6b8b457d4774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774"
Jul 16 22:05:02.338556 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:02.338534    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:05:03.469234 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:03.469208    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:05:03.598054 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:03.597965    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca\") pod \"6a00c980-1ed6-46c6-89c0-6b8b457d4774\" (UID: \"6a00c980-1ed6-46c6-89c0-6b8b457d4774\") "
Jul 16 22:05:03.598346 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:03.598326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a00c980-1ed6-46c6-89c0-6b8b457d4774" (UID: "6a00c980-1ed6-46c6-89c0-6b8b457d4774"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:03.699580 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:03.699556    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a00c980-1ed6-46c6-89c0-6b8b457d4774-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:05:04.325165 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:04.325132    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"
Jul 16 22:05:04.325372 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:04.325132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z" event={"ID":"6a00c980-1ed6-46c6-89c0-6b8b457d4774","Type":"ContainerDied","Data":"4e8d2c12097e9fcae877b3f3cb6c95c807450708de6eef0785357daf15ededd4"}
Jul 16 22:05:04.325372 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:04.325263    2559 scope.go:117] "RemoveContainer" containerID="617bf8511da03c437c009ad5a02cd5b9ba7da5e75defd07bc88dfe327f2fca5b"
Jul 16 22:05:04.357938 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:04.357907    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:05:04.365538 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:04.365507    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-kvk8z"]
Jul 16 22:05:05.679263 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:05.679234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" path="/var/lib/kubelet/pods/6a00c980-1ed6-46c6-89c0-6b8b457d4774/volumes"
Jul 16 22:05:15.752697 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:15.752661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:16.547400 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547368    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:16.547800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547786    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.547800 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547809    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547814    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547823    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547831    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547843    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547853    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547865    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547872    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547919    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.547936 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.547927    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548035    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548046    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548055    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548064    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548075    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548082    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548108    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6f6e42-6e20-437a-9f9d-a35bae65fd4d" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548116    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.548309 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.548126    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:16.551508 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.551489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:16.554583 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.554566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:05:16.560707 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.560682    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:16.716216 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.716181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8\" (UID: \"6addad30-eb33-4b67-885f-abc95d5d8e33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:16.817500 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.817401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8\" (UID: \"6addad30-eb33-4b67-885f-abc95d5d8e33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:16.818289 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.818264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8\" (UID: \"6addad30-eb33-4b67-885f-abc95d5d8e33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:16.863176 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:16.863147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:17.006246 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.006205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:17.008616 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:05:17.008580    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6addad30_eb33_4b67_885f_abc95d5d8e33.slice/crio-862b7153f3dcce9a6f6b1a856fa40e3a9d43ad6efd9d9e6058a55b68f333fe15 WatchSource:0}: Error finding container 862b7153f3dcce9a6f6b1a856fa40e3a9d43ad6efd9d9e6058a55b68f333fe15: Status 404 returned error can't find the container with id 862b7153f3dcce9a6f6b1a856fa40e3a9d43ad6efd9d9e6058a55b68f333fe15
Jul 16 22:05:17.398019 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.397986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerStarted","Data":"858b378feff42011255ac7d0b374b4f4bbf30fd7672180f6860c39e4e800f2d7"}
Jul 16 22:05:17.398148 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.398046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerStarted","Data":"862b7153f3dcce9a6f6b1a856fa40e3a9d43ad6efd9d9e6058a55b68f333fe15"}
Jul 16 22:05:17.837600 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.837551    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" podStartSLOduration=1.8375354590000001 podStartE2EDuration="1.837535459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:17.426639789 +0000 UTC m=+3380.277257166" watchObservedRunningTime="2026-07-16 22:05:17.837535459 +0000 UTC m=+3380.688152884"
Jul 16 22:05:17.838972 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.838952    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:17.839379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839365    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:17.839426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839381    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:17.839426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839391    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:17.839426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839396    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f43562-e905-4794-987b-c92d3b7d77af" containerName="revoke-keys"
Jul 16 22:05:17.839426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839403    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:17.839426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839410    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4f92fd-36c1-4392-a015-782095ff3a2f" containerName="revoke-keys"
Jul 16 22:05:17.839577 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.839489    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a00c980-1ed6-46c6-89c0-6b8b457d4774" containerName="revoke-keys"
Jul 16 22:05:17.842527 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.842509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:17.875766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.875735    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:17.896194 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.896157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:17.977632 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:17.977581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:18.030033 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.029998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c\" (UID: \"475039d0-2fb6-4437-8f14-bc767bce5181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:18.131643 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.131613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c\" (UID: \"475039d0-2fb6-4437-8f14-bc767bce5181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:18.132286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.132255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c\" (UID: \"475039d0-2fb6-4437-8f14-bc767bce5181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:18.154024 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.153996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:18.305762 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.305735    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:18.306257 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:05:18.306236    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475039d0_2fb6_4437_8f14_bc767bce5181.slice/crio-41cea4705d4353ede98e02870c880e54031eae9c103784f73ed879da4a934e4d WatchSource:0}: Error finding container 41cea4705d4353ede98e02870c880e54031eae9c103784f73ed879da4a934e4d: Status 404 returned error can't find the container with id 41cea4705d4353ede98e02870c880e54031eae9c103784f73ed879da4a934e4d
Jul 16 22:05:18.404399 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.404364    2559 generic.go:356] "Generic (PLEG): container finished" podID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerID="858b378feff42011255ac7d0b374b4f4bbf30fd7672180f6860c39e4e800f2d7" exitCode=6
Jul 16 22:05:18.404547 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.404446    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerDied","Data":"858b378feff42011255ac7d0b374b4f4bbf30fd7672180f6860c39e4e800f2d7"}
Jul 16 22:05:18.404620 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.404598    2559 scope.go:117] "RemoveContainer" containerID="858b378feff42011255ac7d0b374b4f4bbf30fd7672180f6860c39e4e800f2d7"
Jul 16 22:05:18.405746 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:18.405725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" event={"ID":"475039d0-2fb6-4437-8f14-bc767bce5181","Type":"ContainerStarted","Data":"41cea4705d4353ede98e02870c880e54031eae9c103784f73ed879da4a934e4d"}
Jul 16 22:05:19.412830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.412794    2559 generic.go:356] "Generic (PLEG): container finished" podID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerID="0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a" exitCode=6
Jul 16 22:05:19.413304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.412893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerDied","Data":"0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a"}
Jul 16 22:05:19.413304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.412992    2559 scope.go:117] "RemoveContainer" containerID="858b378feff42011255ac7d0b374b4f4bbf30fd7672180f6860c39e4e800f2d7"
Jul 16 22:05:19.413304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.413119    2559 scope.go:117] "RemoveContainer" containerID="0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a"
Jul 16 22:05:19.413472 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:19.413361    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8_odh-ai-gateway-infra(6addad30-eb33-4b67-885f-abc95d5d8e33)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33"
Jul 16 22:05:19.414627 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.414606    2559 generic.go:356] "Generic (PLEG): container finished" podID="475039d0-2fb6-4437-8f14-bc767bce5181" containerID="31221a7437c444a23e51b84e04ac8a638d0942cb5a289ded3439f316d7b828f2" exitCode=6
Jul 16 22:05:19.414763 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.414673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" event={"ID":"475039d0-2fb6-4437-8f14-bc767bce5181","Type":"ContainerDied","Data":"31221a7437c444a23e51b84e04ac8a638d0942cb5a289ded3439f316d7b828f2"}
Jul 16 22:05:19.414849 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:19.414836    2559 scope.go:117] "RemoveContainer" containerID="31221a7437c444a23e51b84e04ac8a638d0942cb5a289ded3439f316d7b828f2"
Jul 16 22:05:20.421980 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:20.421903    2559 scope.go:117] "RemoveContainer" containerID="0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a"
Jul 16 22:05:20.422415 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:20.422150    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8_odh-ai-gateway-infra(6addad30-eb33-4b67-885f-abc95d5d8e33)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33"
Jul 16 22:05:20.423504 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:20.423482    2559 generic.go:356] "Generic (PLEG): container finished" podID="475039d0-2fb6-4437-8f14-bc767bce5181" containerID="914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7" exitCode=6
Jul 16 22:05:20.423630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:20.423559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" event={"ID":"475039d0-2fb6-4437-8f14-bc767bce5181","Type":"ContainerDied","Data":"914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7"}
Jul 16 22:05:20.423630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:20.423613    2559 scope.go:117] "RemoveContainer" containerID="31221a7437c444a23e51b84e04ac8a638d0942cb5a289ded3439f316d7b828f2"
Jul 16 22:05:20.423716 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:20.423695    2559 scope.go:117] "RemoveContainer" containerID="914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7"
Jul 16 22:05:20.423871 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:20.423848    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c_odh-ai-gateway-infra(475039d0-2fb6-4437-8f14-bc767bce5181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" podUID="475039d0-2fb6-4437-8f14-bc767bce5181"
Jul 16 22:05:21.430683 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:21.430638    2559 scope.go:117] "RemoveContainer" containerID="914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7"
Jul 16 22:05:21.431068 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:21.430838    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c_odh-ai-gateway-infra(475039d0-2fb6-4437-8f14-bc767bce5181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" podUID="475039d0-2fb6-4437-8f14-bc767bce5181"
Jul 16 22:05:30.672473 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:30.672444    2559 scope.go:117] "RemoveContainer" containerID="0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a"
Jul 16 22:05:31.487039 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:31.487006    2559 generic.go:356] "Generic (PLEG): container finished" podID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerID="4365d9844d8f788f608f1701e270abfa18fd2e86598fd5c3701cbcba3c0d6f9c" exitCode=6
Jul 16 22:05:31.487240 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:31.487060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerDied","Data":"4365d9844d8f788f608f1701e270abfa18fd2e86598fd5c3701cbcba3c0d6f9c"}
Jul 16 22:05:31.487240 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:31.487148    2559 scope.go:117] "RemoveContainer" containerID="0193d11c9724a074b036873d0ef3965961f35d55cd59e9d646df94e68212838a"
Jul 16 22:05:31.487470 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:31.487450    2559 scope.go:117] "RemoveContainer" containerID="4365d9844d8f788f608f1701e270abfa18fd2e86598fd5c3701cbcba3c0d6f9c"
Jul 16 22:05:31.487731 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:31.487709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8_odh-ai-gateway-infra(6addad30-eb33-4b67-885f-abc95d5d8e33)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33"
Jul 16 22:05:32.517574 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:32.517545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:32.663182 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:32.663159    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:32.758148 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:32.758119    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca\") pod \"6addad30-eb33-4b67-885f-abc95d5d8e33\" (UID: \"6addad30-eb33-4b67-885f-abc95d5d8e33\") "
Jul 16 22:05:32.758538 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:32.758512    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6addad30-eb33-4b67-885f-abc95d5d8e33" (UID: "6addad30-eb33-4b67-885f-abc95d5d8e33"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:32.859344 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:32.859274    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6addad30-eb33-4b67-885f-abc95d5d8e33-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:05:33.344663 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.344626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:05:33.500237 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.500203    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"
Jul 16 22:05:33.500428 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.500240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8" event={"ID":"6addad30-eb33-4b67-885f-abc95d5d8e33","Type":"ContainerDied","Data":"862b7153f3dcce9a6f6b1a856fa40e3a9d43ad6efd9d9e6058a55b68f333fe15"}
Jul 16 22:05:33.500428 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.500309    2559 scope.go:117] "RemoveContainer" containerID="4365d9844d8f788f608f1701e270abfa18fd2e86598fd5c3701cbcba3c0d6f9c"
Jul 16 22:05:33.525022 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.524989    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:33.529975 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.529949    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-vxxm8"]
Jul 16 22:05:33.679123 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:33.679028    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" path="/var/lib/kubelet/pods/6addad30-eb33-4b67-885f-abc95d5d8e33/volumes"
Jul 16 22:05:34.172504 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172464    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:34.172933 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172916    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172935    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172956    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172964    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172979    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.172989    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.173106    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.173325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.173126    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:34.176292 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.176272    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:34.189146 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.189122    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:34.272170 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.272135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4\" (UID: \"ae03a2df-98ed-442a-8e6b-89cdf445d3eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:34.372797 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.372769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4\" (UID: \"ae03a2df-98ed-442a-8e6b-89cdf445d3eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:34.373362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.373344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4\" (UID: \"ae03a2df-98ed-442a-8e6b-89cdf445d3eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:34.486549 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.486515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:34.631274 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.631241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:34.631644 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:05:34.631462    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae03a2df_98ed_442a_8e6b_89cdf445d3eb.slice/crio-a6fa33bdf076706862ffd9814cb15669933fd84f1014d733ebfcadfd7bf68e13 WatchSource:0}: Error finding container a6fa33bdf076706862ffd9814cb15669933fd84f1014d733ebfcadfd7bf68e13: Status 404 returned error can't find the container with id a6fa33bdf076706862ffd9814cb15669933fd84f1014d733ebfcadfd7bf68e13
Jul 16 22:05:34.672844 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:34.672826    2559 scope.go:117] "RemoveContainer" containerID="914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7"
Jul 16 22:05:35.514770 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.514740    2559 generic.go:356] "Generic (PLEG): container finished" podID="475039d0-2fb6-4437-8f14-bc767bce5181" containerID="ffcb76a716637e888cbfaafdd30365603e15ae9d7fc2a28f39e7b6f22fafb294" exitCode=6
Jul 16 22:05:35.514970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.514814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" event={"ID":"475039d0-2fb6-4437-8f14-bc767bce5181","Type":"ContainerDied","Data":"ffcb76a716637e888cbfaafdd30365603e15ae9d7fc2a28f39e7b6f22fafb294"}
Jul 16 22:05:35.514970 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.514869    2559 scope.go:117] "RemoveContainer" containerID="914cd69da6cd32f047163fade3981a616328d30bae4be188b25e72161b8a2fb7"
Jul 16 22:05:35.515231 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.515207    2559 scope.go:117] "RemoveContainer" containerID="ffcb76a716637e888cbfaafdd30365603e15ae9d7fc2a28f39e7b6f22fafb294"
Jul 16 22:05:35.515464 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:35.515439    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c_odh-ai-gateway-infra(475039d0-2fb6-4437-8f14-bc767bce5181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" podUID="475039d0-2fb6-4437-8f14-bc767bce5181"
Jul 16 22:05:35.516690 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.516662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerStarted","Data":"52fabe7982fe3b1ac85d228dbe020701639db8c2b12748907fe44d6d29b0c5c5"}
Jul 16 22:05:35.516752 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.516699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerStarted","Data":"a6fa33bdf076706862ffd9814cb15669933fd84f1014d733ebfcadfd7bf68e13"}
Jul 16 22:05:35.549012 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:35.548966    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" podStartSLOduration=1.548948419 podStartE2EDuration="1.548948419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:35.548601834 +0000 UTC m=+3398.399219215" watchObservedRunningTime="2026-07-16 22:05:35.548948419 +0000 UTC m=+3398.399565795"
Jul 16 22:05:36.287523 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.287493    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:36.288004 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.287989    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6addad30-eb33-4b67-885f-abc95d5d8e33" containerName="revoke-keys"
Jul 16 22:05:36.291062 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.291047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:36.303525 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.303498    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:36.390375 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.390344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj\" (UID: \"72c51f91-72e8-442c-8424-8c731dd1a686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:36.491297 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.491262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj\" (UID: \"72c51f91-72e8-442c-8424-8c731dd1a686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:36.491921 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.491883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj\" (UID: \"72c51f91-72e8-442c-8424-8c731dd1a686\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:36.524324 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.524292    2559 generic.go:356] "Generic (PLEG): container finished" podID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerID="52fabe7982fe3b1ac85d228dbe020701639db8c2b12748907fe44d6d29b0c5c5" exitCode=6
Jul 16 22:05:36.524497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.524376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerDied","Data":"52fabe7982fe3b1ac85d228dbe020701639db8c2b12748907fe44d6d29b0c5c5"}
Jul 16 22:05:36.524585 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.524515    2559 scope.go:117] "RemoveContainer" containerID="52fabe7982fe3b1ac85d228dbe020701639db8c2b12748907fe44d6d29b0c5c5"
Jul 16 22:05:36.545119 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.545079    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:36.601581 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.601553    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:36.697742 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.697719    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:36.756823 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.756789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:36.760665 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:05:36.760622    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c51f91_72e8_442c_8424_8c731dd1a686.slice/crio-afbe347c776d1795a453ffb7eb789dc8d105f772d54fe612b581d2905b1e350a WatchSource:0}: Error finding container afbe347c776d1795a453ffb7eb789dc8d105f772d54fe612b581d2905b1e350a: Status 404 returned error can't find the container with id afbe347c776d1795a453ffb7eb789dc8d105f772d54fe612b581d2905b1e350a
Jul 16 22:05:36.794108 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.794070    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca\") pod \"475039d0-2fb6-4437-8f14-bc767bce5181\" (UID: \"475039d0-2fb6-4437-8f14-bc767bce5181\") "
Jul 16 22:05:36.794438 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.794406    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "475039d0-2fb6-4437-8f14-bc767bce5181" (UID: "475039d0-2fb6-4437-8f14-bc767bce5181"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:36.895071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:36.895045    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/475039d0-2fb6-4437-8f14-bc767bce5181-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:05:37.534427 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.534399    2559 generic.go:356] "Generic (PLEG): container finished" podID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerID="6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1" exitCode=6
Jul 16 22:05:37.534823 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.534490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerDied","Data":"6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1"}
Jul 16 22:05:37.534823 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.534561    2559 scope.go:117] "RemoveContainer" containerID="52fabe7982fe3b1ac85d228dbe020701639db8c2b12748907fe44d6d29b0c5c5"
Jul 16 22:05:37.534823 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.534762    2559 scope.go:117] "RemoveContainer" containerID="6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1"
Jul 16 22:05:37.535016 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:37.534991    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4_odh-ai-gateway-infra(ae03a2df-98ed-442a-8e6b-89cdf445d3eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb"
Jul 16 22:05:37.536220 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.536198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerStarted","Data":"d082ed34aa0fa446fab5ea2b6f5821c6521038591a16ec32a5066beccfaf4234"}
Jul 16 22:05:37.536329 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.536257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerStarted","Data":"afbe347c776d1795a453ffb7eb789dc8d105f772d54fe612b581d2905b1e350a"}
Jul 16 22:05:37.537557 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.537537    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"
Jul 16 22:05:37.537644 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.537566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c" event={"ID":"475039d0-2fb6-4437-8f14-bc767bce5181","Type":"ContainerDied","Data":"41cea4705d4353ede98e02870c880e54031eae9c103784f73ed879da4a934e4d"}
Jul 16 22:05:37.552973 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.552953    2559 scope.go:117] "RemoveContainer" containerID="ffcb76a716637e888cbfaafdd30365603e15ae9d7fc2a28f39e7b6f22fafb294"
Jul 16 22:05:37.577806 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.577765    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" podStartSLOduration=1.577750985 podStartE2EDuration="1.577750985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:37.577345047 +0000 UTC m=+3400.427962428" watchObservedRunningTime="2026-07-16 22:05:37.577750985 +0000 UTC m=+3400.428368362"
Jul 16 22:05:37.596671 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.596650    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:37.601366 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.601318    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-2sv8c"]
Jul 16 22:05:37.679408 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:37.679384    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" path="/var/lib/kubelet/pods/475039d0-2fb6-4437-8f14-bc767bce5181/volumes"
Jul 16 22:05:38.544930 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:38.544895    2559 generic.go:356] "Generic (PLEG): container finished" podID="72c51f91-72e8-442c-8424-8c731dd1a686" containerID="d082ed34aa0fa446fab5ea2b6f5821c6521038591a16ec32a5066beccfaf4234" exitCode=6
Jul 16 22:05:38.545423 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:38.544982    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerDied","Data":"d082ed34aa0fa446fab5ea2b6f5821c6521038591a16ec32a5066beccfaf4234"}
Jul 16 22:05:38.545423 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:38.545175    2559 scope.go:117] "RemoveContainer" containerID="d082ed34aa0fa446fab5ea2b6f5821c6521038591a16ec32a5066beccfaf4234"
Jul 16 22:05:38.547954 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:38.547937    2559 scope.go:117] "RemoveContainer" containerID="6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1"
Jul 16 22:05:38.548154 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:38.548133    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4_odh-ai-gateway-infra(ae03a2df-98ed-442a-8e6b-89cdf445d3eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb"
Jul 16 22:05:39.556491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:39.556457    2559 generic.go:356] "Generic (PLEG): container finished" podID="72c51f91-72e8-442c-8424-8c731dd1a686" containerID="4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9" exitCode=6
Jul 16 22:05:39.556927 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:39.556544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerDied","Data":"4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9"}
Jul 16 22:05:39.556927 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:39.556601    2559 scope.go:117] "RemoveContainer" containerID="d082ed34aa0fa446fab5ea2b6f5821c6521038591a16ec32a5066beccfaf4234"
Jul 16 22:05:39.556927 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:39.556810    2559 scope.go:117] "RemoveContainer" containerID="4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9"
Jul 16 22:05:39.557139 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:39.557049    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj_odh-ai-gateway-infra(72c51f91-72e8-442c-8424-8c731dd1a686)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" podUID="72c51f91-72e8-442c-8424-8c731dd1a686"
Jul 16 22:05:40.564323 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:40.564300    2559 scope.go:117] "RemoveContainer" containerID="4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9"
Jul 16 22:05:40.564714 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:40.564480    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj_odh-ai-gateway-infra(72c51f91-72e8-442c-8424-8c731dd1a686)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" podUID="72c51f91-72e8-442c-8424-8c731dd1a686"
Jul 16 22:05:49.679128 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:49.679034    2559 scope.go:117] "RemoveContainer" containerID="6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1"
Jul 16 22:05:50.622045 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:50.621964    2559 generic.go:356] "Generic (PLEG): container finished" podID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerID="ae35b949eba7e61cf9554b3cd2d815dfbf305515e6abeff8d4addc559d372460" exitCode=6
Jul 16 22:05:50.622045 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:50.622033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerDied","Data":"ae35b949eba7e61cf9554b3cd2d815dfbf305515e6abeff8d4addc559d372460"}
Jul 16 22:05:50.622255 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:50.622120    2559 scope.go:117] "RemoveContainer" containerID="6d64df1ed0f1a75ea46f639517f1fbf9007c8b7d878e770696e0b960449782e1"
Jul 16 22:05:50.622413 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:50.622395    2559 scope.go:117] "RemoveContainer" containerID="ae35b949eba7e61cf9554b3cd2d815dfbf305515e6abeff8d4addc559d372460"
Jul 16 22:05:50.622680 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:50.622649    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4_odh-ai-gateway-infra(ae03a2df-98ed-442a-8e6b-89cdf445d3eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb"
Jul 16 22:05:51.651230 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:51.651105    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:51.790938 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:51.790917    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:51.928394 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:51.928321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca\") pod \"ae03a2df-98ed-442a-8e6b-89cdf445d3eb\" (UID: \"ae03a2df-98ed-442a-8e6b-89cdf445d3eb\") "
Jul 16 22:05:51.928646 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:51.928624    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae03a2df-98ed-442a-8e6b-89cdf445d3eb" (UID: "ae03a2df-98ed-442a-8e6b-89cdf445d3eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:52.029254 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.029229    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae03a2df-98ed-442a-8e6b-89cdf445d3eb-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:05:52.635582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.635547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4" event={"ID":"ae03a2df-98ed-442a-8e6b-89cdf445d3eb","Type":"ContainerDied","Data":"a6fa33bdf076706862ffd9814cb15669933fd84f1014d733ebfcadfd7bf68e13"}
Jul 16 22:05:52.635761 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.635630    2559 scope.go:117] "RemoveContainer" containerID="ae35b949eba7e61cf9554b3cd2d815dfbf305515e6abeff8d4addc559d372460"
Jul 16 22:05:52.635761 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.635557    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"
Jul 16 22:05:52.662423 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.662397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:52.672267 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:52.672236    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ds9p4"]
Jul 16 22:05:53.679041 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:53.679011    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" path="/var/lib/kubelet/pods/ae03a2df-98ed-442a-8e6b-89cdf445d3eb/volumes"
Jul 16 22:05:54.673224 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:54.673196    2559 scope.go:117] "RemoveContainer" containerID="4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9"
Jul 16 22:05:55.657975 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:55.657890    2559 generic.go:356] "Generic (PLEG): container finished" podID="72c51f91-72e8-442c-8424-8c731dd1a686" containerID="57df54b7bd40593e13049bf95b5878ddce577e6b37d2fbf5e620943b0e8080ba" exitCode=6
Jul 16 22:05:55.657975 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:55.657917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerDied","Data":"57df54b7bd40593e13049bf95b5878ddce577e6b37d2fbf5e620943b0e8080ba"}
Jul 16 22:05:55.658471 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:55.658003    2559 scope.go:117] "RemoveContainer" containerID="4064e050095b178ab29ab3a9db98682b4e77c2428bc3b8b4b07f62f4cde4cff9"
Jul 16 22:05:55.658471 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:55.658348    2559 scope.go:117] "RemoveContainer" containerID="57df54b7bd40593e13049bf95b5878ddce577e6b37d2fbf5e620943b0e8080ba"
Jul 16 22:05:55.658604 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:05:55.658583    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj_odh-ai-gateway-infra(72c51f91-72e8-442c-8424-8c731dd1a686)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" podUID="72c51f91-72e8-442c-8424-8c731dd1a686"
Jul 16 22:05:56.691138 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:56.691083    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:56.850158 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:56.850135    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:56.976829 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:56.976800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca\") pod \"72c51f91-72e8-442c-8424-8c731dd1a686\" (UID: \"72c51f91-72e8-442c-8424-8c731dd1a686\") "
Jul 16 22:05:56.977253 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:56.977230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72c51f91-72e8-442c-8424-8c731dd1a686" (UID: "72c51f91-72e8-442c-8424-8c731dd1a686"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:57.077745 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.077722    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c51f91-72e8-442c-8424-8c731dd1a686-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:05:57.675345 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.675311    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"
Jul 16 22:05:57.679488 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.679456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj" event={"ID":"72c51f91-72e8-442c-8424-8c731dd1a686","Type":"ContainerDied","Data":"afbe347c776d1795a453ffb7eb789dc8d105f772d54fe612b581d2905b1e350a"}
Jul 16 22:05:57.679627 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.679498    2559 scope.go:117] "RemoveContainer" containerID="57df54b7bd40593e13049bf95b5878ddce577e6b37d2fbf5e620943b0e8080ba"
Jul 16 22:05:57.724959 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.724930    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:57.733679 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:57.733658    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-rl7vj"]
Jul 16 22:05:59.678061 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:59.678026    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" path="/var/lib/kubelet/pods/72c51f91-72e8-442c-8424-8c731dd1a686/volumes"
Jul 16 22:05:59.965022 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:05:59.964984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:00.066692 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:00.066654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:06.619497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619461    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:06.619855 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619842    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.619855 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619856    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619865    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619870    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619884    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619890    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619898    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619903    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619920    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619925    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619931    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619937    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619944    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619949    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.619953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619956    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.619961    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620032    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620040    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620046    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620052    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620058    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620064    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620070    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.620379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.620076    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="475039d0-2fb6-4437-8f14-bc767bce5181" containerName="revoke-keys"
Jul 16 22:06:06.624704 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.624687    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:06.628520 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.628503    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:06:06.635278 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.634812    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:06.761002 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.760971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k\" (UID: \"6ab07bb3-eac9-474b-8de8-fff581b3d852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:06.862494 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.862462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k\" (UID: \"6ab07bb3-eac9-474b-8de8-fff581b3d852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:06.863064 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.863042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k\" (UID: \"6ab07bb3-eac9-474b-8de8-fff581b3d852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:06.937300 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:06.937233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:07.074011 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.073982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:07.076333 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:07.076308    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab07bb3_eac9_474b_8de8_fff581b3d852.slice/crio-15607843981c72ffc47f0d7d7a99d5ae350d2c3df6e7cc6e30057c3922c1f217 WatchSource:0}: Error finding container 15607843981c72ffc47f0d7d7a99d5ae350d2c3df6e7cc6e30057c3922c1f217: Status 404 returned error can't find the container with id 15607843981c72ffc47f0d7d7a99d5ae350d2c3df6e7cc6e30057c3922c1f217
Jul 16 22:06:07.723718 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.723686    2559 generic.go:356] "Generic (PLEG): container finished" podID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerID="a1a97f702e01b6430cc464d5e14585eb0d0a255add45d0a257a0717dea9f3013" exitCode=6
Jul 16 22:06:07.724149 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.723769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" event={"ID":"6ab07bb3-eac9-474b-8de8-fff581b3d852","Type":"ContainerDied","Data":"a1a97f702e01b6430cc464d5e14585eb0d0a255add45d0a257a0717dea9f3013"}
Jul 16 22:06:07.724149 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.723825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" event={"ID":"6ab07bb3-eac9-474b-8de8-fff581b3d852","Type":"ContainerStarted","Data":"15607843981c72ffc47f0d7d7a99d5ae350d2c3df6e7cc6e30057c3922c1f217"}
Jul 16 22:06:07.724149 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.723968    2559 scope.go:117] "RemoveContainer" containerID="a1a97f702e01b6430cc464d5e14585eb0d0a255add45d0a257a0717dea9f3013"
Jul 16 22:06:07.869560 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.869530    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:07.869939 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.869926    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:07.869939 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.869939    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c51f91-72e8-442c-8424-8c731dd1a686" containerName="revoke-keys"
Jul 16 22:06:07.870055 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.870016    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae03a2df-98ed-442a-8e6b-89cdf445d3eb" containerName="revoke-keys"
Jul 16 22:06:07.874507 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.874485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:07.882969 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.882933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:07.972471 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:07.972439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx\" (UID: \"abb78324-4e39-4889-9e04-ddb78b3977f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:08.073456 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.073420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx\" (UID: \"abb78324-4e39-4889-9e04-ddb78b3977f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:08.074070 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.074044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx\" (UID: \"abb78324-4e39-4889-9e04-ddb78b3977f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:08.186013 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.185965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:08.326043 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.326013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:08.328182 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:08.328155    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb78324_4e39_4889_9e04_ddb78b3977f5.slice/crio-4c5040457cc79eb5335627ec7a3493eb63ba171ad455eeae689487103fa8f0ac WatchSource:0}: Error finding container 4c5040457cc79eb5335627ec7a3493eb63ba171ad455eeae689487103fa8f0ac: Status 404 returned error can't find the container with id 4c5040457cc79eb5335627ec7a3493eb63ba171ad455eeae689487103fa8f0ac
Jul 16 22:06:08.520792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.520701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:08.731214 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.731186    2559 generic.go:356] "Generic (PLEG): container finished" podID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerID="b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8" exitCode=6
Jul 16 22:06:08.731690 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.731277    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" event={"ID":"6ab07bb3-eac9-474b-8de8-fff581b3d852","Type":"ContainerDied","Data":"b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8"}
Jul 16 22:06:08.731690 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.731341    2559 scope.go:117] "RemoveContainer" containerID="a1a97f702e01b6430cc464d5e14585eb0d0a255add45d0a257a0717dea9f3013"
Jul 16 22:06:08.731690 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.731588    2559 scope.go:117] "RemoveContainer" containerID="b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8"
Jul 16 22:06:08.731862 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:08.731821    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k_odh-ai-gateway-infra(6ab07bb3-eac9-474b-8de8-fff581b3d852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852"
Jul 16 22:06:08.733017 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.732991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerStarted","Data":"821a40f8d867173e2a021e48044f7a4904c24a76fadb0ce5e3f1fda0fdeed91e"}
Jul 16 22:06:08.733167 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.733041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerStarted","Data":"4c5040457cc79eb5335627ec7a3493eb63ba171ad455eeae689487103fa8f0ac"}
Jul 16 22:06:08.781651 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:08.781555    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" podStartSLOduration=1.781540617 podStartE2EDuration="1.781540617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:06:08.779591648 +0000 UTC m=+3431.630209025" watchObservedRunningTime="2026-07-16 22:06:08.781540617 +0000 UTC m=+3431.632157994"
Jul 16 22:06:09.282482 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:09.282452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:09.740010 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:09.739982    2559 scope.go:117] "RemoveContainer" containerID="b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8"
Jul 16 22:06:09.740486 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:09.740242    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k_odh-ai-gateway-infra(6ab07bb3-eac9-474b-8de8-fff581b3d852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852"
Jul 16 22:06:09.741357 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:09.741333    2559 generic.go:356] "Generic (PLEG): container finished" podID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerID="821a40f8d867173e2a021e48044f7a4904c24a76fadb0ce5e3f1fda0fdeed91e" exitCode=6
Jul 16 22:06:09.741465 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:09.741429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerDied","Data":"821a40f8d867173e2a021e48044f7a4904c24a76fadb0ce5e3f1fda0fdeed91e"}
Jul 16 22:06:09.741562 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:09.741547    2559 scope.go:117] "RemoveContainer" containerID="821a40f8d867173e2a021e48044f7a4904c24a76fadb0ce5e3f1fda0fdeed91e"
Jul 16 22:06:10.749030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:10.748994    2559 generic.go:356] "Generic (PLEG): container finished" podID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerID="97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e" exitCode=6
Jul 16 22:06:10.749517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:10.749085    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerDied","Data":"97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e"}
Jul 16 22:06:10.749517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:10.749179    2559 scope.go:117] "RemoveContainer" containerID="821a40f8d867173e2a021e48044f7a4904c24a76fadb0ce5e3f1fda0fdeed91e"
Jul 16 22:06:10.749517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:10.749417    2559 scope.go:117] "RemoveContainer" containerID="97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e"
Jul 16 22:06:10.749653 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:10.749631    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx_odh-ai-gateway-infra(abb78324-4e39-4889-9e04-ddb78b3977f5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5"
Jul 16 22:06:11.759056 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:11.759032    2559 scope.go:117] "RemoveContainer" containerID="97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e"
Jul 16 22:06:11.759443 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:11.759241    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx_odh-ai-gateway-infra(abb78324-4e39-4889-9e04-ddb78b3977f5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5"
Jul 16 22:06:20.137630 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:20.137591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:20.673264 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:20.673233    2559 scope.go:117] "RemoveContainer" containerID="b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8"
Jul 16 22:06:21.028933 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:21.028907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:21.813677 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:21.813646    2559 generic.go:356] "Generic (PLEG): container finished" podID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerID="7e6d720dab6b58a4abe1cbd940802bd004710f5a9bb9cd153cadfba0f2ced0e6" exitCode=6
Jul 16 22:06:21.814118 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:21.813710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" event={"ID":"6ab07bb3-eac9-474b-8de8-fff581b3d852","Type":"ContainerDied","Data":"7e6d720dab6b58a4abe1cbd940802bd004710f5a9bb9cd153cadfba0f2ced0e6"}
Jul 16 22:06:21.814118 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:21.813767    2559 scope.go:117] "RemoveContainer" containerID="b6b962251255864ca2c934fc6d9f023f20ac1deb673059341348084ca4b91ec8"
Jul 16 22:06:21.814118 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:21.814071    2559 scope.go:117] "RemoveContainer" containerID="7e6d720dab6b58a4abe1cbd940802bd004710f5a9bb9cd153cadfba0f2ced0e6"
Jul 16 22:06:21.814330 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:21.814308    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k_odh-ai-gateway-infra(6ab07bb3-eac9-474b-8de8-fff581b3d852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852"
Jul 16 22:06:22.022065 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.022035    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677703713968"]
Jul 16 22:06:22.026677 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.026660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:22.031437 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.031414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jpfm4\""
Jul 16 22:06:22.033767 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.033732    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677703713968"]
Jul 16 22:06:22.197680 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.197603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj4jz\" (UniqueName: \"kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz\") pod \"test-curl-7517-140677703713968\" (UID: \"fc3fc251-5dc3-45c5-8f81-9bce01c5be88\") " pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:22.298426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.298393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj4jz\" (UniqueName: \"kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz\") pod \"test-curl-7517-140677703713968\" (UID: \"fc3fc251-5dc3-45c5-8f81-9bce01c5be88\") " pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:22.316436 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.316407    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj4jz\" (UniqueName: \"kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz\") pod \"test-curl-7517-140677703713968\" (UID: \"fc3fc251-5dc3-45c5-8f81-9bce01c5be88\") " pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:22.338225 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.338196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:22.487437 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.487415    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677703713968"]
Jul 16 22:06:22.489335 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:22.489312    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3fc251_5dc3_45c5_8f81_9bce01c5be88.slice/crio-4fa07f6dfc9f9a08ec3550872b3e0140bd14fc575e954981c32ea84f21016db8 WatchSource:0}: Error finding container 4fa07f6dfc9f9a08ec3550872b3e0140bd14fc575e954981c32ea84f21016db8: Status 404 returned error can't find the container with id 4fa07f6dfc9f9a08ec3550872b3e0140bd14fc575e954981c32ea84f21016db8
Jul 16 22:06:22.821601 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.821507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677703713968" event={"ID":"fc3fc251-5dc3-45c5-8f81-9bce01c5be88","Type":"ContainerStarted","Data":"4fa07f6dfc9f9a08ec3550872b3e0140bd14fc575e954981c32ea84f21016db8"}
Jul 16 22:06:22.850387 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:22.850352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:23.153747 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.153723    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:23.308323 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.308298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca\") pod \"6ab07bb3-eac9-474b-8de8-fff581b3d852\" (UID: \"6ab07bb3-eac9-474b-8de8-fff581b3d852\") "
Jul 16 22:06:23.308576 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.308555    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ab07bb3-eac9-474b-8de8-fff581b3d852" (UID: "6ab07bb3-eac9-474b-8de8-fff581b3d852"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:06:23.409889 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.409828    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab07bb3-eac9-474b-8de8-fff581b3d852-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:23.678942 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.678865    2559 scope.go:117] "RemoveContainer" containerID="97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e"
Jul 16 22:06:23.829858 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.829831    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"
Jul 16 22:06:23.830312 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.829826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k" event={"ID":"6ab07bb3-eac9-474b-8de8-fff581b3d852","Type":"ContainerDied","Data":"15607843981c72ffc47f0d7d7a99d5ae350d2c3df6e7cc6e30057c3922c1f217"}
Jul 16 22:06:23.830312 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.829979    2559 scope.go:117] "RemoveContainer" containerID="7e6d720dab6b58a4abe1cbd940802bd004710f5a9bb9cd153cadfba0f2ced0e6"
Jul 16 22:06:23.831650 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.831579    2559 generic.go:356] "Generic (PLEG): container finished" podID="fc3fc251-5dc3-45c5-8f81-9bce01c5be88" containerID="3b6d99c2d25bf6e0e346dba052a1639b465146f376e01551cc9078e3a02a948a" exitCode=0
Jul 16 22:06:23.831650 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.831616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677703713968" event={"ID":"fc3fc251-5dc3-45c5-8f81-9bce01c5be88","Type":"ContainerDied","Data":"3b6d99c2d25bf6e0e346dba052a1639b465146f376e01551cc9078e3a02a948a"}
Jul 16 22:06:23.851473 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.851449    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:23.854504 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:23.854478    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f8cd113-j6m5k"]
Jul 16 22:06:24.839599 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:24.839568    2559 generic.go:356] "Generic (PLEG): container finished" podID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerID="d8ad02daf9df7edfab5203b06bf478acff334ce24ebed1e902c3aaf92081b033" exitCode=6
Jul 16 22:06:24.840043 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:24.839644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerDied","Data":"d8ad02daf9df7edfab5203b06bf478acff334ce24ebed1e902c3aaf92081b033"}
Jul 16 22:06:24.840043 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:24.839704    2559 scope.go:117] "RemoveContainer" containerID="97b86f8b3f89d6c7052ad6680a0ce5733448b052632e2476cd426e6dbda10d3e"
Jul 16 22:06:24.840280 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:24.840064    2559 scope.go:117] "RemoveContainer" containerID="d8ad02daf9df7edfab5203b06bf478acff334ce24ebed1e902c3aaf92081b033"
Jul 16 22:06:24.840410 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:24.840315    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx_odh-ai-gateway-infra(abb78324-4e39-4889-9e04-ddb78b3977f5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5"
Jul 16 22:06:24.986335 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:24.986311    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:25.008727 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.008691    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677703713968_fc3fc251-5dc3-45c5-8f81-9bce01c5be88/test-curl-7517-140677703713968/0.log"
Jul 16 22:06:25.024980 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.024955    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj4jz\" (UniqueName: \"kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz\") pod \"fc3fc251-5dc3-45c5-8f81-9bce01c5be88\" (UID: \"fc3fc251-5dc3-45c5-8f81-9bce01c5be88\") "
Jul 16 22:06:25.027160 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.027136    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz" (OuterVolumeSpecName: "kube-api-access-jj4jz") pod "fc3fc251-5dc3-45c5-8f81-9bce01c5be88" (UID: "fc3fc251-5dc3-45c5-8f81-9bce01c5be88"). InnerVolumeSpecName "kube-api-access-jj4jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:25.033217 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.033132    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677703713968"]
Jul 16 22:06:25.036659 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.036639    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677703713968"]
Jul 16 22:06:25.125931 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.125850    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj4jz\" (UniqueName: \"kubernetes.io/projected/fc3fc251-5dc3-45c5-8f81-9bce01c5be88-kube-api-access-jj4jz\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:25.163725 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.163687    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677703774640"]
Jul 16 22:06:25.164193 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164175    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164195    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164212    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164219    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164231    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164239    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164247    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3fc251-5dc3-45c5-8f81-9bce01c5be88" containerName="test-curl-7517-140677703713968"
Jul 16 22:06:25.164286 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164256    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3fc251-5dc3-45c5-8f81-9bce01c5be88" containerName="test-curl-7517-140677703713968"
Jul 16 22:06:25.164626 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164355    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164626 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164369    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:25.164626 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.164378    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3fc251-5dc3-45c5-8f81-9bce01c5be88" containerName="test-curl-7517-140677703713968"
Jul 16 22:06:25.167528 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.167508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:25.175660 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.175643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677703774640"]
Jul 16 22:06:25.226429 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.226401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zzx\" (UniqueName: \"kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx\") pod \"test-curl-7517-140677703774640\" (UID: \"1e958bed-d133-4c31-8303-b713daf84da1\") " pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:25.327471 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.327434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zzx\" (UniqueName: \"kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx\") pod \"test-curl-7517-140677703774640\" (UID: \"1e958bed-d133-4c31-8303-b713daf84da1\") " pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:25.337140 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.337116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zzx\" (UniqueName: \"kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx\") pod \"test-curl-7517-140677703774640\" (UID: \"1e958bed-d133-4c31-8303-b713daf84da1\") " pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:25.477339 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.477314    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:25.678706 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.678676    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" path="/var/lib/kubelet/pods/6ab07bb3-eac9-474b-8de8-fff581b3d852/volumes"
Jul 16 22:06:25.679013 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.679001    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3fc251-5dc3-45c5-8f81-9bce01c5be88" path="/var/lib/kubelet/pods/fc3fc251-5dc3-45c5-8f81-9bce01c5be88/volumes"
Jul 16 22:06:25.829446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.828364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677703774640"]
Jul 16 22:06:25.846201 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.846174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677703774640" event={"ID":"1e958bed-d133-4c31-8303-b713daf84da1","Type":"ContainerStarted","Data":"186c381f924f23a28d693dd9d07799bcbed1f61f6858476e91a34b9cf3087aea"}
Jul 16 22:06:25.847457 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.847437    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703713968"
Jul 16 22:06:25.847457 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.847450    2559 scope.go:117] "RemoveContainer" containerID="3b6d99c2d25bf6e0e346dba052a1639b465146f376e01551cc9078e3a02a948a"
Jul 16 22:06:25.870429 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:25.870399    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:26.009981 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.009955    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:26.033637 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.033615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca\") pod \"abb78324-4e39-4889-9e04-ddb78b3977f5\" (UID: \"abb78324-4e39-4889-9e04-ddb78b3977f5\") "
Jul 16 22:06:26.034029 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.033999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abb78324-4e39-4889-9e04-ddb78b3977f5" (UID: "abb78324-4e39-4889-9e04-ddb78b3977f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:06:26.134512 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.134492    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb78324-4e39-4889-9e04-ddb78b3977f5-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:26.856796 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.856759    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"
Jul 16 22:06:26.857280 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.856796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx" event={"ID":"abb78324-4e39-4889-9e04-ddb78b3977f5","Type":"ContainerDied","Data":"4c5040457cc79eb5335627ec7a3493eb63ba171ad455eeae689487103fa8f0ac"}
Jul 16 22:06:26.857280 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.856860    2559 scope.go:117] "RemoveContainer" containerID="d8ad02daf9df7edfab5203b06bf478acff334ce24ebed1e902c3aaf92081b033"
Jul 16 22:06:26.858709 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.858680    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e958bed-d133-4c31-8303-b713daf84da1" containerID="cd3b3354c2a3fe2f519dc96455b55c8808587ae13926cc11fc7727da1b02103f" exitCode=0
Jul 16 22:06:26.858843 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.858777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677703774640" event={"ID":"1e958bed-d133-4c31-8303-b713daf84da1","Type":"ContainerDied","Data":"cd3b3354c2a3fe2f519dc96455b55c8808587ae13926cc11fc7727da1b02103f"}
Jul 16 22:06:26.899766 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.899739    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:26.901802 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:26.901780    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc2328dc-nzlkx"]
Jul 16 22:06:27.679135 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:27.679106    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" path="/var/lib/kubelet/pods/abb78324-4e39-4889-9e04-ddb78b3977f5/volumes"
Jul 16 22:06:28.011021 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.011000    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:28.038220 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.038195    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677703774640_1e958bed-d133-4c31-8303-b713daf84da1/test-curl-7517-140677703774640/0.log"
Jul 16 22:06:28.053550 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.053525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9zzx\" (UniqueName: \"kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx\") pod \"1e958bed-d133-4c31-8303-b713daf84da1\" (UID: \"1e958bed-d133-4c31-8303-b713daf84da1\") "
Jul 16 22:06:28.055769 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.055741    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx" (OuterVolumeSpecName: "kube-api-access-l9zzx") pod "1e958bed-d133-4c31-8303-b713daf84da1" (UID: "1e958bed-d133-4c31-8303-b713daf84da1"). InnerVolumeSpecName "kube-api-access-l9zzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:28.069136 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.069109    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677703774640"]
Jul 16 22:06:28.072891 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.072871    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677703774640"]
Jul 16 22:06:28.155313 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.155281    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9zzx\" (UniqueName: \"kubernetes.io/projected/1e958bed-d133-4c31-8303-b713daf84da1-kube-api-access-l9zzx\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:28.238176 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238147    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:28.238636 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238611    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238636 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238631    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238677    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238690    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e958bed-d133-4c31-8303-b713daf84da1" containerName="test-curl-7517-140677703774640"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238701    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e958bed-d133-4c31-8303-b713daf84da1" containerName="test-curl-7517-140677703774640"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238804    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238816    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:28.238830 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab07bb3-eac9-474b-8de8-fff581b3d852" containerName="revoke-keys"
Jul 16 22:06:28.239191 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.238837    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e958bed-d133-4c31-8303-b713daf84da1" containerName="test-curl-7517-140677703774640"
Jul 16 22:06:28.241978 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.241959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:28.246944 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.246920    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:28.256385 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.256362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgr4\" (UniqueName: \"kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4\") pod \"test-curl-7517-140677702071472\" (UID: \"b1675ea2-8d00-469b-a7f6-ecb9241b44bf\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:28.357575 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.357553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgr4\" (UniqueName: \"kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4\") pod \"test-curl-7517-140677702071472\" (UID: \"b1675ea2-8d00-469b-a7f6-ecb9241b44bf\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:28.367070 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.367039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgr4\" (UniqueName: \"kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4\") pod \"test-curl-7517-140677702071472\" (UID: \"b1675ea2-8d00-469b-a7f6-ecb9241b44bf\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:28.553908 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.553846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:28.700319 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.700294    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:28.701757 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:28.701737    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1675ea2_8d00_469b_a7f6_ecb9241b44bf.slice/crio-2722053b37b806b313c81d49b361414c1303c440c2048c47d5066aa0f8135dd9 WatchSource:0}: Error finding container 2722053b37b806b313c81d49b361414c1303c440c2048c47d5066aa0f8135dd9: Status 404 returned error can't find the container with id 2722053b37b806b313c81d49b361414c1303c440c2048c47d5066aa0f8135dd9
Jul 16 22:06:28.872325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.872255    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:28.872325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.872293    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="186c381f924f23a28d693dd9d07799bcbed1f61f6858476e91a34b9cf3087aea"
Jul 16 22:06:28.873555 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:28.873529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702071472" event={"ID":"b1675ea2-8d00-469b-a7f6-ecb9241b44bf","Type":"ContainerStarted","Data":"2722053b37b806b313c81d49b361414c1303c440c2048c47d5066aa0f8135dd9"}
Jul 16 22:06:28.883297 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:28.883266    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7517-140677703774640\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="1e958bed-d133-4c31-8303-b713daf84da1" pod="opendatahub/test-curl-7517-140677703774640"
Jul 16 22:06:29.679252 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:29.679218    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e958bed-d133-4c31-8303-b713daf84da1" path="/var/lib/kubelet/pods/1e958bed-d133-4c31-8303-b713daf84da1/volumes"
Jul 16 22:06:29.886874 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:29.886839    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1675ea2-8d00-469b-a7f6-ecb9241b44bf" containerID="2570bb41d39ce04e41bb8654853a31b04a3aa41221838b8410c6448b2c243b46" exitCode=0
Jul 16 22:06:29.887050 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:29.886879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702071472" event={"ID":"b1675ea2-8d00-469b-a7f6-ecb9241b44bf","Type":"ContainerDied","Data":"2570bb41d39ce04e41bb8654853a31b04a3aa41221838b8410c6448b2c243b46"}
Jul 16 22:06:31.035386 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.035360    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.061334 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.061309    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677702071472_b1675ea2-8d00-469b-a7f6-ecb9241b44bf/test-curl-7517-140677702071472/0.log"
Jul 16 22:06:31.078930 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.078895    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qgr4\" (UniqueName: \"kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4\") pod \"b1675ea2-8d00-469b-a7f6-ecb9241b44bf\" (UID: \"b1675ea2-8d00-469b-a7f6-ecb9241b44bf\") "
Jul 16 22:06:31.081060 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.081034    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4" (OuterVolumeSpecName: "kube-api-access-2qgr4") pod "b1675ea2-8d00-469b-a7f6-ecb9241b44bf" (UID: "b1675ea2-8d00-469b-a7f6-ecb9241b44bf"). InnerVolumeSpecName "kube-api-access-2qgr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:31.088666 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.088643    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:31.091419 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.091400    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:31.180263 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.180202    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qgr4\" (UniqueName: \"kubernetes.io/projected/b1675ea2-8d00-469b-a7f6-ecb9241b44bf-kube-api-access-2qgr4\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:31.221905 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.221882    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:31.222347 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222325    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1675ea2-8d00-469b-a7f6-ecb9241b44bf" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:31.222347 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222343    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1675ea2-8d00-469b-a7f6-ecb9241b44bf" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:31.222491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222358    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:31.222491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222364    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:31.222491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222428    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb78324-4e39-4889-9e04-ddb78b3977f5" containerName="revoke-keys"
Jul 16 22:06:31.222491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.222440    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1675ea2-8d00-469b-a7f6-ecb9241b44bf" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:31.225443 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.225426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.232973 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.232953    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:31.280898 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.280870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdcb\" (UniqueName: \"kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb\") pod \"test-curl-7517-140677702071472\" (UID: \"0d94f142-432f-4cdc-a233-816ff931605d\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.382008 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.381982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdcb\" (UniqueName: \"kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb\") pod \"test-curl-7517-140677702071472\" (UID: \"0d94f142-432f-4cdc-a233-816ff931605d\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.391697 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.391671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdcb\" (UniqueName: \"kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb\") pod \"test-curl-7517-140677702071472\" (UID: \"0d94f142-432f-4cdc-a233-816ff931605d\") " pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.535517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.535491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.675821 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:31.675792    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d94f142_432f_4cdc_a233_816ff931605d.slice/crio-39c136a247113864f3dd92a64b0b5a0af84f023eac9d6a13efc365d689235281 WatchSource:0}: Error finding container 39c136a247113864f3dd92a64b0b5a0af84f023eac9d6a13efc365d689235281: Status 404 returned error can't find the container with id 39c136a247113864f3dd92a64b0b5a0af84f023eac9d6a13efc365d689235281
Jul 16 22:06:31.680794 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.680766    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1675ea2-8d00-469b-a7f6-ecb9241b44bf" path="/var/lib/kubelet/pods/b1675ea2-8d00-469b-a7f6-ecb9241b44bf/volumes"
Jul 16 22:06:31.681324 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.681222    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:31.898986 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.898889    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:31.898986 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.898898    2559 scope.go:117] "RemoveContainer" containerID="2570bb41d39ce04e41bb8654853a31b04a3aa41221838b8410c6448b2c243b46"
Jul 16 22:06:31.900520 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:31.900325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702071472" event={"ID":"0d94f142-432f-4cdc-a233-816ff931605d","Type":"ContainerStarted","Data":"39c136a247113864f3dd92a64b0b5a0af84f023eac9d6a13efc365d689235281"}
Jul 16 22:06:32.908828 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:32.908792    2559 generic.go:356] "Generic (PLEG): container finished" podID="0d94f142-432f-4cdc-a233-816ff931605d" containerID="a7f2f78054d09b4823c88da6ddab4b2482c892fd8cda1daf9bfca00cf22847fb" exitCode=0
Jul 16 22:06:32.909212 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:32.908876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702071472" event={"ID":"0d94f142-432f-4cdc-a233-816ff931605d","Type":"ContainerDied","Data":"a7f2f78054d09b4823c88da6ddab4b2482c892fd8cda1daf9bfca00cf22847fb"}
Jul 16 22:06:34.060005 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.059978    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:34.081387 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.081350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677702071472_0d94f142-432f-4cdc-a233-816ff931605d/test-curl-7517-140677702071472/0.log"
Jul 16 22:06:34.105778 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.105749    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crdcb\" (UniqueName: \"kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb\") pod \"0d94f142-432f-4cdc-a233-816ff931605d\" (UID: \"0d94f142-432f-4cdc-a233-816ff931605d\") "
Jul 16 22:06:34.108070 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.108039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb" (OuterVolumeSpecName: "kube-api-access-crdcb") pod "0d94f142-432f-4cdc-a233-816ff931605d" (UID: "0d94f142-432f-4cdc-a233-816ff931605d"). InnerVolumeSpecName "kube-api-access-crdcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:34.108774 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.108748    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:34.112599 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.112566    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677702071472"]
Jul 16 22:06:34.207030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.206970    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crdcb\" (UniqueName: \"kubernetes.io/projected/0d94f142-432f-4cdc-a233-816ff931605d-kube-api-access-crdcb\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:34.241849 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.241813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:34.242694 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.242669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d94f142-432f-4cdc-a233-816ff931605d" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:34.242821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.242696    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d94f142-432f-4cdc-a233-816ff931605d" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:34.242938 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.242924    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d94f142-432f-4cdc-a233-816ff931605d" containerName="test-curl-7517-140677702071472"
Jul 16 22:06:34.247846 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.247818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:34.250176 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.250151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:34.307657 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.307629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx2zp\" (UniqueName: \"kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp\") pod \"test-curl-7517-140677702072480\" (UID: \"d313b8f1-412c-4cdc-b523-8bffac906ba7\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:34.408497 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.408468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx2zp\" (UniqueName: \"kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp\") pod \"test-curl-7517-140677702072480\" (UID: \"d313b8f1-412c-4cdc-b523-8bffac906ba7\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:34.418029 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.418003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx2zp\" (UniqueName: \"kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp\") pod \"test-curl-7517-140677702072480\" (UID: \"d313b8f1-412c-4cdc-b523-8bffac906ba7\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:34.560060 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.560030    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:34.712341 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.712315    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:34.717634 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:34.717605    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd313b8f1_412c_4cdc_b523_8bffac906ba7.slice/crio-98e241ac966421b2c172d30ec378018a5d38c077300dcb51a19113fb5eab40af WatchSource:0}: Error finding container 98e241ac966421b2c172d30ec378018a5d38c077300dcb51a19113fb5eab40af: Status 404 returned error can't find the container with id 98e241ac966421b2c172d30ec378018a5d38c077300dcb51a19113fb5eab40af
Jul 16 22:06:34.921477 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.921387    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:34.921477 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.921405    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39c136a247113864f3dd92a64b0b5a0af84f023eac9d6a13efc365d689235281"
Jul 16 22:06:34.922561 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:34.922533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702072480" event={"ID":"d313b8f1-412c-4cdc-b523-8bffac906ba7","Type":"ContainerStarted","Data":"98e241ac966421b2c172d30ec378018a5d38c077300dcb51a19113fb5eab40af"}
Jul 16 22:06:34.932593 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:34.932567    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7517-140677702071472\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="0d94f142-432f-4cdc-a233-816ff931605d" pod="opendatahub/test-curl-7517-140677702071472"
Jul 16 22:06:35.679218 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:35.679189    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d94f142-432f-4cdc-a233-816ff931605d" path="/var/lib/kubelet/pods/0d94f142-432f-4cdc-a233-816ff931605d/volumes"
Jul 16 22:06:35.929542 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:35.929455    2559 generic.go:356] "Generic (PLEG): container finished" podID="d313b8f1-412c-4cdc-b523-8bffac906ba7" containerID="dcb1c04eea046968d23ac47a194c2de0a985fafc9cfbb62382f70c83cf972fd6" exitCode=0
Jul 16 22:06:35.929684 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:35.929542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702072480" event={"ID":"d313b8f1-412c-4cdc-b523-8bffac906ba7","Type":"ContainerDied","Data":"dcb1c04eea046968d23ac47a194c2de0a985fafc9cfbb62382f70c83cf972fd6"}
Jul 16 22:06:37.077744 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.077718    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.104207 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.104166    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677702072480_d313b8f1-412c-4cdc-b523-8bffac906ba7/test-curl-7517-140677702072480/0.log"
Jul 16 22:06:37.128670 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.128635    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:37.131574 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.131519    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx2zp\" (UniqueName: \"kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp\") pod \"d313b8f1-412c-4cdc-b523-8bffac906ba7\" (UID: \"d313b8f1-412c-4cdc-b523-8bffac906ba7\") "
Jul 16 22:06:37.134521 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.134498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp" (OuterVolumeSpecName: "kube-api-access-tx2zp") pod "d313b8f1-412c-4cdc-b523-8bffac906ba7" (UID: "d313b8f1-412c-4cdc-b523-8bffac906ba7"). InnerVolumeSpecName "kube-api-access-tx2zp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:37.135704 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.135682    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:37.232825 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.232792    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx2zp\" (UniqueName: \"kubernetes.io/projected/d313b8f1-412c-4cdc-b523-8bffac906ba7-kube-api-access-tx2zp\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:37.262509 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.262487    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:37.262891 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.262878    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d313b8f1-412c-4cdc-b523-8bffac906ba7" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:37.262949 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.262894    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d313b8f1-412c-4cdc-b523-8bffac906ba7" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:37.262986 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.262959    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d313b8f1-412c-4cdc-b523-8bffac906ba7" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:37.265950 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.265935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.274049 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.274027    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:37.334052 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.334029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkmj\" (UniqueName: \"kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj\") pod \"test-curl-7517-140677702072480\" (UID: \"b86811ca-7be5-4407-b6cf-78e22df0a645\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.435140 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.435086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkmj\" (UniqueName: \"kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj\") pod \"test-curl-7517-140677702072480\" (UID: \"b86811ca-7be5-4407-b6cf-78e22df0a645\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.447412 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.447393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkmj\" (UniqueName: \"kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj\") pod \"test-curl-7517-140677702072480\" (UID: \"b86811ca-7be5-4407-b6cf-78e22df0a645\") " pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.576604 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.576541    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.681590 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.681557    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d313b8f1-412c-4cdc-b523-8bffac906ba7" path="/var/lib/kubelet/pods/d313b8f1-412c-4cdc-b523-8bffac906ba7/volumes"
Jul 16 22:06:37.714436 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.714413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:37.715900 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:37.715872    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb86811ca_7be5_4407_b6cf_78e22df0a645.slice/crio-5306dc90d808f9e1ef7d234ed546d24e557cbe39549a318c9a3824af5cdb5df6 WatchSource:0}: Error finding container 5306dc90d808f9e1ef7d234ed546d24e557cbe39549a318c9a3824af5cdb5df6: Status 404 returned error can't find the container with id 5306dc90d808f9e1ef7d234ed546d24e557cbe39549a318c9a3824af5cdb5df6
Jul 16 22:06:37.942422 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.942346    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:37.942570 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.942350    2559 scope.go:117] "RemoveContainer" containerID="dcb1c04eea046968d23ac47a194c2de0a985fafc9cfbb62382f70c83cf972fd6"
Jul 16 22:06:37.943745 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:37.943658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702072480" event={"ID":"b86811ca-7be5-4407-b6cf-78e22df0a645","Type":"ContainerStarted","Data":"5306dc90d808f9e1ef7d234ed546d24e557cbe39549a318c9a3824af5cdb5df6"}
Jul 16 22:06:38.957779 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:38.957747    2559 generic.go:356] "Generic (PLEG): container finished" podID="b86811ca-7be5-4407-b6cf-78e22df0a645" containerID="34e682363d8128f8c480dfabff39de170d04ef2b24224bffdac0b0e6b6eced9b" exitCode=0
Jul 16 22:06:38.958370 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:38.957787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7517-140677702072480" event={"ID":"b86811ca-7be5-4407-b6cf-78e22df0a645","Type":"ContainerDied","Data":"34e682363d8128f8c480dfabff39de170d04ef2b24224bffdac0b0e6b6eced9b"}
Jul 16 22:06:40.097281 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.097258    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:40.121686 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.121661    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7517-140677702072480_b86811ca-7be5-4407-b6cf-78e22df0a645/test-curl-7517-140677702072480/0.log"
Jul 16 22:06:40.145855 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.145823    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:40.149598 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.149578    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7517-140677702072480"]
Jul 16 22:06:40.157679 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.157654    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txkmj\" (UniqueName: \"kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj\") pod \"b86811ca-7be5-4407-b6cf-78e22df0a645\" (UID: \"b86811ca-7be5-4407-b6cf-78e22df0a645\") "
Jul 16 22:06:40.159836 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.159813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj" (OuterVolumeSpecName: "kube-api-access-txkmj") pod "b86811ca-7be5-4407-b6cf-78e22df0a645" (UID: "b86811ca-7be5-4407-b6cf-78e22df0a645"). InnerVolumeSpecName "kube-api-access-txkmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:06:40.259282 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.259247    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txkmj\" (UniqueName: \"kubernetes.io/projected/b86811ca-7be5-4407-b6cf-78e22df0a645-kube-api-access-txkmj\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:40.341785 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.341752    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"]
Jul 16 22:06:40.342209 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.342195    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86811ca-7be5-4407-b6cf-78e22df0a645" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:40.342209 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.342210    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86811ca-7be5-4407-b6cf-78e22df0a645" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:40.342306 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.342270    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86811ca-7be5-4407-b6cf-78e22df0a645" containerName="test-curl-7517-140677702072480"
Jul 16 22:06:40.345326 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.345308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:40.349479 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.349459    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:06:40.361560 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.361537    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"]
Jul 16 22:06:40.460477 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.460448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m\" (UID: \"09af76eb-0029-4d1c-b325-7c1b575fe0e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:40.561112 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.561016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m\" (UID: \"09af76eb-0029-4d1c-b325-7c1b575fe0e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:40.561686 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.561661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m\" (UID: \"09af76eb-0029-4d1c-b325-7c1b575fe0e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:40.655655 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.655625    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:40.879174 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.879036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:40.969638 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.969613    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:40.969803 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.969664    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5306dc90d808f9e1ef7d234ed546d24e557cbe39549a318c9a3824af5cdb5df6"
Jul 16 22:06:40.980975 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:06:40.980947    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7517-140677702072480\" is forbidden: User \"system:node:ip-10-0-132-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-95.ec2.internal' and this object" podUID="b86811ca-7be5-4407-b6cf-78e22df0a645" pod="opendatahub/test-curl-7517-140677702072480"
Jul 16 22:06:40.981355 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:40.981336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:41.009030 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:41.008874    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"]
Jul 16 22:06:41.011456 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:06:41.011437    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09af76eb_0029_4d1c_b325_7c1b575fe0e4.slice/crio-ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a WatchSource:0}: Error finding container ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a: Status 404 returned error can't find the container with id ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a
Jul 16 22:06:41.679631 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:41.679596    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86811ca-7be5-4407-b6cf-78e22df0a645" path="/var/lib/kubelet/pods/b86811ca-7be5-4407-b6cf-78e22df0a645/volumes"
Jul 16 22:06:41.977161 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:41.977131    2559 generic.go:356] "Generic (PLEG): container finished" podID="09af76eb-0029-4d1c-b325-7c1b575fe0e4" containerID="41d3d936a614c2f6c221b467e485310199885b7a1b16f0ce4b862bef896939a0" exitCode=0
Jul 16 22:06:41.977319 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:41.977219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m" event={"ID":"09af76eb-0029-4d1c-b325-7c1b575fe0e4","Type":"ContainerDied","Data":"41d3d936a614c2f6c221b467e485310199885b7a1b16f0ce4b862bef896939a0"}
Jul 16 22:06:41.977319 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:41.977273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m" event={"ID":"09af76eb-0029-4d1c-b325-7c1b575fe0e4","Type":"ContainerStarted","Data":"ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a"}
Jul 16 22:06:43.123511 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.123489    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:43.183198 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.183169    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca\") pod \"09af76eb-0029-4d1c-b325-7c1b575fe0e4\" (UID: \"09af76eb-0029-4d1c-b325-7c1b575fe0e4\") "
Jul 16 22:06:43.183491 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.183469    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "09af76eb-0029-4d1c-b325-7c1b575fe0e4" (UID: "09af76eb-0029-4d1c-b325-7c1b575fe0e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:06:43.284692 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.284630    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09af76eb-0029-4d1c-b325-7c1b575fe0e4-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:06:43.989779 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.989737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m" event={"ID":"09af76eb-0029-4d1c-b325-7c1b575fe0e4","Type":"ContainerDied","Data":"ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a"}
Jul 16 22:06:43.989944 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.989791    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea8e883c66ae1bbb09b34696e8a45617608e0384fd94c8d059bb7aebc70c9c1a"
Jul 16 22:06:43.989944 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:43.989756    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m"
Jul 16 22:06:51.087213 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:51.087163    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:55.458046 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:55.458010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:06:58.501586 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:06:58.501549    2559 scope.go:117] "RemoveContainer" containerID="3cf2bd6d2abc71621bba8deceb53b784bfccd0c304f1b07e1c15b6017c06bd5a"
Jul 16 22:07:01.969634 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:01.969594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:02.114817 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:02.114768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:06.126695 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.126655    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:07:06.127295 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.126915    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy" containerID="cri-o://26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c" gracePeriod=30
Jul 16 22:07:06.176554 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.176518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:06.354532 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.354499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:06.483654 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.483627    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"]
Jul 16 22:07:06.484064 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.484050    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09af76eb-0029-4d1c-b325-7c1b575fe0e4" containerName="revoke-keys"
Jul 16 22:07:06.484161 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.484065    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="09af76eb-0029-4d1c-b325-7c1b575fe0e4" containerName="revoke-keys"
Jul 16 22:07:06.484223 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.484161    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="09af76eb-0029-4d1c-b325-7c1b575fe0e4" containerName="revoke-keys"
Jul 16 22:07:06.489432 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.489413    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:06.492570 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.492550    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:07:06.496373 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.496348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"]
Jul 16 22:07:06.590704 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.590668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9\" (UID: \"846c4276-c2f2-4ef2-8761-990303ef9c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:06.691330 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.691295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9\" (UID: \"846c4276-c2f2-4ef2-8761-990303ef9c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:06.691883 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.691863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9\" (UID: \"846c4276-c2f2-4ef2-8761-990303ef9c83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:06.802236 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.802163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:06.950064 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:06.950037    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"]
Jul 16 22:07:06.951054 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:07:06.951029    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846c4276_c2f2_4ef2_8761_990303ef9c83.slice/crio-143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c WatchSource:0}: Error finding container 143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c: Status 404 returned error can't find the container with id 143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c
Jul 16 22:07:07.081143 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:07.081055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:07.126599 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:07.126566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9" event={"ID":"846c4276-c2f2-4ef2-8761-990303ef9c83","Type":"ContainerStarted","Data":"143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c"}
Jul 16 22:07:07.180580 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:07.180535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:08.134515 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:08.134478    2559 generic.go:356] "Generic (PLEG): container finished" podID="846c4276-c2f2-4ef2-8761-990303ef9c83" containerID="25e57d18e51e5751bccb8a7d7326f86b8ccd412c6d0436f88c84b781b48c40ae" exitCode=0
Jul 16 22:07:08.134701 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:08.134559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9" event={"ID":"846c4276-c2f2-4ef2-8761-990303ef9c83","Type":"ContainerDied","Data":"25e57d18e51e5751bccb8a7d7326f86b8ccd412c6d0436f88c84b781b48c40ae"}
Jul 16 22:07:09.273576 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:09.273551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:09.315506 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:09.315479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca\") pod \"846c4276-c2f2-4ef2-8761-990303ef9c83\" (UID: \"846c4276-c2f2-4ef2-8761-990303ef9c83\") "
Jul 16 22:07:09.315786 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:09.315765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "846c4276-c2f2-4ef2-8761-990303ef9c83" (UID: "846c4276-c2f2-4ef2-8761-990303ef9c83"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:07:09.416821 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:09.416759    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/846c4276-c2f2-4ef2-8761-990303ef9c83-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:10.147036 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:10.147000    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9"
Jul 16 22:07:10.147245 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:10.147028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9" event={"ID":"846c4276-c2f2-4ef2-8761-990303ef9c83","Type":"ContainerDied","Data":"143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c"}
Jul 16 22:07:10.147245 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:10.147145    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="143a31e2f7cd82f9974ecc45416c36401c90385ec936f27edc60c32b3bec0c5c"
Jul 16 22:07:11.392793 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.392737    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:07:11.436189 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436164    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436209    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436275    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436307    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436343 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436338    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436383    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo\") pod \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\" (UID: \"1f73d42d-f469-4167-b27c-bf6ddccfefc5\") "
Jul 16 22:07:11.436667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:11.436833 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436696    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-certs\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.436833 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:11.436833 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:07:11.436999 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.436846    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:11.437307 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.437278    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:11.439426 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.439400    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:11.439527 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.439508    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9" (OuterVolumeSpecName: "kube-api-access-qtvm9") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "kube-api-access-qtvm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:07:11.439631 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.439610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:07:11.439631 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.439615    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f73d42d-f469-4167-b27c-bf6ddccfefc5" (UID: "1f73d42d-f469-4167-b27c-bf6ddccfefc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:07:11.537566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537530    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-podinfo\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537565    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-data\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537566 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537575    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istiod-ca-cert\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537583    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-token\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537591    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtvm9\" (UniqueName: \"kubernetes.io/projected/1f73d42d-f469-4167-b27c-bf6ddccfefc5-kube-api-access-qtvm9\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537600    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-credential-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537608    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-workload-socket\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:11.537756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:11.537616    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f73d42d-f469-4167-b27c-bf6ddccfefc5-istio-envoy\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:12.161412 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.161375    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerID="26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c" exitCode=0
Jul 16 22:07:12.161584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.161418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerDied","Data":"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"}
Jul 16 22:07:12.161584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.161423    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"
Jul 16 22:07:12.161584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.161472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c" event={"ID":"1f73d42d-f469-4167-b27c-bf6ddccfefc5","Type":"ContainerDied","Data":"e1aa8996e6df36465884d115e8f001731df22aa4060a41c6ef082443cdc90fdb"}
Jul 16 22:07:12.161584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.161495    2559 scope.go:117] "RemoveContainer" containerID="26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"
Jul 16 22:07:12.171371 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.171361    2559 scope.go:117] "RemoveContainer" containerID="53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"
Jul 16 22:07:12.179576 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.179547    2559 scope.go:117] "RemoveContainer" containerID="26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"
Jul 16 22:07:12.179833 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:07:12.179806    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c\": container with ID starting with 26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c not found: ID does not exist" containerID="26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"
Jul 16 22:07:12.179934 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.179841    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c"} err="failed to get container status \"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c\": rpc error: code = NotFound desc = could not find container \"26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c\": container with ID starting with 26300522463cdf0dacd139ca8543ea34b55a34616fd54da73e911df8c41bd33c not found: ID does not exist"
Jul 16 22:07:12.179934 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.179858    2559 scope.go:117] "RemoveContainer" containerID="53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"
Jul 16 22:07:12.180315 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:07:12.180237    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b\": container with ID starting with 53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b not found: ID does not exist" containerID="53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"
Jul 16 22:07:12.180315 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.180276    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b"} err="failed to get container status \"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b\": rpc error: code = NotFound desc = could not find container \"53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b\": container with ID starting with 53b3fea1e44c14879ef878abac4d89c3869e8715247e95f048ad34666dc8b96b not found: ID does not exist"
Jul 16 22:07:12.183009 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.182987    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:07:12.188034 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:12.188013    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2140ea-openshift-default-8856dd78c-5826c"]
Jul 16 22:07:13.678797 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:13.678766    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" path="/var/lib/kubelet/pods/1f73d42d-f469-4167-b27c-bf6ddccfefc5/volumes"
Jul 16 22:07:17.064771 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:17.064731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:21.598518 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:21.598422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:24.269020 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.268988    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:24.269416 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269386    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.269416 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269398    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.269416 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269407    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.269416 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269414    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.269552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269426    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846c4276-c2f2-4ef2-8761-990303ef9c83" containerName="revoke-keys"
Jul 16 22:07:24.269552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269432    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="846c4276-c2f2-4ef2-8761-990303ef9c83" containerName="revoke-keys"
Jul 16 22:07:24.269552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269534    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="846c4276-c2f2-4ef2-8761-990303ef9c83" containerName="revoke-keys"
Jul 16 22:07:24.269552 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269548    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.269674 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.269554    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f73d42d-f469-4167-b27c-bf6ddccfefc5" containerName="istio-proxy"
Jul 16 22:07:24.273960 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.273944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:24.277270 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.277252    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:07:24.283125 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.283078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:24.350255 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.350220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c\" (UID: \"a86f94ae-f55b-433d-a972-16ae444ef1da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:24.450848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.450817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c\" (UID: \"a86f94ae-f55b-433d-a972-16ae444ef1da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:24.451418 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.451400    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c\" (UID: \"a86f94ae-f55b-433d-a972-16ae444ef1da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:24.585760 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.585687    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:24.726304 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:24.726274    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:24.726981 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:07:24.726954    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86f94ae_f55b_433d_a972_16ae444ef1da.slice/crio-b780ded0986545839acac215dfef7891fc8ebb36dcc058444794d6bcd70784ee WatchSource:0}: Error finding container b780ded0986545839acac215dfef7891fc8ebb36dcc058444794d6bcd70784ee: Status 404 returned error can't find the container with id b780ded0986545839acac215dfef7891fc8ebb36dcc058444794d6bcd70784ee
Jul 16 22:07:25.233784 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:25.233691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerStarted","Data":"9c5070143a6af86e13119f309cf3b11aed019782c2c029120ea8c5f510c99378"}
Jul 16 22:07:25.233784 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:25.233742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerStarted","Data":"b780ded0986545839acac215dfef7891fc8ebb36dcc058444794d6bcd70784ee"}
Jul 16 22:07:25.254362 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:25.254316    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" podStartSLOduration=1.25430199 podStartE2EDuration="1.25430199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:07:25.251263945 +0000 UTC m=+3508.101881324" watchObservedRunningTime="2026-07-16 22:07:25.25430199 +0000 UTC m=+3508.104919367"
Jul 16 22:07:26.241597 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:26.241562    2559 generic.go:356] "Generic (PLEG): container finished" podID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerID="9c5070143a6af86e13119f309cf3b11aed019782c2c029120ea8c5f510c99378" exitCode=6
Jul 16 22:07:26.242028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:26.241649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerDied","Data":"9c5070143a6af86e13119f309cf3b11aed019782c2c029120ea8c5f510c99378"}
Jul 16 22:07:26.242028 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:26.241805    2559 scope.go:117] "RemoveContainer" containerID="9c5070143a6af86e13119f309cf3b11aed019782c2c029120ea8c5f510c99378"
Jul 16 22:07:27.248840 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:27.248811    2559 generic.go:356] "Generic (PLEG): container finished" podID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerID="798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a" exitCode=6
Jul 16 22:07:27.249379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:27.248868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerDied","Data":"798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a"}
Jul 16 22:07:27.249379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:27.248938    2559 scope.go:117] "RemoveContainer" containerID="9c5070143a6af86e13119f309cf3b11aed019782c2c029120ea8c5f510c99378"
Jul 16 22:07:27.249379 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:27.249144    2559 scope.go:117] "RemoveContainer" containerID="798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a"
Jul 16 22:07:27.249528 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:07:27.249381    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c_odh-ai-gateway-infra(a86f94ae-f55b-433d-a972-16ae444ef1da)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da"
Jul 16 22:07:28.256860 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:28.256830    2559 scope.go:117] "RemoveContainer" containerID="798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a"
Jul 16 22:07:28.257270 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:07:28.257066    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c_odh-ai-gateway-infra(a86f94ae-f55b-433d-a972-16ae444ef1da)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da"
Jul 16 22:07:28.409419 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:28.409387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:28.507801 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:28.507720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:32.292391 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:32.292358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:32.491181 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:32.491146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:38.148504 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.148476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-szjzk_465d0663-dc75-4268-9b25-4e3c42f8ae27/manager/0.log"
Jul 16 22:07:38.284914 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.284878    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j865c_65882d68-bb2e-428a-868b-88e4c5136521/manager/0.log"
Jul 16 22:07:38.416330 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.416251    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57c55c95-hnclh_4bda049f-c3b4-4797-8c4e-bd267e11c0ae/manager/0.log"
Jul 16 22:07:38.530574 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.530548    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mrln7_9925eeb3-b356-4787-94c9-93ca461d2f3a/server/0.log"
Jul 16 22:07:38.652997 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.652965    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zpzkd_e1097aa9-6060-405e-9385-029608f42e47/manager/0.log"
Jul 16 22:07:38.766014 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.765988    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-67429_080ce4a3-77ff-4416-8c02-5881e8ab73cf/copy-manifests/0.log"
Jul 16 22:07:38.784696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:38.784657    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-67429_080ce4a3-77ff-4416-8c02-5881e8ab73cf/manager/0.log"
Jul 16 22:07:39.386113 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:39.386065    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-96f5c9c8d-qjb6l_00b1793f-d48e-4c8e-984a-b9adf6ad7841/maas-api/0.log"
Jul 16 22:07:39.492101 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:39.492063    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737290-xb8ht_8608f0b3-9b6d-4f1c-aea4-c4a0b07103ea/cleanup/0.log"
Jul 16 22:07:39.672877 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:39.672797    2559 scope.go:117] "RemoveContainer" containerID="798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a"
Jul 16 22:07:39.936696 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:39.936630    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-f90d76-m6qgr_5fcd7da9-c45c-43a8-afe6-15d2826798ae/revoke-keys/0.log"
Jul 16 22:07:40.045315 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.045285    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-ef3576-dsrkn_cc094478-43ad-4775-a21e-9480a718270e/revoke-keys/0.log"
Jul 16 22:07:40.154781 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.154752    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c_a86f94ae-f55b-433d-a972-16ae444ef1da/revoke-keys/1.log"
Jul 16 22:07:40.262446 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.262420    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-f53605-z7n5k_215a5674-00d9-431a-9622-2f62ee0b5299/revoke-keys/0.log"
Jul 16 22:07:40.326944 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.326911    2559 generic.go:356] "Generic (PLEG): container finished" podID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerID="522805bb90560a66489ae9d757c4723ed1cbde03a3197e35c4b7438a921d0bc3" exitCode=6
Jul 16 22:07:40.327127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.326983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerDied","Data":"522805bb90560a66489ae9d757c4723ed1cbde03a3197e35c4b7438a921d0bc3"}
Jul 16 22:07:40.327127 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.327048    2559 scope.go:117] "RemoveContainer" containerID="798da4e6a30b7f58bbeb48e3d1d56ac15262179924ee8128b53ba4b2d1cb2f5a"
Jul 16 22:07:40.327367 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.327348    2559 scope.go:117] "RemoveContainer" containerID="522805bb90560a66489ae9d757c4723ed1cbde03a3197e35c4b7438a921d0bc3"
Jul 16 22:07:40.327609 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:07:40.327592    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c_odh-ai-gateway-infra(a86f94ae-f55b-433d-a972-16ae444ef1da)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da"
Jul 16 22:07:40.478209 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.478179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-5b4b2622-2mhqd_fe94a168-0cbc-45c1-8dc9-f5b6efd4df12/revoke-keys/0.log"
Jul 16 22:07:40.694279 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.694204    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-2140ea-zq49m_09af76eb-0029-4d1c-b325-7c1b575fe0e4/revoke-keys/0.log"
Jul 16 22:07:40.798495 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.798474    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-a87ce2-znmq9_846c4276-c2f2-4ef2-8761-990303ef9c83/revoke-keys/0.log"
Jul 16 22:07:40.902562 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:40.902540    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qsngd_4f4c3440-f99d-45bf-a9bb-d8ad9afef710/postgres/0.log"
Jul 16 22:07:41.356528 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:41.356497    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:41.497777 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:41.497750    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:41.598233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:41.598207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca\") pod \"a86f94ae-f55b-433d-a972-16ae444ef1da\" (UID: \"a86f94ae-f55b-433d-a972-16ae444ef1da\") "
Jul 16 22:07:41.598565 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:41.598542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a86f94ae-f55b-433d-a972-16ae444ef1da" (UID: "a86f94ae-f55b-433d-a972-16ae444ef1da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:07:41.699370 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:41.699336    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86f94ae-f55b-433d-a972-16ae444ef1da-maas-api-service-ca\") on node \"ip-10-0-132-95.ec2.internal\" DevicePath \"\""
Jul 16 22:07:42.273402 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.273367    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jcj7s_73f2979a-6d7a-4a8e-9221-fd54af3e15e3/manager/0.log"
Jul 16 22:07:42.339933 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.339889    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"
Jul 16 22:07:42.339933 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.339894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c" event={"ID":"a86f94ae-f55b-433d-a972-16ae444ef1da","Type":"ContainerDied","Data":"b780ded0986545839acac215dfef7891fc8ebb36dcc058444794d6bcd70784ee"}
Jul 16 22:07:42.340212 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.339969    2559 scope.go:117] "RemoveContainer" containerID="522805bb90560a66489ae9d757c4723ed1cbde03a3197e35c4b7438a921d0bc3"
Jul 16 22:07:42.363328 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.363302    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:42.367290 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.367270    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-ktw8c"]
Jul 16 22:07:42.624457 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.624381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-22xcg_14854a67-b48e-4372-b715-694ad9544c06/registry-server/0.log"
Jul 16 22:07:42.770998 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:42.770971    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xhjpb_4af092dd-bf01-4b0e-b556-3343ffd55a94/manager/0.log"
Jul 16 22:07:43.663316 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:43.663292    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-r6rzf_973c89bc-cf96-4a0b-bb29-857ae01a5fa3/kube-auth-proxy/0.log"
Jul 16 22:07:43.678318 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:43.678295    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" path="/var/lib/kubelet/pods/a86f94ae-f55b-433d-a972-16ae444ef1da/volumes"
Jul 16 22:07:43.898431 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:43.898400    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/1.log"
Jul 16 22:07:44.022053 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:44.022029    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kkjgw_79c6d579-6c65-4b1c-bc22-73caf9e2e8bb/payload-pre-processing/0.log"
Jul 16 22:07:44.267958 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:44.267930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86df8464b4-fb7nr_de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1/router/0.log"
Jul 16 22:07:44.597767 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:44.597739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jfkg9_b4d58343-875a-4530-8d0c-90e3cb146e99/main/0.log"
Jul 16 22:07:44.935798 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:44.935715    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtv979_0368cc7e-b458-455a-9ace-aba1bb2e3f7e/main/0.log"
Jul 16 22:07:50.555636 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:50.555593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:52.189676 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:52.189639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:07:54.424832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:54.424797    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h6dvh_b46b0a82-5f3f-4c50-96f4-289e7a0ee231/global-pull-secret-syncer/0.log"
Jul 16 22:07:54.486948 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:54.486907    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log"
Jul 16 22:07:54.606001 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:07:54.605976    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-95.ec2.internal_cf30bda94c0cf296cb79742041db8530/haproxy/0.log"
Jul 16 22:08:00.181669 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:00.181638    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jcj7s_73f2979a-6d7a-4a8e-9221-fd54af3e15e3/manager/0.log"
Jul 16 22:08:00.320434 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:00.320402    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-22xcg_14854a67-b48e-4372-b715-694ad9544c06/registry-server/0.log"
Jul 16 22:08:00.484590 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:00.484564    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xhjpb_4af092dd-bf01-4b0e-b556-3343ffd55a94/manager/0.log"
Jul 16 22:08:02.535900 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:02.535870    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-9tgkl_82ef6627-388a-4cc4-9445-6545744d96ea/cluster-monitoring-operator/0.log"
Jul 16 22:08:02.706479 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:02.706449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f22q_54329bdc-551a-4e65-9b31-1e231281af26/node-exporter/0.log"
Jul 16 22:08:02.731494 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:02.731473    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f22q_54329bdc-551a-4e65-9b31-1e231281af26/kube-rbac-proxy/0.log"
Jul 16 22:08:02.755489 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:02.755468    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5f22q_54329bdc-551a-4e65-9b31-1e231281af26/init-textfile/0.log"
Jul 16 22:08:03.840910 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.840876    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"]
Jul 16 22:08:03.841320 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841306    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841368 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841323    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841368 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841368 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841339    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841463 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841425    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841463 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841433    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.841463 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.841441    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:03.846112 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.846077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.849233 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.849213    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bq49w\"/\"default-dockercfg-hm25x\""
Jul 16 22:08:03.849326 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.849259    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq49w\"/\"openshift-service-ca.crt\""
Jul 16 22:08:03.850582 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.850565    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq49w\"/\"kube-root-ca.crt\""
Jul 16 22:08:03.856360 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.856340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"]
Jul 16 22:08:03.889864 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.889843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-lib-modules\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.889967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.889879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-podres\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.889967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.889901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvpw5\" (UniqueName: \"kubernetes.io/projected/bc5a4e58-074d-411a-8bfe-ad88449f794e-kube-api-access-fvpw5\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.889967 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.889943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-proc\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.890117 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.890014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-sys\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.990917 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.990888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-sys\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.990936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-lib-modules\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.990971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-podres\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.990993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvpw5\" (UniqueName: \"kubernetes.io/projected/bc5a4e58-074d-411a-8bfe-ad88449f794e-kube-api-access-fvpw5\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.991006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-sys\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991071 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.991018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-proc\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991318 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.991072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-proc\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991318 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.991157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-podres\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:03.991318 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:03.991173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc5a4e58-074d-411a-8bfe-ad88449f794e-lib-modules\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:04.001584 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.001562    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvpw5\" (UniqueName: \"kubernetes.io/projected/bc5a4e58-074d-411a-8bfe-ad88449f794e-kube-api-access-fvpw5\") pod \"perf-node-gather-daemonset-579wm\" (UID: \"bc5a4e58-074d-411a-8bfe-ad88449f794e\") " pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:04.157191 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.157118    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:04.300264 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.300240    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"]
Jul 16 22:08:04.302821 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:08:04.302795    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc5a4e58_074d_411a_8bfe_ad88449f794e.slice/crio-3de04a0897227fedd7116fd5945b28f80d5d12b674ba28efa78a254da058dd7e WatchSource:0}: Error finding container 3de04a0897227fedd7116fd5945b28f80d5d12b674ba28efa78a254da058dd7e: Status 404 returned error can't find the container with id 3de04a0897227fedd7116fd5945b28f80d5d12b674ba28efa78a254da058dd7e
Jul 16 22:08:04.461321 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.461234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm" event={"ID":"bc5a4e58-074d-411a-8bfe-ad88449f794e","Type":"ContainerStarted","Data":"4c7e63e6e031a29468040a7c8570908332675f39503e806f9457c34231aaf26b"}
Jul 16 22:08:04.461444 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.461371    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:04.461444 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.461392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm" event={"ID":"bc5a4e58-074d-411a-8bfe-ad88449f794e","Type":"ContainerStarted","Data":"3de04a0897227fedd7116fd5945b28f80d5d12b674ba28efa78a254da058dd7e"}
Jul 16 22:08:04.481188 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.481139    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm" podStartSLOduration=1.481124422 podStartE2EDuration="1.481124422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:08:04.480196279 +0000 UTC m=+3547.330813847" watchObservedRunningTime="2026-07-16 22:08:04.481124422 +0000 UTC m=+3547.331741796"
Jul 16 22:08:04.895325 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:04.895291    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-jhxd9_b2cfa9ff-8f43-4367-a6d2-bcc8122e8bfd/networking-console-plugin/0.log"
Jul 16 22:08:05.596209 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:05.596170    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/1.log"
Jul 16 22:08:05.603987 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:05.603960    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9mp2p_e2b78486-f6a7-428d-b8af-f00f3f2e403f/console-operator/2.log"
Jul 16 22:08:06.086618 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:06.086585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:06.782047 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:06.782022    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-7g9db_4058cd78-c208-4e9b-a81e-4b091d39bceb/volume-data-source-validator/0.log"
Jul 16 22:08:08.034564 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:08.034539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skzl6_6f1dc438-9f9c-48ed-84e6-e7340f2a3827/dns/0.log"
Jul 16 22:08:08.057722 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:08.057696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skzl6_6f1dc438-9f9c-48ed-84e6-e7340f2a3827/kube-rbac-proxy/0.log"
Jul 16 22:08:08.137734 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:08.137703    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-94mx7_40fa01ee-376d-4245-99da-9a90e656996e/dns-node-resolver/0.log"
Jul 16 22:08:08.821955 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:08.821922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9z7ph_b07dadad-44fe-448e-be3a-82ffcb256bcd/node-ca/0.log"
Jul 16 22:08:10.205193 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.205161    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-r6rzf_973c89bc-cf96-4a0b-bb29-857ae01a5fa3/kube-auth-proxy/0.log"
Jul 16 22:08:10.265849 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.265820    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/0.log"
Jul 16 22:08:10.325784 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.325759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/1.log"
Jul 16 22:08:10.366845 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.366821    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kkjgw_79c6d579-6c65-4b1c-bc22-73caf9e2e8bb/payload-pre-processing/0.log"
Jul 16 22:08:10.436833 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.436809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86df8464b4-fb7nr_de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1/router/0.log"
Jul 16 22:08:10.476832 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:10.476810    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bq49w/perf-node-gather-daemonset-579wm"
Jul 16 22:08:11.205347 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.205305    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6qsw_9bf83322-6e29-4529-a041-aaf60393f9de/serve-healthcheck-canary/0.log"
Jul 16 22:08:11.703637 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.703606    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vbvfs_feefd622-acb8-49d2-bf3a-f1d94ec42d16/insights-operator/0.log"
Jul 16 22:08:11.704376 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.704351    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vbvfs_feefd622-acb8-49d2-bf3a-f1d94ec42d16/insights-operator/1.log"
Jul 16 22:08:11.867920 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.867889    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zfzhj_8af58baf-edfa-4c49-9839-a4970c127d4a/kube-rbac-proxy/0.log"
Jul 16 22:08:11.889953 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.889930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zfzhj_8af58baf-edfa-4c49-9839-a4970c127d4a/exporter/0.log"
Jul 16 22:08:11.912642 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:11.912623    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zfzhj_8af58baf-edfa-4c49-9839-a4970c127d4a/extractor/0.log"
Jul 16 22:08:14.069363 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.069330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:14.144354 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.144326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdnw5_c1335911-b6ee-424e-aa17-7354c74cb7df/konnectivity-agent/0.log" limit=1024
Jul 16 22:08:14.320848 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.320770    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"]
Jul 16 22:08:14.321204 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.321190    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:14.321256 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.321205    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86f94ae-f55b-433d-a972-16ae444ef1da" containerName="revoke-keys"
Jul 16 22:08:14.324408 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.324392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"
Jul 16 22:08:14.327435 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.327416    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t46j7\""
Jul 16 22:08:14.332718 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.332304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"]
Jul 16 22:08:14.378452 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.378425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d140ff0-63b3-42bd-a74a-5e76b61f80db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5\" (UID: \"2d140ff0-63b3-42bd-a74a-5e76b61f80db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"
Jul 16 22:08:14.479606 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.479580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d140ff0-63b3-42bd-a74a-5e76b61f80db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5\" (UID: \"2d140ff0-63b3-42bd-a74a-5e76b61f80db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"
Jul 16 22:08:14.480203 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.480184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d140ff0-63b3-42bd-a74a-5e76b61f80db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5\" (UID: \"2d140ff0-63b3-42bd-a74a-5e76b61f80db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"
Jul 16 22:08:14.482819 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.482802    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-szjzk_465d0663-dc75-4268-9b25-4e3c42f8ae27/manager/0.log"
Jul 16 22:08:14.636305 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.636217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"
Jul 16 22:08:14.774147 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.774119    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j865c_65882d68-bb2e-428a-868b-88e4c5136521/manager/0.log"
Jul 16 22:08:14.959108 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.959007    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57c55c95-hnclh_4bda049f-c3b4-4797-8c4e-bd267e11c0ae/manager/0.log"
Jul 16 22:08:14.982857 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:14.982825    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mrln7_9925eeb3-b356-4787-94c9-93ca461d2f3a/server/0.log"
Jul 16 22:08:15.008460 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.008430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5"]
Jul 16 22:08:15.010353 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:08:15.010319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d140ff0_63b3_42bd_a74a_5e76b61f80db.slice/crio-f04f44864fca8952704d8945d22e0d7a3481df4b890bd98f8950f6a45ce77231 WatchSource:0}: Error finding container f04f44864fca8952704d8945d22e0d7a3481df4b890bd98f8950f6a45ce77231: Status 404 returned error can't find the container with id f04f44864fca8952704d8945d22e0d7a3481df4b890bd98f8950f6a45ce77231
Jul 16 22:08:15.029756 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.029124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-r6rzf_973c89bc-cf96-4a0b-bb29-857ae01a5fa3/kube-auth-proxy/0.log"
Jul 16 22:08:15.072792 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.072771    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/0.log"
Jul 16 22:08:15.114638 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.114615    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zpzkd_e1097aa9-6060-405e-9385-029608f42e47/manager/0.log"
Jul 16 22:08:15.150344 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.150322    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/1.log"
Jul 16 22:08:15.189769 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.189740    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kkjgw_79c6d579-6c65-4b1c-bc22-73caf9e2e8bb/payload-pre-processing/0.log"
Jul 16 22:08:15.230826 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.230793    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86df8464b4-fb7nr_de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1/router/0.log"
Jul 16 22:08:15.254669 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.254647    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-67429_080ce4a3-77ff-4416-8c02-5881e8ab73cf/manager/0.log"
Jul 16 22:08:15.301422 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.301398    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f7d7dc89-67429_080ce4a3-77ff-4416-8c02-5881e8ab73cf/copy-manifests/0.log"
Jul 16 22:08:15.532682 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.532650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" event={"ID":"2d140ff0-63b3-42bd-a74a-5e76b61f80db","Type":"ContainerStarted","Data":"f0385882263af787beb430bb5b4ee598c91b38e49d4ab846f0afc340a84e2a30"}
Jul 16 22:08:15.532809 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.532704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" event={"ID":"2d140ff0-63b3-42bd-a74a-5e76b61f80db","Type":"ContainerStarted","Data":"f04f44864fca8952704d8945d22e0d7a3481df4b890bd98f8950f6a45ce77231"}
Jul 16 22:08:15.549338 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:15.549289    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" podStartSLOduration=1.549273552 podStartE2EDuration="1.549273552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:08:15.548717638 +0000 UTC m=+3558.399335017" watchObservedRunningTime="2026-07-16 22:08:15.549273552 +0000 UTC m=+3558.399890928"
Jul 16 22:08:16.418558 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.418527    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"]
Jul 16 22:08:16.423859 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.423841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"
Jul 16 22:08:16.435449 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.435423    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"]
Jul 16 22:08:16.494271 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.494235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/843d2a05-2732-47a9-84f4-e2cb28184b08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9\" (UID: \"843d2a05-2732-47a9-84f4-e2cb28184b08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"
Jul 16 22:08:16.544069 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.544028    2559 generic.go:356] "Generic (PLEG): container finished" podID="2d140ff0-63b3-42bd-a74a-5e76b61f80db" containerID="f0385882263af787beb430bb5b4ee598c91b38e49d4ab846f0afc340a84e2a30" exitCode=6
Jul 16 22:08:16.544272 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.544071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" event={"ID":"2d140ff0-63b3-42bd-a74a-5e76b61f80db","Type":"ContainerDied","Data":"f0385882263af787beb430bb5b4ee598c91b38e49d4ab846f0afc340a84e2a30"}
Jul 16 22:08:16.544390 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.544374    2559 scope.go:117] "RemoveContainer" containerID="f0385882263af787beb430bb5b4ee598c91b38e49d4ab846f0afc340a84e2a30"
Jul 16 22:08:16.595226 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.595193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/843d2a05-2732-47a9-84f4-e2cb28184b08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9\" (UID: \"843d2a05-2732-47a9-84f4-e2cb28184b08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"
Jul 16 22:08:16.595765 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.595740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/843d2a05-2732-47a9-84f4-e2cb28184b08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9\" (UID: \"843d2a05-2732-47a9-84f4-e2cb28184b08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"
Jul 16 22:08:16.716913 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.716889    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b9fcf8c8b-r6rzf_973c89bc-cf96-4a0b-bb29-857ae01a5fa3/kube-auth-proxy/0.log"
Jul 16 22:08:16.735516 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.735484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"
Jul 16 22:08:16.785295 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.785239    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/0.log"
Jul 16 22:08:16.860985 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.860951    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x5zst_d43af5c5-eb03-48ef-b2b1-45c000406f78/istio-proxy/1.log"
Jul 16 22:08:16.902580 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.902548    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kkjgw_79c6d579-6c65-4b1c-bc22-73caf9e2e8bb/payload-pre-processing/0.log"
Jul 16 22:08:16.962512 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:16.962488    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86df8464b4-fb7nr_de3e5d1d-6f5a-42cb-a88d-a8d31896c3c1/router/0.log"
Jul 16 22:08:17.123152 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.123128    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9"]
Jul 16 22:08:17.124364 ip-10-0-132-95 kubenswrapper[2559]: W0716 22:08:17.124335    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843d2a05_2732_47a9_84f4_e2cb28184b08.slice/crio-6262c81b0ea453d81206aa3a43bf80b7d3c08866c9722353e0ccbf5610e16375 WatchSource:0}: Error finding container 6262c81b0ea453d81206aa3a43bf80b7d3c08866c9722353e0ccbf5610e16375: Status 404 returned error can't find the container with id 6262c81b0ea453d81206aa3a43bf80b7d3c08866c9722353e0ccbf5610e16375
Jul 16 22:08:17.553387 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.553349    2559 generic.go:356] "Generic (PLEG): container finished" podID="2d140ff0-63b3-42bd-a74a-5e76b61f80db" containerID="223864dc6e74daadd2ec5802de873725e7fed79fde80e1b4c0f4689210a6e9b1" exitCode=6
Jul 16 22:08:17.553814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.553403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" event={"ID":"2d140ff0-63b3-42bd-a74a-5e76b61f80db","Type":"ContainerDied","Data":"223864dc6e74daadd2ec5802de873725e7fed79fde80e1b4c0f4689210a6e9b1"}
Jul 16 22:08:17.553814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.553469    2559 scope.go:117] "RemoveContainer" containerID="f0385882263af787beb430bb5b4ee598c91b38e49d4ab846f0afc340a84e2a30"
Jul 16 22:08:17.553814 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.553744    2559 scope.go:117] "RemoveContainer" containerID="223864dc6e74daadd2ec5802de873725e7fed79fde80e1b4c0f4689210a6e9b1"
Jul 16 22:08:17.554081 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:08:17.554037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5_odh-ai-gateway-infra(2d140ff0-63b3-42bd-a74a-5e76b61f80db)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" podUID="2d140ff0-63b3-42bd-a74a-5e76b61f80db"
Jul 16 22:08:17.555290 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:17.555263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9" event={"ID":"843d2a05-2732-47a9-84f4-e2cb28184b08","Type":"ContainerStarted","Data":"6262c81b0ea453d81206aa3a43bf80b7d3c08866c9722353e0ccbf5610e16375"}
Jul 16 22:08:18.562667 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:18.562638    2559 scope.go:117] "RemoveContainer" containerID="223864dc6e74daadd2ec5802de873725e7fed79fde80e1b4c0f4689210a6e9b1"
Jul 16 22:08:18.563113 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:08:18.562897    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5_odh-ai-gateway-infra(2d140ff0-63b3-42bd-a74a-5e76b61f80db)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c1cf683e-j2pb5" podUID="2d140ff0-63b3-42bd-a74a-5e76b61f80db"
Jul 16 22:08:18.563965 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:18.563944    2559 generic.go:356] "Generic (PLEG): container finished" podID="843d2a05-2732-47a9-84f4-e2cb28184b08" containerID="e679a7c0c5bcf1b142cdb9ff8b54a20fb5afd954981c54e8b937abc38e415d84" exitCode=6
Jul 16 22:08:18.564023 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:18.563989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9" event={"ID":"843d2a05-2732-47a9-84f4-e2cb28184b08","Type":"ContainerDied","Data":"e679a7c0c5bcf1b142cdb9ff8b54a20fb5afd954981c54e8b937abc38e415d84"}
Jul 16 22:08:18.564174 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:18.564164    2559 scope.go:117] "RemoveContainer" containerID="e679a7c0c5bcf1b142cdb9ff8b54a20fb5afd954981c54e8b937abc38e415d84"
Jul 16 22:08:19.571551 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:19.571469    2559 generic.go:356] "Generic (PLEG): container finished" podID="843d2a05-2732-47a9-84f4-e2cb28184b08" containerID="bcdbeabbb7378d172b48180771c73979c7eed3e91805757b40c4ef79f5d01af3" exitCode=6
Jul 16 22:08:19.571551 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:19.571526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9" event={"ID":"843d2a05-2732-47a9-84f4-e2cb28184b08","Type":"ContainerDied","Data":"bcdbeabbb7378d172b48180771c73979c7eed3e91805757b40c4ef79f5d01af3"}
Jul 16 22:08:19.572041 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:19.571568    2559 scope.go:117] "RemoveContainer" containerID="e679a7c0c5bcf1b142cdb9ff8b54a20fb5afd954981c54e8b937abc38e415d84"
Jul 16 22:08:19.572041 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:19.571739    2559 scope.go:117] "RemoveContainer" containerID="bcdbeabbb7378d172b48180771c73979c7eed3e91805757b40c4ef79f5d01af3"
Jul 16 22:08:19.572041 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:08:19.571951    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9_odh-ai-gateway-infra(843d2a05-2732-47a9-84f4-e2cb28184b08)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9" podUID="843d2a05-2732-47a9-84f4-e2cb28184b08"
Jul 16 22:08:20.580517 ip-10-0-132-95 kubenswrapper[2559]: I0716 22:08:20.580480    2559 scope.go:117] "RemoveContainer" containerID="bcdbeabbb7378d172b48180771c73979c7eed3e91805757b40c4ef79f5d01af3"
Jul 16 22:08:20.580938 ip-10-0-132-95 kubenswrapper[2559]: E0716 22:08:20.580765    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9_odh-ai-gateway-infra(843d2a05-2732-47a9-84f4-e2cb28184b08)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f60157c3-8r7w9" podUID="843d2a05-2732-47a9-84f4-e2cb28184b08"