Jul 17 05:31:21.030899 ip-10-0-142-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 05:31:21.031127 ip-10-0-142-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 05:31:21.031144 ip-10-0-142-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 05:31:21.031444 ip-10-0-142-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 05:31:30.772228 ip-10-0-142-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 17 05:31:30.772247 ip-10-0-142-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot efb8476434844178a7d2c82307633285 --
Jul 17 05:32:59.998385 ip-10-0-142-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 05:33:00.434913 ip-10-0-142-187 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:33:00.434913 ip-10-0-142-187 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 05:33:00.434913 ip-10-0-142-187 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:33:00.434913 ip-10-0-142-187 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 05:33:00.434913 ip-10-0-142-187 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:33:00.436032 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.435942    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 05:33:00.442522 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442503    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.442522 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442521    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.442522 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442524    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442528    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442533    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442537    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442540    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442543    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442545    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442548    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442550    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442553    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442555    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442565    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442568    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442570    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442573    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442575    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442577    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442580    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442582    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.442628 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442585    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442587    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442590    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442593    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442595    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442597    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442600    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442602    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442604    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442607    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442610    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442612    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442615    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442617    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442620    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442623    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442626    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442629    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442631    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442634    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.443080 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442637    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442639    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442641    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442645    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442649    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442652    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442655    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442657    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442660    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442662    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442665    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442668    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442670    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442673    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442675    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442679    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442681    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442683    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442686    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442688    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.443662 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442691    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442693    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442696    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442698    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442701    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442704    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442706    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442710    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442712    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442715    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442718    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442721    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442723    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442726    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442728    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442731    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442733    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442736    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442738    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442740    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.444162 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442743    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442745    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442748    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442750    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442753    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442755    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442758    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442760    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442763    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442768    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442771    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442775    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442778    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442781    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442784    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442786    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442789    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.442791    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443504    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.444635 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443513    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443516    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443519    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443522    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443526    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443529    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443531    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443534    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443537    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443539    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443541    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443544    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443546    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443549    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443551    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443554    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443556    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443559    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443561    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443564    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.445153 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443566    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443569    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443571    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443573    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443576    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443579    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443581    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443583    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443586    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443588    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443590    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443593    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443595    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443598    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443601    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443604    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443606    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443610    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443615    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.445641 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443619    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443623    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443626    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443629    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443632    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443634    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443637    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443639    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443641    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443644    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443646    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443649    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443651    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443654    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443657    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443660    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443664    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443668    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443671    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443674    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.446099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443677    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443680    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443683    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443685    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443688    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443691    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443693    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443696    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443699    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443701    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443704    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443709    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443711    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443714    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443716    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443719    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443722    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443724    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443727    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443729    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.446597 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443734    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443736    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443739    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443741    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443744    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443746    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443749    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443751    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443754    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443756    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443759    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443761    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443763    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443766    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443768    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443770    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443773    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443776    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.443778    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444176    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.447114 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444181    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444184    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444187    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444191    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444193    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444196    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444199    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444201    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444204    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444206    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444209    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444211    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444214    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444217    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444219    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444222    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444225    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444229    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444231    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444234    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.447602 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444236    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444239    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444241    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444244    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444246    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444249    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444251    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444253    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444256    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444258    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444261    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444263    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444266    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444268    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444270    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444273    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444276    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444278    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444281    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444284    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.448085 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444286    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444288    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444291    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444293    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444297    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444301    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444304    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444307    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444310    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444312    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444315    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444317    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444319    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444322    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444324    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444326    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444329    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444331    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444333    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444336    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.448573 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444338    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444341    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444344    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444346    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444348    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444351    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444353    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444356    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444358    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444361    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444363    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444365    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444369    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444371    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444373    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444376    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444378    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444381    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444383    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444386    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.449057 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444388    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444391    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444395    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444398    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444401    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444405    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444408    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444411    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444413    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444416    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444419    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444421    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444424    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444427    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444429    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444431    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444434    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.444436    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444514    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 05:33:00.449588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444525    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444534    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444540    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444548    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444551    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444555    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444560    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444562    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444565    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444569    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444572    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444575    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444579    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444581    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444584    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444588    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444591    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444595    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444598    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444601    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444604    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444607    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444610    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 05:33:00.450055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444613    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444616    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444619    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444622    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444625    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444628    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444630    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444633    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444637    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444640    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444643    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444646    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444649    2567 flags.go:64] FLAG: --enable-server="true"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444652    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444656    2567 flags.go:64] FLAG: --event-burst="100"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444659    2567 flags.go:64] FLAG: --event-qps="50"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444662    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444664    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444669    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444672    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444675    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444678    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444681    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444684    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444688    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 05:33:00.450610 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444691    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444694    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444696    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444699    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444702    2567 flags.go:64] FLAG: --feature-gates=""
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444706    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444708    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444712    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444715    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444718    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444721    2567 flags.go:64] FLAG: --help="false"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444723    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444727    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444730    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444733    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444736    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444739    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444742    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444745    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444747    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444750    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444753    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444756    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444759    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 17 05:33:00.451243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444761    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444765    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444768    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444771    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444773    2567 flags.go:64] FLAG: --lock-file=""
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444776    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444779    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444783    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444788    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444791    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444794    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444797    2567 flags.go:64] FLAG: --logging-format="text"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444799    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444802    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444805    2567 flags.go:64] FLAG: --manifest-url=""
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444808    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444817    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444820    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444824    2567 flags.go:64] FLAG: --max-pods="110"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444827    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444830    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444832    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444835    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444838    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444841    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 05:33:00.451819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444843    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444851    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444854    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444857    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444860    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444863    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444868    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444871    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444875    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444878    2567 flags.go:64] FLAG: --port="10250"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444881    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444884    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a607343ea0bc1795"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444887    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444890    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444893    2567 flags.go:64] FLAG: --register-node="true"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444897    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444900    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444903    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444906    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444908    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444912    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444915    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444917    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444920    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444923    2567 flags.go:64] FLAG: --runonce="false"
Jul 17 05:33:00.452439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444926    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444928    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444931    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444934    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444936    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444939    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444942    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444945    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444947    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444950    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444953    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444955    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444958    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444962    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444964    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444971    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444974    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444977    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444980    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444983    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444985    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444988    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444992    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444994    2567 flags.go:64] FLAG: --v="2"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.444998    2567 flags.go:64] FLAG: --version="false"
Jul 17 05:33:00.453066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.445002    2567 flags.go:64] FLAG: --vmodule=""
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.445006    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.445009    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445157    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445161    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445164    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445167    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445170    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445172    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445175    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445177    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445181    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445185    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445188    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445191    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445194    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445196    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445199    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445202    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445205    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.453686 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445207    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445210    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445214    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445216    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445219    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445221    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445224    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445226    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445229    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445232    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445235    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445237    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445240    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445242    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445245    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445247    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445249    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445251    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445254    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.454177 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445256    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445259    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445262    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445266    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445269    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445271    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445274    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445276    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445278    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445281    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445283    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445286    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445288    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445291    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445293    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445298    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445301    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445303    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445305    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.454634 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445308    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445310    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445312    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445316    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445318    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445321    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445323    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445326    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445328    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445330    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445333    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445335    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445338    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445340    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445342    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445345    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445347    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445350    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445354    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445357    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.455088 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445360    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445362    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445365    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445368    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445371    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445373    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445375    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445378    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445381    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445385    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445387    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445389    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445392    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445394    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445397    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445401    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445403    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445406    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445408    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445411    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.455794 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445413    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445415    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445418    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.445420    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.446446    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.453490    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.453507    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.454098    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.454120    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454184    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454189    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454192    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454196    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454199    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454201    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.456479 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454204    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454207    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454210    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454213    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454215    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454219    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454221    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454226    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454231    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454234    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454237    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454240    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454242    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454246    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454248    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454250    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454253    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454255    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454258    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454260    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.456862 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454262    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454265    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454267    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454275    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454278    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454281    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454283    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454285    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454288    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454290    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454293    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454296    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454298    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454301    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454303    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454306    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454308    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454311    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454313    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454316    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.457363 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454318    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454321    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454323    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454326    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454328    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454331    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454333    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454336    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454338    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454341    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454343    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454347    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454351    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454353    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454356    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454359    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454368    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454371    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454373    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.457857 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454376    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454378    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454381    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454383    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454385    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454388    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454390    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454392    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454395    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454397    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454399    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454402    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454404    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454407    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454409    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454411    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454414    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454416    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454418    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454421    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.458344 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454423    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454426    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454428    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454431    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454433    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454436    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454438    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454440    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454443    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454447    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454455    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454458    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454462    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454464    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.458821 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.454469    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454622    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454627    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454630    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454632    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454635    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454638    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454641    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454643    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454646    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454648    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454651    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454653    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454656    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454658    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454660    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454663    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454665    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454668    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454670    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:33:00.459263 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454672    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454675    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454677    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454681    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454684    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454688    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454691    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454693    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454696    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454704    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454707    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454709    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454717    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454720    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454722    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454724    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454727    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454729    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454732    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:33:00.459750 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454734    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454737    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454740    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454742    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454744    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454747    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454749    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454751    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454754    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454756    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454759    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454761    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454764    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454766    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454768    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454771    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454776    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454778    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454780    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454783    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:33:00.460217 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454785    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454787    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454790    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454797    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454800    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454803    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454805    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454808    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454810    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454812    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454814    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454819    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454821    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454824    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454826    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454829    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454831    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454834    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454836    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454838    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:33:00.460694 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454849    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454852    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454854    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454857    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454859    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454862    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454864    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454867    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454870    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454872    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454875    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454878    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454881    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454884    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454887    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454890    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454902    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454905    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454907    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:33:00.461223 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454910    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:00.454912    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.454917    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.456424    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.458632    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.459865    2567 server.go:1019] "Starting client certificate rotation"
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.459976    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 05:33:00.461681 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.460009    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 05:33:00.462587 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.462572    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 05:33:00.464080 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.464065    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 05:33:00.475401 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.475385    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 17 05:33:00.477633 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.477619    2567 log.go:25] "Validated CRI v1 image API"
Jul 17 05:33:00.478503 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.478484    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 05:33:00.480877 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.480851    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e98f9c0-d921-479d-b24b-6c03c2849580:/dev/nvme0n1p3 db5bbabd-ffca-471d-8741-ea4be3c5fc68:/dev/nvme0n1p4]
Jul 17 05:33:00.480947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.480877    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 05:33:00.487844 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.487813    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 05:33:00.487929 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.487747    2567 manager.go:216] Machine: {Timestamp:2026-07-17 05:33:00.486089516 +0000 UTC m=+0.364848866 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100492 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23889be07e1c9be3f8d1bb5dc34e51 SystemUUID:ec23889b-e07e-1c9b-e3f8-d1bb5dc34e51 BootID:efb84764-3484-4178-a7d2-c82307633285 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:18:80:0b:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:18:80:0b:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:d6:fc:f9:c8:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 05:33:00.487929 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.487910    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 05:33:00.488023 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.487991    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 05:33:00.491204 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.491176    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 05:33:00.491346 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.491206    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 05:33:00.491990 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.491981    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 05:33:00.492021 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.491992    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 05:33:00.492021 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.492000    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 05:33:00.492762 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.492752    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 05:33:00.494060 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.494051    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 05:33:00.497762 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497751    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 05:33:00.497888 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497878    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 05:33:00.497933 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497913    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 05:33:00.497962 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497932    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 05:33:00.497962 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497946    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 05:33:00.498043 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497976    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 17 05:33:00.498043 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.497985    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 05:33:00.498466 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.498451    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 05:33:00.498466 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.498470    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 05:33:00.502599 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.502572    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 05:33:00.504579 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.504561    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 05:33:00.504642 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.504594    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 05:33:00.505725 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505703    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505730    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505745    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505751    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505759    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505765    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505773    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505778    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505784    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505790    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 05:33:00.505793 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505798    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 05:33:00.506281 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.505804    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 05:33:00.506603 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.506584    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7m2k7"
Jul 17 05:33:00.506822 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.506811    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 05:33:00.506866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.506823    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 05:33:00.508614 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.508592    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 05:33:00.508614 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.508604    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 05:33:00.508708 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.508650    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 05:33:00.510087 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.510074    2567 server.go:1268] "Started kubelet"
Jul 17 05:33:00.510209 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.510183    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 05:33:00.510264 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.510183    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 05:33:00.510312 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.510285    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 05:33:00.510999 ip-10-0-142-187 systemd[1]: Started Kubernetes Kubelet.
Jul 17 05:33:00.511856 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.511807    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 05:33:00.512592 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.512573    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 05:33:00.513630 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.513611    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7m2k7"
Jul 17 05:33:00.517053 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.517021    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 05:33:00.519165 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519152    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 05:33:00.519212 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519170    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 05:33:00.519267 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.519233    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.519846 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519828    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 05:33:00.519846 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519846    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 05:33:00.519980 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519952    2567 factory.go:55] Registering systemd factory
Jul 17 05:33:00.519980 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519969    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 17 05:33:00.520059 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519997    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 05:33:00.520059 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.519955    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 05:33:00.520059 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520015    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 05:33:00.520333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520320    2567 factory.go:153] Registering CRI-O factory
Jul 17 05:33:00.520392 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520336    2567 factory.go:223] Registration of the crio container factory successfully
Jul 17 05:33:00.520392 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520383    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 05:33:00.520480 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520406    2567 factory.go:103] Registering Raw factory
Jul 17 05:33:00.520480 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520421    2567 manager.go:1196] Started watching for new ooms in manager
Jul 17 05:33:00.520904 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.520889    2567 manager.go:349] Starting recovery of all containers
Jul 17 05:33:00.523819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.523795    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:00.528425 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.528407    2567 manager.go:354] Recovery completed
Jul 17 05:33:00.532569 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.532381    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-187.ec2.internal\" not found" node="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.539003 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.538986    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.540771 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.540754    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.540844 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.540786    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.540844 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.540797    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.541340 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.541328    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 05:33:00.541340 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.541338    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 05:33:00.541438 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.541356    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 05:33:00.541438 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.541365    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.542013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.541998    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.542097 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.542024    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.542097 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.542037    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.543456 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.543443    2567 policy_none.go:49] "None policy: Start"
Jul 17 05:33:00.543520 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.543461    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 05:33:00.543520 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.543474    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 05:33:00.545484 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.545471    2567 policy_none.go:47] "Start"
Jul 17 05:33:00.578864 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.578845    2567 manager.go:337] "Starting Device Plugin manager"
Jul 17 05:33:00.578987 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.578879    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 05:33:00.578987 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.578892    2567 server.go:87] "Starting device plugin registration server"
Jul 17 05:33:00.579177 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.579165    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 05:33:00.579237 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.579198    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 05:33:00.579371 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.579352    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 05:33:00.579456 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.579437    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 05:33:00.579456 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.579452    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 05:33:00.579915 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.579891    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 05:33:00.579974 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.579954    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.597314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.597288    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 05:33:00.609991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.598616    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 05:33:00.609991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.598659    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 05:33:00.609991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.598681    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 05:33:00.609991 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.598721    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 05:33:00.609991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.600918    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:00.679783 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.679749    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.680936 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.680921    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.681000 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.680954    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.681000 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.680965    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.681000 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.680988    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.689588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.689544    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.689588 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.689567    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-187.ec2.internal\": node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.699666 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.699648    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"]
Jul 17 05:33:00.699733 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.699709    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.700560 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.700543    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.700634 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.700572    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.700634 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.700583    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.702723 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.702692    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.702723 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.702711    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.702837 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.702799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.702888 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.702853    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.703449 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703433    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.703510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703471    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.703510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703481    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.703573 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703433    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.703573 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703549    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.703573 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.703565    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.705572 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.705557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.705644 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.705582    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:33:00.706207 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.706182    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:33:00.706285 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.706215    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:33:00.706285 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.706226    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:33:00.721641 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.721621    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-187.ec2.internal\" not found" node="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.725597 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.725581    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-187.ec2.internal\" not found" node="ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.803603 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.803577    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.820959 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.820934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f6608d28020517457478c70f43bbd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-187.ec2.internal\" (UID: \"05f6608d28020517457478c70f43bbd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.821081 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.820965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.821081 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.820985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.903960 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:00.903924    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:00.921218 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.921275 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.921275 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f6608d28020517457478c70f43bbd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-187.ec2.internal\" (UID: \"05f6608d28020517457478c70f43bbd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.921341 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f6608d28020517457478c70f43bbd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-187.ec2.internal\" (UID: \"05f6608d28020517457478c70f43bbd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.921341 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:00.921341 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:00.921298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef1bc8fa0938949801101a4d8fc7f81b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal\" (UID: \"ef1bc8fa0938949801101a4d8fc7f81b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:01.004729 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.004662    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.025159 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.025138    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:01.028701 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.028682    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:01.105086 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.105047    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.205583 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.205550    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.306203 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.306099    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.348916 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.348887    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:01.406813 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.406785    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.459339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.459302    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 05:33:01.459899 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.459466    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 05:33:01.459899 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.459473    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 05:33:01.459899 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.459497    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 05:33:01.507860 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.507821    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.518176 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.518140    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 05:28:01 +0000 UTC" deadline="2028-01-30 20:21:55.074611767 +0000 UTC"
Jul 17 05:33:01.518176 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.518171    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13502h48m53.556444124s"
Jul 17 05:33:01.608654 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.608624    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.611990 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:01.611956    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f6608d28020517457478c70f43bbd1.slice/crio-83b9c3b3440dc67aa35d80eea28c1ae27b632aacf44a3d248f977c84e2bc09ea WatchSource:0}: Error finding container 83b9c3b3440dc67aa35d80eea28c1ae27b632aacf44a3d248f977c84e2bc09ea: Status 404 returned error can't find the container with id 83b9c3b3440dc67aa35d80eea28c1ae27b632aacf44a3d248f977c84e2bc09ea
Jul 17 05:33:01.616822 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.616804    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:33:01.622309 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:01.622284    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1bc8fa0938949801101a4d8fc7f81b.slice/crio-6b3b825560e80da55dc45d71e4917807c6597910d257b01499ed5998a6624028 WatchSource:0}: Error finding container 6b3b825560e80da55dc45d71e4917807c6597910d257b01499ed5998a6624028: Status 404 returned error can't find the container with id 6b3b825560e80da55dc45d71e4917807c6597910d257b01499ed5998a6624028
Jul 17 05:33:01.709586 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.709545    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.810153 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.810094    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.910684 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:01.910586    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-187.ec2.internal\" not found"
Jul 17 05:33:01.938528 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:01.938499    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:02.019683 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:02.019657    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:02.030080 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:02.030058    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 05:33:02.031084 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:02.031070    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal"
Jul 17 05:33:02.036886 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:02.036870    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 05:33:03.914356 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.914324    2567 apiserver.go:52] "Watching apiserver"
Jul 17 05:33:03.922960 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.922922    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 05:33:03.924013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.923981    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nz2h8","kube-system/konnectivity-agent-vbdzf","openshift-cluster-node-tuning-operator/tuned-vhm85","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal","openshift-multus/multus-gsn4q","openshift-network-diagnostics/network-check-target-kxgzj","openshift-network-operator/iptables-alerter-ks87w","openshift-ovn-kubernetes/ovnkube-node-kgtr8","kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566","openshift-dns/node-resolver-gwjxr","openshift-image-registry/node-ca-lr5l2","openshift-multus/multus-additional-cni-plugins-cp88x","openshift-multus/network-metrics-daemon-hzh45"]
Jul 17 05:33:03.925083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.925056    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:03.926691 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.926658    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.928755 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.928730    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 05:33:03.929003 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.928989    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dl297\""
Jul 17 05:33:03.929225 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.929210    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.929377 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.929362    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.929832 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.929809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.932162 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.931924    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.932162 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.931966    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kv7b\""
Jul 17 05:33:03.932313 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.932220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 05:33:03.932801 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.932650    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 05:33:03.933797 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.933778    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.933887 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.933778    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 05:33:03.934031 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.934016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.935585 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.935145    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 05:33:03.936161 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.936142    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n2c5v\""
Jul 17 05:33:03.936279 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.936188    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.936410 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.936396    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.936585 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.936571    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:03.936653 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:03.936633    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:03.938654 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.938636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:03.940992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.940971    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 05:33:03.942848 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.941193    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pmlv8\""
Jul 17 05:33:03.942997 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.942974    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:03.943060 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:03.943046    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:03.945258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-tmp\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945335 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnwnm\" (UniqueName: \"kubernetes.io/projected/17dac02b-bb88-4c9a-a236-6ba95c84595d-kube-api-access-jnwnm\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945335 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvfr\" (UniqueName: \"kubernetes.io/projected/17f769d5-02cb-4652-9dea-0876273087c6-kube-api-access-bxvfr\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:03.945438 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-registration-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.945438 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-modprobe-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945438 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945423    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-device-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.945568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysconfig\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945469    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-systemd\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945544    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jh7\" (UniqueName: \"kubernetes.io/projected/4eb15bb3-9728-45bd-8977-95576942893d-kube-api-access-w5jh7\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.945741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cnibin\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-os-release\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-conf\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945653    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-sys\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-sys-fs\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-kubernetes\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945857    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-tuned\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-system-cni-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-host\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.945977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.945985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-socket-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946059    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhdwd\" (UniqueName: \"kubernetes.io/projected/232ea57f-e48f-4ef6-9ce3-46609b7fc283-kube-api-access-mhdwd\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-run\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-lib-modules\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.946494 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-var-lib-kubelet\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:03.946813 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.946793    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:03.948627 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.948598    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 05:33:03.948789 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.948774    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.948975    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949040    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949059    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nhf84\""
Jul 17 05:33:03.949271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949271    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.949551 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.949471    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 05:33:03.951047 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.951026    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 05:33:03.951768 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.951376    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.951768 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.951391    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.951768 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.951628    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4rb8z\""
Jul 17 05:33:03.952068 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.952029    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:03.953977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.953958    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 05:33:03.954328 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.954310    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 05:33:03.954740 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.954565    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5bmz\""
Jul 17 05:33:03.954897 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.954883    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:03.954965 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:03.954943    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:03.957227 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.957208    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:03.959309 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.959288    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.959309 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.959298    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prbkg\""
Jul 17 05:33:03.959464 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.959433    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.959882 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.959846    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:03.962423 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.962390    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 05:33:03.962804 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.962771    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vthv2\""
Jul 17 05:33:03.962940 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.962923    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 05:33:03.963263 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.963239    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 05:33:03.965423 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.965140    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-znx29"
Jul 17 05:33:03.972755 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:03.972734    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-znx29"
Jul 17 05:33:04.008989 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.008964    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:04.020078 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.020024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal" event={"ID":"ef1bc8fa0938949801101a4d8fc7f81b","Type":"ContainerStarted","Data":"6b3b825560e80da55dc45d71e4917807c6597910d257b01499ed5998a6624028"}
Jul 17 05:33:04.021300 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.021272    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal" event={"ID":"05f6608d28020517457478c70f43bbd1","Type":"ContainerStarted","Data":"83b9c3b3440dc67aa35d80eea28c1ae27b632aacf44a3d248f977c84e2bc09ea"}
Jul 17 05:33:04.036960 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.036931    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 05:33:04.046698 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-socket-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.046698 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-tmp\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnwnm\" (UniqueName: \"kubernetes.io/projected/17dac02b-bb88-4c9a-a236-6ba95c84595d-kube-api-access-jnwnm\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-conf-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-multus-certs\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-script-lib\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvfr\" (UniqueName: \"kubernetes.io/projected/17f769d5-02cb-4652-9dea-0876273087c6-kube-api-access-bxvfr\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:04.046890 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046873    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af3e416-61aa-416f-86c9-fc7bebee5079-host-slash\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-cni-binary-copy\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046920    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-multus-daemon-config\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-registration-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af3e416-61aa-416f-86c9-fc7bebee5079-iptables-alerter-script\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.046997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-os-release\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-multus\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-var-lib-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-agent-certs\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-device-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-systemd\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlrg\" (UniqueName: \"kubernetes.io/projected/ddcade3c-54a5-4606-b23b-f6d523c49bd0-kube-api-access-4wlrg\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-hostroot\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-netns\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.047253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-ovn\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-log-socket\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-hosts-file\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-k8s-cni-cncf-io\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-registration-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cnibin\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-conf\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-kubelet-config\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-socket-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-node-log\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-sys-fs\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-tuned\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-tmp-dir\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-slash\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-config\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-env-overrides\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdph\" (UniqueName: \"kubernetes.io/projected/b117a2a3-f598-445e-832d-90235f9d9f27-kube-api-access-nkdph\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-host\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcade3c-54a5-4606-b23b-f6d523c49bd0-host\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-systemd-units\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-systemd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhdwd\" (UniqueName: \"kubernetes.io/projected/232ea57f-e48f-4ef6-9ce3-46609b7fc283-kube-api-access-mhdwd\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-run\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-lib-modules\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047892    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-var-lib-kubelet\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-device-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.048632 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-systemd\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cnibin\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048395    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysctl-conf\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.048474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-sys-fs\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.047901    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-var-lib-kubelet\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-socket-dir-parent\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-kubelet\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.049243 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.049461 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.049461 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-host\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049461 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049442    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-run\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049592    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddcade3c-54a5-4606-b23b-f6d523c49bd0-serviceca\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-lib-modules\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbr9\" (UniqueName: \"kubernetes.io/projected/c4666bbd-64d6-4977-b104-b4c625801801-kube-api-access-lfbr9\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-kubelet\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.049841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-modprobe-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-cnibin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-etc-kubernetes\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-modprobe-d\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.049993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-netd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysconfig\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-netns\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b117a2a3-f598-445e-832d-90235f9d9f27-ovn-node-metrics-cert\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050105    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-sysconfig\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-konnectivity-ca\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkxg\" (UniqueName: \"kubernetes.io/projected/0af3e416-61aa-416f-86c9-fc7bebee5079-kube-api-access-kqkxg\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.050153 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-etc-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050174    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jh7\" (UniqueName: \"kubernetes.io/projected/4eb15bb3-9728-45bd-8977-95576942893d-kube-api-access-w5jh7\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-os-release\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050218    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-sys\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-sys\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-os-release\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-kubernetes\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4eb15bb3-9728-45bd-8977-95576942893d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-dbus\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050445    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcnmr\" (UniqueName: \"kubernetes.io/projected/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-kube-api-access-fcnmr\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-system-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050463    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-kubernetes\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-bin\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.050536    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:04.050699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-system-cni-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.051328 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-bin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.051328 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/232ea57f-e48f-4ef6-9ce3-46609b7fc283-system-cni-dir\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.051328 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.050655    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:04.550621915 +0000 UTC m=+3.013806020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:04.051328 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.050897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/232ea57f-e48f-4ef6-9ce3-46609b7fc283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.051768 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.051745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-tmp\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.051847 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.051792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17dac02b-bb88-4c9a-a236-6ba95c84595d-etc-tuned\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.057242 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.057222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnwnm\" (UniqueName: \"kubernetes.io/projected/17dac02b-bb88-4c9a-a236-6ba95c84595d-kube-api-access-jnwnm\") pod \"tuned-vhm85\" (UID: \"17dac02b-bb88-4c9a-a236-6ba95c84595d\") " pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.057384 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.057362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvfr\" (UniqueName: \"kubernetes.io/projected/17f769d5-02cb-4652-9dea-0876273087c6-kube-api-access-bxvfr\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:04.058838 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.058819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jh7\" (UniqueName: \"kubernetes.io/projected/4eb15bb3-9728-45bd-8977-95576942893d-kube-api-access-w5jh7\") pod \"aws-ebs-csi-driver-node-k9566\" (UID: \"4eb15bb3-9728-45bd-8977-95576942893d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.064089 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.064066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhdwd\" (UniqueName: \"kubernetes.io/projected/232ea57f-e48f-4ef6-9ce3-46609b7fc283-kube-api-access-mhdwd\") pod \"multus-additional-cni-plugins-cp88x\" (UID: \"232ea57f-e48f-4ef6-9ce3-46609b7fc283\") " pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.151175 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-multus\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151175 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-var-lib-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-agent-certs\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlrg\" (UniqueName: \"kubernetes.io/projected/ddcade3c-54a5-4606-b23b-f6d523c49bd0-kube-api-access-4wlrg\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-multus\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-hostroot\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-netns\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-var-lib-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-ovn\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-run-netns\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-ovn\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-log-socket\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-hostroot\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151398 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-hosts-file\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-k8s-cni-cncf-io\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-log-socket\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-kubelet-config\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151495    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-k8s-cni-cncf-io\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-node-log\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151519    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-kubelet-config\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-tmp-dir\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-hosts-file\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-slash\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.151574    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-config\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151614    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-node-log\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.151631    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:04.651611067 +0000 UTC m=+3.114795154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-slash\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.151966 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-env-overrides\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdph\" (UniqueName: \"kubernetes.io/projected/b117a2a3-f598-445e-832d-90235f9d9f27-kube-api-access-nkdph\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcade3c-54a5-4606-b23b-f6d523c49bd0-host\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-systemd-units\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-systemd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151855    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcade3c-54a5-4606-b23b-f6d523c49bd0-host\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-socket-dir-parent\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-systemd-units\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-kubelet\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-tmp-dir\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151946    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-kubelet\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-systemd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddcade3c-54a5-4606-b23b-f6d523c49bd0-serviceca\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.151978    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbr9\" (UniqueName: \"kubernetes.io/projected/c4666bbd-64d6-4977-b104-b4c625801801-kube-api-access-lfbr9\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-kubelet\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.152553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-cnibin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-kubelet\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-socket-dir-parent\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-etc-kubernetes\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-etc-kubernetes\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152169    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-netd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-config\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-env-overrides\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-netns\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-cnibin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b117a2a3-f598-445e-832d-90235f9d9f27-ovn-node-metrics-cert\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152243    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-netns\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-netd\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-konnectivity-ca\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkxg\" (UniqueName: \"kubernetes.io/projected/0af3e416-61aa-416f-86c9-fc7bebee5079-kube-api-access-kqkxg\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-etc-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ddcade3c-54a5-4606-b23b-f6d523c49bd0-serviceca\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.153370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-dbus\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-etc-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcnmr\" (UniqueName: \"kubernetes.io/projected/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-kube-api-access-fcnmr\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152562    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d69bccb2-b724-47b1-b267-dc685e49047a-dbus\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-system-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152609    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-bin\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-bin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-system-cni-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-conf-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-host-cni-bin\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-multus-certs\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152712    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-var-lib-cni-bin\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-multus-conf-dir\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-script-lib\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-host-run-multus-certs\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-konnectivity-ca\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b117a2a3-f598-445e-832d-90235f9d9f27-run-openvswitch\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af3e416-61aa-416f-86c9-fc7bebee5079-host-slash\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-cni-binary-copy\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af3e416-61aa-416f-86c9-fc7bebee5079-host-slash\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-multus-daemon-config\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af3e416-61aa-416f-86c9-fc7bebee5079-iptables-alerter-script\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-os-release\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.152955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4666bbd-64d6-4977-b104-b4c625801801-os-release\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.153212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b117a2a3-f598-445e-832d-90235f9d9f27-ovnkube-script-lib\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.153337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-cni-binary-copy\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.153484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c4666bbd-64d6-4977-b104-b4c625801801-multus-daemon-config\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.154863 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.154031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af3e416-61aa-416f-86c9-fc7bebee5079-iptables-alerter-script\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.155316 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.155043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/266708c1-a69f-4d2a-a1d4-18bdccac4cd2-agent-certs\") pod \"konnectivity-agent-vbdzf\" (UID: \"266708c1-a69f-4d2a-a1d4-18bdccac4cd2\") " pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.155316 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.155235    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b117a2a3-f598-445e-832d-90235f9d9f27-ovn-node-metrics-cert\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.160368 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.160348    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:04.160368 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.160370    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:04.160510 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.160383    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:04.160510 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.160441    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:04.660428529 +0000 UTC m=+3.123612612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:04.163372 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.163324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkxg\" (UniqueName: \"kubernetes.io/projected/0af3e416-61aa-416f-86c9-fc7bebee5079-kube-api-access-kqkxg\") pod \"iptables-alerter-ks87w\" (UID: \"0af3e416-61aa-416f-86c9-fc7bebee5079\") " pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.163372 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.163353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdph\" (UniqueName: \"kubernetes.io/projected/b117a2a3-f598-445e-832d-90235f9d9f27-kube-api-access-nkdph\") pod \"ovnkube-node-kgtr8\" (UID: \"b117a2a3-f598-445e-832d-90235f9d9f27\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.163525 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.163413    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlrg\" (UniqueName: \"kubernetes.io/projected/ddcade3c-54a5-4606-b23b-f6d523c49bd0-kube-api-access-4wlrg\") pod \"node-ca-lr5l2\" (UID: \"ddcade3c-54a5-4606-b23b-f6d523c49bd0\") " pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.164178 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.164155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcnmr\" (UniqueName: \"kubernetes.io/projected/1fd5f8f0-e459-458f-8e96-e4ca0003da1a-kube-api-access-fcnmr\") pod \"node-resolver-gwjxr\" (UID: \"1fd5f8f0-e459-458f-8e96-e4ca0003da1a\") " pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.164271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.164219    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbr9\" (UniqueName: \"kubernetes.io/projected/c4666bbd-64d6-4977-b104-b4c625801801-kube-api-access-lfbr9\") pod \"multus-gsn4q\" (UID: \"c4666bbd-64d6-4977-b104-b4c625801801\") " pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.240106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.240021    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566"
Jul 17 05:33:04.249121 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.249094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp88x"
Jul 17 05:33:04.258024 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.258000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhm85"
Jul 17 05:33:04.264791 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.264771    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gsn4q"
Jul 17 05:33:04.277441 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.277422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:04.286102 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.286085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ks87w"
Jul 17 05:33:04.293703 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.293669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:04.301324 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.301303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gwjxr"
Jul 17 05:33:04.307989 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.307966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lr5l2"
Jul 17 05:33:04.556331 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.556252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:04.556474 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.556396    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:04.556474 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.556457    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:05.556439095 +0000 UTC m=+4.019623194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:04.657644 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.657606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:04.657799 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.657774    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:04.657846 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.657836    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:05.657821449 +0000 UTC m=+4.121005531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:04.758338 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.758309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:04.758515 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.758493    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:04.758567 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.758521    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:04.758567 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.758531    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:04.758639 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:04.758590    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:05.758572674 +0000 UTC m=+4.221756776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:04.975790 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.975715    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 05:28:03 +0000 UTC" deadline="2028-01-31 15:00:16.317512804 +0000 UTC"
Jul 17 05:33:04.975790 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:04.975747    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13521h27m11.341769174s"
Jul 17 05:33:05.014099 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.014062    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232ea57f_e48f_4ef6_9ce3_46609b7fc283.slice/crio-37ebea8cac546253e925085188ba064349535992792b3c2054e81a0b49d392c6 WatchSource:0}: Error finding container 37ebea8cac546253e925085188ba064349535992792b3c2054e81a0b49d392c6: Status 404 returned error can't find the container with id 37ebea8cac546253e925085188ba064349535992792b3c2054e81a0b49d392c6
Jul 17 05:33:05.014527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.014502    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:05.014718 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.014636    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:05.015512 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.015489    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb15bb3_9728_45bd_8977_95576942893d.slice/crio-f05e506fd8f8a542149bee7d2c79101b186d258be77c5de46feb988403864280 WatchSource:0}: Error finding container f05e506fd8f8a542149bee7d2c79101b186d258be77c5de46feb988403864280: Status 404 returned error can't find the container with id f05e506fd8f8a542149bee7d2c79101b186d258be77c5de46feb988403864280
Jul 17 05:33:05.017051 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.017025    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af3e416_61aa_416f_86c9_fc7bebee5079.slice/crio-fb75497cc5dde59316acb077223776b82965af0337b5cf2d8ed85f3a31cdcb24 WatchSource:0}: Error finding container fb75497cc5dde59316acb077223776b82965af0337b5cf2d8ed85f3a31cdcb24: Status 404 returned error can't find the container with id fb75497cc5dde59316acb077223776b82965af0337b5cf2d8ed85f3a31cdcb24
Jul 17 05:33:05.018886 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.018822    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17dac02b_bb88_4c9a_a236_6ba95c84595d.slice/crio-551bfe0faa5245f9288e0a287215531aca4e77e0c07f530bf0b0e6856d353a96 WatchSource:0}: Error finding container 551bfe0faa5245f9288e0a287215531aca4e77e0c07f530bf0b0e6856d353a96: Status 404 returned error can't find the container with id 551bfe0faa5245f9288e0a287215531aca4e77e0c07f530bf0b0e6856d353a96
Jul 17 05:33:05.019707 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.019642    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4666bbd_64d6_4977_b104_b4c625801801.slice/crio-65afd398a7ab5b42934642f5acbe77878b68fc53a4c0b78a860aded9292d4dad WatchSource:0}: Error finding container 65afd398a7ab5b42934642f5acbe77878b68fc53a4c0b78a860aded9292d4dad: Status 404 returned error can't find the container with id 65afd398a7ab5b42934642f5acbe77878b68fc53a4c0b78a860aded9292d4dad
Jul 17 05:33:05.020461 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.020438    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb117a2a3_f598_445e_832d_90235f9d9f27.slice/crio-0fa914357848bafdb273649f05c09e320a11418a2c37b0b9145a67b331cc972c WatchSource:0}: Error finding container 0fa914357848bafdb273649f05c09e320a11418a2c37b0b9145a67b331cc972c: Status 404 returned error can't find the container with id 0fa914357848bafdb273649f05c09e320a11418a2c37b0b9145a67b331cc972c
Jul 17 05:33:05.021968 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.021942    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcade3c_54a5_4606_b23b_f6d523c49bd0.slice/crio-9dcc4ef2d7562e494f8da38197443271cefb0d94b58ad0c87c215d6dce82d216 WatchSource:0}: Error finding container 9dcc4ef2d7562e494f8da38197443271cefb0d94b58ad0c87c215d6dce82d216: Status 404 returned error can't find the container with id 9dcc4ef2d7562e494f8da38197443271cefb0d94b58ad0c87c215d6dce82d216
Jul 17 05:33:05.024112 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.024087    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd5f8f0_e459_458f_8e96_e4ca0003da1a.slice/crio-a100a10db6326c7673dab28d0f6d8cdd7d5fdc8d1c680708365c3bbf2a2bdc2f WatchSource:0}: Error finding container a100a10db6326c7673dab28d0f6d8cdd7d5fdc8d1c680708365c3bbf2a2bdc2f: Status 404 returned error can't find the container with id a100a10db6326c7673dab28d0f6d8cdd7d5fdc8d1c680708365c3bbf2a2bdc2f
Jul 17 05:33:05.025048 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:05.024697    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266708c1_a69f_4d2a_a1d4_18bdccac4cd2.slice/crio-0d4d4007413b7a05abc4dba26457f66867924709380b9d6f4c5e2162219b440f WatchSource:0}: Error finding container 0d4d4007413b7a05abc4dba26457f66867924709380b9d6f4c5e2162219b440f: Status 404 returned error can't find the container with id 0d4d4007413b7a05abc4dba26457f66867924709380b9d6f4c5e2162219b440f
Jul 17 05:33:05.027344 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.027202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"0fa914357848bafdb273649f05c09e320a11418a2c37b0b9145a67b331cc972c"}
Jul 17 05:33:05.030106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.030075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gsn4q" event={"ID":"c4666bbd-64d6-4977-b104-b4c625801801","Type":"ContainerStarted","Data":"65afd398a7ab5b42934642f5acbe77878b68fc53a4c0b78a860aded9292d4dad"}
Jul 17 05:33:05.031781 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.031755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhm85" event={"ID":"17dac02b-bb88-4c9a-a236-6ba95c84595d","Type":"ContainerStarted","Data":"551bfe0faa5245f9288e0a287215531aca4e77e0c07f530bf0b0e6856d353a96"}
Jul 17 05:33:05.032965 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.032916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ks87w" event={"ID":"0af3e416-61aa-416f-86c9-fc7bebee5079","Type":"ContainerStarted","Data":"fb75497cc5dde59316acb077223776b82965af0337b5cf2d8ed85f3a31cdcb24"}
Jul 17 05:33:05.034094 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.034076    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566" event={"ID":"4eb15bb3-9728-45bd-8977-95576942893d","Type":"ContainerStarted","Data":"f05e506fd8f8a542149bee7d2c79101b186d258be77c5de46feb988403864280"}
Jul 17 05:33:05.035880 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.035859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerStarted","Data":"37ebea8cac546253e925085188ba064349535992792b3c2054e81a0b49d392c6"}
Jul 17 05:33:05.094513 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.094324    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:33:05.563559 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.563469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:05.563748 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.563714    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:05.563821 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.563783    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:07.56376281 +0000 UTC m=+6.026946899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:05.664414 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.664359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:05.664588 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.664569    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:05.664648 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.664635    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:07.66461639 +0000 UTC m=+6.127800478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:05.765460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.765422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:05.765654 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.765633    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:05.765751 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.765661    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:05.765751 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.765673    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:05.765751 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:05.765749    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:07.765731131 +0000 UTC m=+6.228915231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:05.978866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.978755    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 05:28:03 +0000 UTC" deadline="2027-12-15 00:55:23.262261036 +0000 UTC"
Jul 17 05:33:05.978866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:05.978816    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12379h22m17.28344896s"
Jul 17 05:33:06.015228 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.015198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:06.015388 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:06.015318    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:06.015752 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.015732    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:06.015859 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:06.015828    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:06.050891 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.050747    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vbdzf" event={"ID":"266708c1-a69f-4d2a-a1d4-18bdccac4cd2","Type":"ContainerStarted","Data":"0d4d4007413b7a05abc4dba26457f66867924709380b9d6f4c5e2162219b440f"}
Jul 17 05:33:06.054278 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.054246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gwjxr" event={"ID":"1fd5f8f0-e459-458f-8e96-e4ca0003da1a","Type":"ContainerStarted","Data":"a100a10db6326c7673dab28d0f6d8cdd7d5fdc8d1c680708365c3bbf2a2bdc2f"}
Jul 17 05:33:06.061905 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.061834    2567 generic.go:356] "Generic (PLEG): container finished" podID="ef1bc8fa0938949801101a4d8fc7f81b" containerID="0279bd06d95609384ee83e5ca732261d45347049df88edb1190977620ad38705" exitCode=0
Jul 17 05:33:06.062019 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.061911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal" event={"ID":"ef1bc8fa0938949801101a4d8fc7f81b","Type":"ContainerDied","Data":"0279bd06d95609384ee83e5ca732261d45347049df88edb1190977620ad38705"}
Jul 17 05:33:06.077982 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.077951    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal" event={"ID":"05f6608d28020517457478c70f43bbd1","Type":"ContainerStarted","Data":"67720929b3ec737238e7573a8435434d19bd08a129125e29136c3457930fd740"}
Jul 17 05:33:06.086057 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:06.086019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr5l2" event={"ID":"ddcade3c-54a5-4606-b23b-f6d523c49bd0","Type":"ContainerStarted","Data":"9dcc4ef2d7562e494f8da38197443271cefb0d94b58ad0c87c215d6dce82d216"}
Jul 17 05:33:07.015334 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.014806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:07.015334 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.014967    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:07.102844 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.102777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal" event={"ID":"ef1bc8fa0938949801101a4d8fc7f81b","Type":"ContainerStarted","Data":"d36c6bc90bd88b21081284f1c5b9c19798ca94750911bb1774177313f15dad04"}
Jul 17 05:33:07.118914 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.118856    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-187.ec2.internal" podStartSLOduration=4.118833768 podStartE2EDuration="4.118833768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:06.091857969 +0000 UTC m=+4.555042074" watchObservedRunningTime="2026-07-17 05:33:07.118833768 +0000 UTC m=+5.582017875"
Jul 17 05:33:07.583125 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.582265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:07.583125 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.582467    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:07.583125 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.582529    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:11.582512311 +0000 UTC m=+10.045696398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:07.683470 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.683433    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:07.683645 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.683596    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:07.683716 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.683658    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:11.683641267 +0000 UTC m=+10.146825355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:07.784291 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:07.784251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:07.784521 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.784501    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:07.784582 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.784529    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:07.784582 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.784553    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:07.784645 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:07.784610    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:11.784592493 +0000 UTC m=+10.247776579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:08.017480 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:08.017397    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:08.017950 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:08.017513    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:08.017950 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:08.017848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:08.017950 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:08.017928    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:09.016738 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:09.016665    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:09.016908 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:09.016829    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:10.015803 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:10.015771    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:10.016244 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:10.015893    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:10.016320 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:10.016306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:10.016495 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:10.016407    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:11.015276 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:11.014770    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:11.015276 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.014907    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:11.620423 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:11.620389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:11.620831 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.620523    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:11.620831 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.620576    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:19.62056256 +0000 UTC m=+18.083746642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:11.721639 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:11.721600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:11.721832 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.721785    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:11.721907 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.721855    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:19.721834938 +0000 UTC m=+18.185019021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:11.823103 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:11.823063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:11.823281 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.823235    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:11.823281 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.823258    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:11.823281 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.823269    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:11.823438 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:11.823315    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:19.823300035 +0000 UTC m=+18.286484116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:12.027343 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:12.027265    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:12.028465 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:12.027760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:12.028465 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:12.027886    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:12.028465 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:12.028097    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:13.014897 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:13.014861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:13.015334 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:13.015012    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:14.015259 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:14.015193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:14.015259 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:14.015258    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:14.015670 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:14.015341    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:14.017813 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:14.017781    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:15.014816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:15.014785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:15.014977 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:15.014909    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:16.015086 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:16.015044    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:16.015484 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:16.015194    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:16.015484 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:16.015239    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:16.015484 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:16.015384    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:17.015272 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:17.015241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:17.015663 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:17.015374    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:18.015188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:18.015159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:18.015393 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:18.015159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:18.015393 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:18.015271    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:18.015393 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:18.015368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:19.015233 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:19.015198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:19.015443 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.015335    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:19.683887 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:19.683850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:19.684029 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.683956    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:19.684029 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.684013    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:35.683996433 +0000 UTC m=+34.147180516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:19.784809 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:19.784775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:19.784949 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.784910    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:19.785009 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.784961    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:33:35.784948312 +0000 UTC m=+34.248132396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:19.885552 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:19.885512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:19.885716 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.885698    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:19.885756 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.885722    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:19.885756 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.885732    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:19.885828 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:19.885795    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:35.885782188 +0000 UTC m=+34.348966270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:20.015443 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:20.015356    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:20.015839 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:20.015511    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:20.015839 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:20.015556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:20.015839 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:20.015655    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:21.014901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:21.014867    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:21.015071 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:21.014997    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:22.015188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:22.015156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:22.015657 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:22.015258    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:22.015657 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:22.015358    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:22.015657 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:22.015462    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:23.014914 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:23.014885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:23.015068 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:23.015027    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:24.019776 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.019209    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:24.020123 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:24.019932    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:24.020351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.019701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:24.020521 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:24.020507    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:24.137212 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.137185    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566" event={"ID":"4eb15bb3-9728-45bd-8977-95576942893d","Type":"ContainerStarted","Data":"24884ea0753cb64cc866319dd7f12aa742fdcd863829e8b3493354385d279700"}
Jul 17 05:33:24.138628 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.138604    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerStarted","Data":"4d118d4eced963fee76d38e972649e226b2d2a50ecae0ed332f539485e58cd36"}
Jul 17 05:33:24.140305 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.140278    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vbdzf" event={"ID":"266708c1-a69f-4d2a-a1d4-18bdccac4cd2","Type":"ContainerStarted","Data":"0e016e0b63b2f2b615113b2619dfd33b7fc39b539fc48b1f884b8412ccb4bc90"}
Jul 17 05:33:24.142028 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.142004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lr5l2" event={"ID":"ddcade3c-54a5-4606-b23b-f6d523c49bd0","Type":"ContainerStarted","Data":"4f89e5f88154b7d7d5d00464180124bb6d4dcc37104bf3364f0ba5a6d950e741"}
Jul 17 05:33:24.159776 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.159723    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-187.ec2.internal" podStartSLOduration=21.159703793 podStartE2EDuration="21.159703793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:07.119482889 +0000 UTC m=+5.582666997" watchObservedRunningTime="2026-07-17 05:33:24.159703793 +0000 UTC m=+22.622887898"
Jul 17 05:33:24.165704 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.162500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:24.165704 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.162990    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:24.171391 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.171347    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vbdzf" podStartSLOduration=3.318274222 podStartE2EDuration="22.171331133s" totalImagesPullingTime="18.853056911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:24.171266132 +0000 UTC m=+22.634450237" watchObservedRunningTime="2026-07-17 05:33:24.171331133 +0000 UTC m=+22.634515238"
Jul 17 05:33:24.204904 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:24.204858    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lr5l2" podStartSLOduration=3.34890542 podStartE2EDuration="22.204843696s" totalImagesPullingTime="18.855938276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:24.185079247 +0000 UTC m=+22.648263351" watchObservedRunningTime="2026-07-17 05:33:24.204843696 +0000 UTC m=+22.668027801"
Jul 17 05:33:25.015395 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.015190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:25.015578 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:25.015499    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:25.145715 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.145662    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhm85" event={"ID":"17dac02b-bb88-4c9a-a236-6ba95c84595d","Type":"ContainerStarted","Data":"4ee707142a4950c7ac11703a2558616bc05b8c556f13f5de8acd7c9afb471f73"}
Jul 17 05:33:25.146946 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.146921    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="4d118d4eced963fee76d38e972649e226b2d2a50ecae0ed332f539485e58cd36" exitCode=0
Jul 17 05:33:25.147036 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.147001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"4d118d4eced963fee76d38e972649e226b2d2a50ecae0ed332f539485e58cd36"}
Jul 17 05:33:25.148335 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.148283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gwjxr" event={"ID":"1fd5f8f0-e459-458f-8e96-e4ca0003da1a","Type":"ContainerStarted","Data":"747dc02db5f857a494a72018467940f98e3a745c5bea176d014b548555d220e8"}
Jul 17 05:33:25.151175 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151159    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:33:25.151493 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151476    2567 generic.go:356] "Generic (PLEG): container finished" podID="b117a2a3-f598-445e-832d-90235f9d9f27" containerID="19d3120c75d9665b54213f527f281f2b9dcb7ae7827668048e42d668f8452ae0" exitCode=1
Jul 17 05:33:25.151566 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"116634661f1a4a55542f16e3e1bcb4d3ee54c9fe94774bad8bf54efca6cdc12f"}
Jul 17 05:33:25.151612 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"1bae7b9c5a69049abfef550540fbcab5395e9a08f5cf2c079dba45e9cc72ba80"}
Jul 17 05:33:25.151656 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"37d7f1c4889ee652fcdaa6eb177ac595a3d45ee441ac14b35fc3281c29c0c7db"}
Jul 17 05:33:25.151710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"7618a508f6e72847e7d602d77f95034b1b322f197e6881272f21b36a04e6ab72"}
Jul 17 05:33:25.151777 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerDied","Data":"19d3120c75d9665b54213f527f281f2b9dcb7ae7827668048e42d668f8452ae0"}
Jul 17 05:33:25.151831 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.151794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"c2ac8957f12a46e8059c4c80bc99b9deb42cbd8eb57d087133f9fd001cd8900b"}
Jul 17 05:33:25.152880 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.152861    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gsn4q" event={"ID":"c4666bbd-64d6-4977-b104-b4c625801801","Type":"ContainerStarted","Data":"8c708667fcebf9a32b87bf5190e61c3780fc45d848378db6ca0949479f1b1760"}
Jul 17 05:33:25.155055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.155036    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:25.155501 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.155486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vbdzf"
Jul 17 05:33:25.161177 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.161140    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vhm85" podStartSLOduration=4.268594794 podStartE2EDuration="23.161127975s" totalImagesPullingTime="18.892533181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:25.160845907 +0000 UTC m=+23.624030014" watchObservedRunningTime="2026-07-17 05:33:25.161127975 +0000 UTC m=+23.624312078"
Jul 17 05:33:25.201021 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.200976    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gsn4q" podStartSLOduration=4.025897896 podStartE2EDuration="23.200962294s" totalImagesPullingTime="19.175064398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:25.20086673 +0000 UTC m=+23.664050844" watchObservedRunningTime="2026-07-17 05:33:25.200962294 +0000 UTC m=+23.664146398"
Jul 17 05:33:25.229284 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.229197    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gwjxr" podStartSLOduration=4.343502111 podStartE2EDuration="23.229179118s" totalImagesPullingTime="18.885677007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:25.228776648 +0000 UTC m=+23.691960752" watchObservedRunningTime="2026-07-17 05:33:25.229179118 +0000 UTC m=+23.692363223"
Jul 17 05:33:25.252546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:25.252520    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 05:33:26.005701 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.005560    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T05:33:25.252540854Z","UUID":"4580d6ed-954b-45e1-8329-3c8110fb594f","Handler":null,"Name":"","Endpoint":""}
Jul 17 05:33:26.007450 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.007427    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 05:33:26.007541 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.007471    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 05:33:26.014598 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.014566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:26.014775 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:26.014750    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:26.015141 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.015124    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:26.015271 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:26.015249    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:26.157096 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.157058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ks87w" event={"ID":"0af3e416-61aa-416f-86c9-fc7bebee5079","Type":"ContainerStarted","Data":"646c675e420fcf65609e94f9886a7afde117d8b8ad044a5e48e44c8f2ebe625a"}
Jul 17 05:33:26.159203 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.159175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566" event={"ID":"4eb15bb3-9728-45bd-8977-95576942893d","Type":"ContainerStarted","Data":"ea3baf0d32be887a325edba7c0d4f5ea9fd79d822e48f65ac82bf62a5facf26d"}
Jul 17 05:33:26.171874 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:26.171825    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ks87w" podStartSLOduration=5.279622204 podStartE2EDuration="24.17180463s" totalImagesPullingTime="18.892182426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:26.171597798 +0000 UTC m=+24.634781902" watchObservedRunningTime="2026-07-17 05:33:26.17180463 +0000 UTC m=+24.634988736"
Jul 17 05:33:27.014977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:27.014742    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:27.015137 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:27.015077    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:27.165709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:27.165653    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:33:27.166354 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:27.166105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"9fc2f906b37f56b93752ce719a74d2e56461d3400078c9855b6d65d393062ecf"}
Jul 17 05:33:27.168358 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:27.168330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566" event={"ID":"4eb15bb3-9728-45bd-8977-95576942893d","Type":"ContainerStarted","Data":"fe5deffb757c40f59d617d80f8b3be44cd1054fb46fbb848780113cba660a326"}
Jul 17 05:33:27.186456 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:27.186411    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9566" podStartSLOduration=4.169554441 podStartE2EDuration="25.186393977s" totalImagesPullingTime="21.016839536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:27.185048569 +0000 UTC m=+25.648232675" watchObservedRunningTime="2026-07-17 05:33:27.186393977 +0000 UTC m=+25.649578081"
Jul 17 05:33:28.015170 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:28.014664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:28.015170 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:28.014811    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:28.015170 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:28.014852    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:28.015170 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:28.014964    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:29.015427 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:29.015396    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:29.016054 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:29.015552    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:30.015586 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.015401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:30.016073 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.015410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:30.016073 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:30.015709    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:30.016073 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:30.015738    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:30.177625 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.177601    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:33:30.177972 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.177950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"2a7eae9924e881a230ffe4391f056c5fc8744748b408741db4bf7b64cdef29e7"}
Jul 17 05:33:30.178218 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.178202    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:30.178387 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.178359    2567 scope.go:117] "RemoveContainer" containerID="19d3120c75d9665b54213f527f281f2b9dcb7ae7827668048e42d668f8452ae0"
Jul 17 05:33:30.179886 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.179865    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="7c6f3189d578b75626d6bb01a2593df484a2e66747d0c1e9440247399701b366" exitCode=0
Jul 17 05:33:30.179968 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.179893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"7c6f3189d578b75626d6bb01a2593df484a2e66747d0c1e9440247399701b366"}
Jul 17 05:33:30.197945 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:30.197924    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:31.014848 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.014696    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:31.015020 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:31.014929    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:31.184003 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.183924    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="0bbc7c7ca21c727e450549c8af6746f988c90015262781f937fd3d7c09ce2c31" exitCode=0
Jul 17 05:33:31.184425 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.184018    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"0bbc7c7ca21c727e450549c8af6746f988c90015262781f937fd3d7c09ce2c31"}
Jul 17 05:33:31.187816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.187800    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:33:31.188107 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.188086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" event={"ID":"b117a2a3-f598-445e-832d-90235f9d9f27","Type":"ContainerStarted","Data":"d7f8cc3368904dde106e8a2754016a6898b0d76fbc9a0a1d2ee46d6553a3ed35"}
Jul 17 05:33:31.188346 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.188333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:31.188389 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.188385    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:31.195083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.195060    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nz2h8"]
Jul 17 05:33:31.195187 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.195173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:31.195296 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:31.195275    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:31.200631 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.200612    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzh45"]
Jul 17 05:33:31.200810 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.200721    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:31.200881 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:31.200826    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:31.201462 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.201442    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxgzj"]
Jul 17 05:33:31.201557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.201542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:31.201652 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:31.201631    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:31.206044 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.206027    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:33:31.273434 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:31.273376    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8" podStartSLOduration=10.335024631 podStartE2EDuration="29.273361523s" totalImagesPullingTime="18.938336892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:31.273332988 +0000 UTC m=+29.736517091" watchObservedRunningTime="2026-07-17 05:33:31.273361523 +0000 UTC m=+29.736545626"
Jul 17 05:33:32.192911 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:32.192829    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="8a9014e5e97313f7fe52a3f5d7ecbafe2c17cb7e4107d9640d88edd2e1ebf49f" exitCode=0
Jul 17 05:33:32.193388 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:32.192921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"8a9014e5e97313f7fe52a3f5d7ecbafe2c17cb7e4107d9640d88edd2e1ebf49f"}
Jul 17 05:33:33.015410 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:33.015377    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:33.015568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:33.015376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:33.015568 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:33.015505    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:33.015568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:33.015379    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:33.015568 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:33.015555    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:33.015805 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:33.015630    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:35.014924 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.014892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:35.015593 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.014964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:35.015593 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.015071    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:35.015593 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.015073    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxgzj" podUID="99536fb7-cf9b-478b-b5d6-d8107d887050"
Jul 17 05:33:35.015593 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.015182    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzh45" podUID="17f769d5-02cb-4652-9dea-0876273087c6"
Jul 17 05:33:35.015593 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.015277    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz2h8" podUID="d69bccb2-b724-47b1-b267-dc685e49047a"
Jul 17 05:33:35.711269 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.711240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:35.711483 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.711368    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:35.711483 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.711422    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs podName:17f769d5-02cb-4652-9dea-0876273087c6 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:07.711408084 +0000 UTC m=+66.174592166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs") pod "network-metrics-daemon-hzh45" (UID: "17f769d5-02cb-4652-9dea-0876273087c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:35.811692 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.811637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:35.811858 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.811803    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:35.811908 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.811864    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret podName:d69bccb2-b724-47b1-b267-dc685e49047a nodeName:}" failed. No retries permitted until 2026-07-17 05:34:07.811850194 +0000 UTC m=+66.275034280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret") pod "global-pull-secret-syncer-nz2h8" (UID: "d69bccb2-b724-47b1-b267-dc685e49047a") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:35.912182 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:35.912149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:35.912358 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.912299    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:35.912358 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.912320    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:35.912358 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.912332    2567 projected.go:196] Error preparing data for projected volume kube-api-access-qq7sb for pod openshift-network-diagnostics/network-check-target-kxgzj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:35.912488 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:35.912389    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb podName:99536fb7-cf9b-478b-b5d6-d8107d887050 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:07.912373608 +0000 UTC m=+66.375557700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq7sb" (UniqueName: "kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb") pod "network-check-target-kxgzj" (UID: "99536fb7-cf9b-478b-b5d6-d8107d887050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:36.900400 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.900161    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-187.ec2.internal" event="NodeReady"
Jul 17 05:33:36.900778 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.900445    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 05:33:36.952649 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.952615    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nbvlz"]
Jul 17 05:33:36.967905 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.967882    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tcj27"]
Jul 17 05:33:36.968067 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.968008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:36.970515 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.970475    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 05:33:36.970707 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.970584    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 05:33:36.970971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.970953    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qq4z7\""
Jul 17 05:33:36.983907 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.983844    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nbvlz"]
Jul 17 05:33:36.983992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.983913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:36.983992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.983940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tcj27"]
Jul 17 05:33:36.986501 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.986481    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 05:33:36.986751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.986736    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 05:33:36.986836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.986737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7j7x7\""
Jul 17 05:33:36.986836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:36.986738    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 05:33:37.014826 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.014806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:33:37.014826 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.014821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:33:37.015029 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.015004    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:33:37.017361 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.017338    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 05:33:37.017727 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.017705    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 05:33:37.017930 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.017913    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 05:33:37.017989 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.017973    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8c5l\""
Jul 17 05:33:37.018233 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.018218    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 05:33:37.018311 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.018217    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44td2\""
Jul 17 05:33:37.122439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5rv\" (UniqueName: \"kubernetes.io/projected/68c7e398-971a-4af8-b120-7492f2f91fcb-kube-api-access-6g5rv\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.122602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a843b1-dcd7-4755-8baf-68853ef12ce5-cert\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.122602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c7e398-971a-4af8-b120-7492f2f91fcb-config-volume\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.122602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zk6\" (UniqueName: \"kubernetes.io/projected/e5a843b1-dcd7-4755-8baf-68853ef12ce5-kube-api-access-t9zk6\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.122602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c7e398-971a-4af8-b120-7492f2f91fcb-tmp-dir\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.122602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.122566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.208534 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.208505    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="d8cbb4a8d61b5364178b6bd703a0de38ef5ef04df3aef1f8be75d6f57394081c" exitCode=0
Jul 17 05:33:37.208657 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.208548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"d8cbb4a8d61b5364178b6bd703a0de38ef5ef04df3aef1f8be75d6f57394081c"}
Jul 17 05:33:37.222803 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.222779    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5rv\" (UniqueName: \"kubernetes.io/projected/68c7e398-971a-4af8-b120-7492f2f91fcb-kube-api-access-6g5rv\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.222885 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.222815    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a843b1-dcd7-4755-8baf-68853ef12ce5-cert\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.222885 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.222854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c7e398-971a-4af8-b120-7492f2f91fcb-config-volume\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.222977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.222962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zk6\" (UniqueName: \"kubernetes.io/projected/e5a843b1-dcd7-4755-8baf-68853ef12ce5-kube-api-access-t9zk6\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.223019 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.222997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c7e398-971a-4af8-b120-7492f2f91fcb-tmp-dir\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.223066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.223030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.223145 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:37.223130    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:37.223197 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:37.223188    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:33:37.723172387 +0000 UTC m=+36.186356468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:37.223323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.223306    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c7e398-971a-4af8-b120-7492f2f91fcb-config-volume\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.223388 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.223341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c7e398-971a-4af8-b120-7492f2f91fcb-tmp-dir\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.227049 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.227033    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a843b1-dcd7-4755-8baf-68853ef12ce5-cert\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.235947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.235925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5rv\" (UniqueName: \"kubernetes.io/projected/68c7e398-971a-4af8-b120-7492f2f91fcb-kube-api-access-6g5rv\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.236026 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.235985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zk6\" (UniqueName: \"kubernetes.io/projected/e5a843b1-dcd7-4755-8baf-68853ef12ce5-kube-api-access-t9zk6\") pod \"ingress-canary-tcj27\" (UID: \"e5a843b1-dcd7-4755-8baf-68853ef12ce5\") " pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.292262 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.292238    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tcj27"
Jul 17 05:33:37.492440 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.492372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tcj27"]
Jul 17 05:33:37.496590 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:37.496564    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a843b1_dcd7_4755_8baf_68853ef12ce5.slice/crio-724f4516a640b271efce93821a3fccc6377e5d485b05758c42aee0ff0c89f5fb WatchSource:0}: Error finding container 724f4516a640b271efce93821a3fccc6377e5d485b05758c42aee0ff0c89f5fb: Status 404 returned error can't find the container with id 724f4516a640b271efce93821a3fccc6377e5d485b05758c42aee0ff0c89f5fb
Jul 17 05:33:37.727348 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:37.727317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:37.727508 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:37.727478    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:37.727555 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:37.727544    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:33:38.727527945 +0000 UTC m=+37.190712031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:38.215040 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:38.214993    2567 generic.go:356] "Generic (PLEG): container finished" podID="232ea57f-e48f-4ef6-9ce3-46609b7fc283" containerID="49b33d2e2971ec15b3e66b6f8d3c0c8d69f5b5fdc6832961d55ffb100fa8f598" exitCode=0
Jul 17 05:33:38.215477 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:38.215077    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerDied","Data":"49b33d2e2971ec15b3e66b6f8d3c0c8d69f5b5fdc6832961d55ffb100fa8f598"}
Jul 17 05:33:38.216937 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:38.216321    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tcj27" event={"ID":"e5a843b1-dcd7-4755-8baf-68853ef12ce5","Type":"ContainerStarted","Data":"724f4516a640b271efce93821a3fccc6377e5d485b05758c42aee0ff0c89f5fb"}
Jul 17 05:33:38.737167 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:38.736932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:38.737324 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:38.737082    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:38.737324 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:38.737288    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:33:40.737265865 +0000 UTC m=+39.200449948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:39.222734 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:39.222703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp88x" event={"ID":"232ea57f-e48f-4ef6-9ce3-46609b7fc283","Type":"ContainerStarted","Data":"7dc338721fb340e633bed42dde5f2c9e393447a34341fbed5ea575c08ec6984c"}
Jul 17 05:33:39.245218 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:39.245160    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cp88x" podStartSLOduration=8.752265662 podStartE2EDuration="37.245141025s" totalImagesPullingTime="28.492875363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:39.243727442 +0000 UTC m=+37.706911545" watchObservedRunningTime="2026-07-17 05:33:39.245141025 +0000 UTC m=+37.708325128"
Jul 17 05:33:40.226271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:40.226222    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tcj27" event={"ID":"e5a843b1-dcd7-4755-8baf-68853ef12ce5","Type":"ContainerStarted","Data":"c99712d0de467fa0a8fe0d82fe9d75007228e6e1da4e4e20a6fdc5bf6d2d3f12"}
Jul 17 05:33:40.241753 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:40.241712    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tcj27" podStartSLOduration=1.855741166 podStartE2EDuration="4.241698012s" totalImagesPullingTime="2.385956846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:40.240596418 +0000 UTC m=+38.703780521" watchObservedRunningTime="2026-07-17 05:33:40.241698012 +0000 UTC m=+38.704882107"
Jul 17 05:33:40.754970 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:40.754937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:40.755094 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:40.755058    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:40.755131 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:40.755117    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:33:44.755103547 +0000 UTC m=+43.218287642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:41.652254 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.652218    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"]
Jul 17 05:33:41.690315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.690287    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"]
Jul 17 05:33:41.690452 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.690384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.692862 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.692841    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 05:33:41.692976 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.692842    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:41.693751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.693732    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8xvjg\""
Jul 17 05:33:41.693751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.693742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 05:33:41.693881 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.693744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 05:33:41.762107 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.762076    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:33:41.764394 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.764374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0085adf7-579e-4c12-b97d-71f186b32796-config\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.764504 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.764409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9vfr\" (UniqueName: \"kubernetes.io/projected/0085adf7-579e-4c12-b97d-71f186b32796-kube-api-access-c9vfr\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.764557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.764498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0085adf7-579e-4c12-b97d-71f186b32796-serving-cert\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.786329 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.786306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:33:41.786458 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.786409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.790173 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.790152    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 05:33:41.790288 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.790221    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 05:33:41.790288 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.790234    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxhcm\""
Jul 17 05:33:41.790372 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.790221    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 05:33:41.794526 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.794506    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 05:33:41.853772 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.853747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"]
Jul 17 05:33:41.865502 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0085adf7-579e-4c12-b97d-71f186b32796-config\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.865617 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865617 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9vfr\" (UniqueName: \"kubernetes.io/projected/0085adf7-579e-4c12-b97d-71f186b32796-kube-api-access-c9vfr\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.865784 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865762    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865841 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865891 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865945 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865896    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865998 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.865998 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.865980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdbr\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.866102 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.866012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0085adf7-579e-4c12-b97d-71f186b32796-serving-cert\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.866102 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.866054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.866178 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.866135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0085adf7-579e-4c12-b97d-71f186b32796-config\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.869749 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.869729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0085adf7-579e-4c12-b97d-71f186b32796-serving-cert\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.876246 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.876224    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"]
Jul 17 05:33:41.876317 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.876304    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:41.878873 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.878857    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 05:33:41.878965 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.878862    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 05:33:41.879293 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.879276    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5x7r2\""
Jul 17 05:33:41.889112 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.889095    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9vfr\" (UniqueName: \"kubernetes.io/projected/0085adf7-579e-4c12-b97d-71f186b32796-kube-api-access-c9vfr\") pod \"service-ca-operator-5bcbc94c78-d8486\" (UID: \"0085adf7-579e-4c12-b97d-71f186b32796\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:41.966646 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.966646 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966650    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdbr\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.966876 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.966876 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:41.966772    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 05:33:41.966876 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:41.966795    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57ff6dc86-86x49: secret "image-registry-tls" not found
Jul 17 05:33:41.966876 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:41.966852    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls podName:ab218050-1c36-4db2-902d-fe4f7b94b044 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:42.466834569 +0000 UTC m=+40.930018667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls") pod "image-registry-57ff6dc86-86x49" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044") : secret "image-registry-tls" not found
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.966974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967009    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967076 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967356 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:41.967356 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.967770 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.967747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.968069 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.968046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.969117 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.969098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.969228 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.969212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.978962 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.978942    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdbr\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.988478 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.988458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:41.999451 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:41.999431    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"
Jul 17 05:33:42.068293 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.068096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:42.068824 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.068258    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:42.068824 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.068545    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:42.568523661 +0000 UTC m=+41.031707765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:42.068988 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.068846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:42.069439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.069411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:42.140733 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.140699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486"]
Jul 17 05:33:42.144741 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:42.144715    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0085adf7_579e_4c12_b97d_71f186b32796.slice/crio-df9f3a546d41b3be2bdd827620a9bffede854101cdde5fe4c0d1fdb7efe69ec6 WatchSource:0}: Error finding container df9f3a546d41b3be2bdd827620a9bffede854101cdde5fe4c0d1fdb7efe69ec6: Status 404 returned error can't find the container with id df9f3a546d41b3be2bdd827620a9bffede854101cdde5fe4c0d1fdb7efe69ec6
Jul 17 05:33:42.232545 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.232445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486" event={"ID":"0085adf7-579e-4c12-b97d-71f186b32796","Type":"ContainerStarted","Data":"df9f3a546d41b3be2bdd827620a9bffede854101cdde5fe4c0d1fdb7efe69ec6"}
Jul 17 05:33:42.472920 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.472881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:42.473087 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.473040    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 05:33:42.473087 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.473060    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57ff6dc86-86x49: secret "image-registry-tls" not found
Jul 17 05:33:42.473155 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.473115    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls podName:ab218050-1c36-4db2-902d-fe4f7b94b044 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:43.47310021 +0000 UTC m=+41.936284296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls") pod "image-registry-57ff6dc86-86x49" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044") : secret "image-registry-tls" not found
Jul 17 05:33:42.573641 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:42.573557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:42.573944 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.573668    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:42.573944 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:42.573746    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:43.573733206 +0000 UTC m=+42.036917288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:43.480399 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:43.480362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:43.480879 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:43.480513    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 05:33:43.480879 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:43.480533    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57ff6dc86-86x49: secret "image-registry-tls" not found
Jul 17 05:33:43.480879 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:43.480585    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls podName:ab218050-1c36-4db2-902d-fe4f7b94b044 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:45.480571403 +0000 UTC m=+43.943755485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls") pod "image-registry-57ff6dc86-86x49" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044") : secret "image-registry-tls" not found
Jul 17 05:33:43.581470 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:43.581437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:43.581640 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:43.581617    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:43.581733 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:43.581719    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:45.581696621 +0000 UTC m=+44.044880723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:44.791235 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:44.791205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:44.791598 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:44.791319    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:44.791598 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:44.791373    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:33:52.791359542 +0000 UTC m=+51.254543625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:45.240823 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:45.240782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486" event={"ID":"0085adf7-579e-4c12-b97d-71f186b32796","Type":"ContainerStarted","Data":"859f713f2085b5dd32ed5b67ad3b23460dd0489455e7925cd4f60a767f0f5fe7"}
Jul 17 05:33:45.254785 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:45.254729    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486" podStartSLOduration=1.961722433 podStartE2EDuration="4.254709152s" totalImagesPullingTime="2.292986719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:45.253746463 +0000 UTC m=+43.716930567" watchObservedRunningTime="2026-07-17 05:33:45.254709152 +0000 UTC m=+43.717893254"
Jul 17 05:33:45.500211 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:45.497500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:45.500211 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:45.497832    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 05:33:45.500211 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:45.497859    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57ff6dc86-86x49: secret "image-registry-tls" not found
Jul 17 05:33:45.500211 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:45.497925    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls podName:ab218050-1c36-4db2-902d-fe4f7b94b044 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:49.497900001 +0000 UTC m=+47.961084105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls") pod "image-registry-57ff6dc86-86x49" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044") : secret "image-registry-tls" not found
Jul 17 05:33:45.598740 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:45.598672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:45.598895 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:45.598844    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:45.598937 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:45.598911    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:49.598892894 +0000 UTC m=+48.062076996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:46.479038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.479002    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jdwt7"]
Jul 17 05:33:46.499656 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.499627    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdwt7"]
Jul 17 05:33:46.499834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.499794    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.502311 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.502283    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 05:33:46.502311 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.502286    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 05:33:46.502510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.502286    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 05:33:46.503084 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.503061    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 05:33:46.503176 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.503098    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tk2pd\""
Jul 17 05:33:46.605092 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.605058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.605235 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.605100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.605235 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.605131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927b0b7e-d2d4-4027-bdb1-74a7415faa99-crio-socket\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.605235 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.605156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6wqg\" (UniqueName: \"kubernetes.io/projected/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-api-access-t6wqg\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.605326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.605255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927b0b7e-d2d4-4027-bdb1-74a7415faa99-data-volume\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.700046 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.700004    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"]
Jul 17 05:33:46.706411 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927b0b7e-d2d4-4027-bdb1-74a7415faa99-crio-socket\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6wqg\" (UniqueName: \"kubernetes.io/projected/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-api-access-t6wqg\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927b0b7e-d2d4-4027-bdb1-74a7415faa99-data-volume\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706623 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:46.706532    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:46.706623 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706623 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:46.706611    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:47.206591841 +0000 UTC m=+45.669775946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:46.706758 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:46.706639    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:46.706758 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/927b0b7e-d2d4-4027-bdb1-74a7415faa99-crio-socket\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.706758 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:46.706741    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:47.206726257 +0000 UTC m=+45.669910340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:46.706898 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.706882    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/927b0b7e-d2d4-4027-bdb1-74a7415faa99-data-volume\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.722175 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.722152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6wqg\" (UniqueName: \"kubernetes.io/projected/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-api-access-t6wqg\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:46.727766 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.727744    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"]
Jul 17 05:33:46.727884 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.727855    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"
Jul 17 05:33:46.730306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.730250    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 05:33:46.730306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.730252    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:46.730457 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.730308    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xwcn2\""
Jul 17 05:33:46.807832 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.807796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjzpw\" (UniqueName: \"kubernetes.io/projected/bd6a7b83-9967-451e-9d5f-3fed8120908d-kube-api-access-sjzpw\") pod \"migrator-7cc9c7ffd7-bqlgh\" (UID: \"bd6a7b83-9967-451e-9d5f-3fed8120908d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"
Jul 17 05:33:46.908695 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.908657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjzpw\" (UniqueName: \"kubernetes.io/projected/bd6a7b83-9967-451e-9d5f-3fed8120908d-kube-api-access-sjzpw\") pod \"migrator-7cc9c7ffd7-bqlgh\" (UID: \"bd6a7b83-9967-451e-9d5f-3fed8120908d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"
Jul 17 05:33:46.916149 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:46.916117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjzpw\" (UniqueName: \"kubernetes.io/projected/bd6a7b83-9967-451e-9d5f-3fed8120908d-kube-api-access-sjzpw\") pod \"migrator-7cc9c7ffd7-bqlgh\" (UID: \"bd6a7b83-9967-451e-9d5f-3fed8120908d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"
Jul 17 05:33:47.036283 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:47.036197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"
Jul 17 05:33:47.190332 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:47.190305    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh"]
Jul 17 05:33:47.193483 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:47.193454    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6a7b83_9967_451e_9d5f_3fed8120908d.slice/crio-0d5e557efdcae108e65b8b2d7a82ace4b326cefc01b29ffeb60f162900868d78 WatchSource:0}: Error finding container 0d5e557efdcae108e65b8b2d7a82ace4b326cefc01b29ffeb60f162900868d78: Status 404 returned error can't find the container with id 0d5e557efdcae108e65b8b2d7a82ace4b326cefc01b29ffeb60f162900868d78
Jul 17 05:33:47.211565 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:47.211544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:47.211651 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:47.211584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:47.211734 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:47.211661    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:47.211734 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:47.211704    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:47.211810 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:47.211739    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:48.211719448 +0000 UTC m=+46.674903546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:47.211810 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:47.211754    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:48.211748228 +0000 UTC m=+46.674932310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:47.246502 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:47.246479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh" event={"ID":"bd6a7b83-9967-451e-9d5f-3fed8120908d","Type":"ContainerStarted","Data":"0d5e557efdcae108e65b8b2d7a82ace4b326cefc01b29ffeb60f162900868d78"}
Jul 17 05:33:48.219040 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:48.219006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:48.219435 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:48.219065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:48.219435 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:48.219161    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:48.219435 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:48.219158    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:48.219435 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:48.219224    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:50.219206779 +0000 UTC m=+48.682390882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:48.219435 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:48.219291    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:50.219275774 +0000 UTC m=+48.682459862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:48.658907 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:48.658821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gwjxr_1fd5f8f0-e459-458f-8e96-e4ca0003da1a/dns-node-resolver/0.log"
Jul 17 05:33:49.253653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:49.253621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh" event={"ID":"bd6a7b83-9967-451e-9d5f-3fed8120908d","Type":"ContainerStarted","Data":"d58542cedf14e2c4dd9ded12334469762cdcc1ac2853b785580c244a17bbc2ed"}
Jul 17 05:33:49.254100 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:49.253713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh" event={"ID":"bd6a7b83-9967-451e-9d5f-3fed8120908d","Type":"ContainerStarted","Data":"a1c66c86b3e66703feb2bd5f1c540fcb768cba228bdca9ee175ecc640806f5ab"}
Jul 17 05:33:49.529653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:49.529572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:49.529791 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:49.529751    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 05:33:49.529791 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:49.529765    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57ff6dc86-86x49: secret "image-registry-tls" not found
Jul 17 05:33:49.529865 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:49.529819    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls podName:ab218050-1c36-4db2-902d-fe4f7b94b044 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:57.529804244 +0000 UTC m=+55.992988326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls") pod "image-registry-57ff6dc86-86x49" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044") : secret "image-registry-tls" not found
Jul 17 05:33:49.630522 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:49.630486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:49.630660 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:49.630624    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:49.630740 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:49.630700    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:57.630671036 +0000 UTC m=+56.093855121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:49.658023 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:49.658005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr5l2_ddcade3c-54a5-4606-b23b-f6d523c49bd0/node-ca/0.log"
Jul 17 05:33:50.234106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:50.234072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:50.234296 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:50.234118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:50.234296 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:50.234207    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:50.234296 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:50.234219    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:50.234296 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:50.234277    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:54.234254696 +0000 UTC m=+52.697438800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:50.234439 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:50.234308    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:54.234300015 +0000 UTC m=+52.697484097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:50.460653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:50.460622    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tcj27_e5a843b1-dcd7-4755-8baf-68853ef12ce5/serve-healthcheck-canary/0.log"
Jul 17 05:33:52.854818 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:52.854787    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:33:52.855255 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:52.854928    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:52.855255 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:52.854987    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls podName:68c7e398-971a-4af8-b120-7492f2f91fcb nodeName:}" failed. No retries permitted until 2026-07-17 05:34:08.85497171 +0000 UTC m=+67.318155792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls") pod "dns-default-nbvlz" (UID: "68c7e398-971a-4af8-b120-7492f2f91fcb") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:54.265129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:54.265093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:54.265638 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:54.265158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:33:54.265638 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:54.265238    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:54.265638 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:54.265312    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:02.26529681 +0000 UTC m=+60.728480892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:54.265638 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:54.265347    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:54.265638 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:54.265433    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:02.265412375 +0000 UTC m=+60.728596480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:57.591852 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.591814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:57.594241 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.594222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"image-registry-57ff6dc86-86x49\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") " pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:57.692285 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.692243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:33:57.692437 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:57.692374    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 05:33:57.692437 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:33:57.692426    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert podName:b1ca6cbc-0179-4cb2-ac21-f9557a13a121 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:13.692413763 +0000 UTC m=+72.155597847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-7p99p" (UID: "b1ca6cbc-0179-4cb2-ac21-f9557a13a121") : secret "networking-console-plugin-cert" not found
Jul 17 05:33:57.695240 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.695219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:57.816649 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.816580    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bqlgh" podStartSLOduration=10.162770903 podStartE2EDuration="11.816560649s" totalImagesPullingTime="1.653789746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:49.270838451 +0000 UTC m=+47.734022557" watchObservedRunningTime="2026-07-17 05:33:57.816560649 +0000 UTC m=+56.279744754"
Jul 17 05:33:57.817056 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:57.817039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:33:57.819490 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:33:57.819462    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab218050_1c36_4db2_902d_fe4f7b94b044.slice/crio-9917b46143d48b2730b18f66ec7a18db9a452c2272221e3b6f13808eb0d157fe WatchSource:0}: Error finding container 9917b46143d48b2730b18f66ec7a18db9a452c2272221e3b6f13808eb0d157fe: Status 404 returned error can't find the container with id 9917b46143d48b2730b18f66ec7a18db9a452c2272221e3b6f13808eb0d157fe
Jul 17 05:33:58.278287 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:58.278251    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" event={"ID":"ab218050-1c36-4db2-902d-fe4f7b94b044","Type":"ContainerStarted","Data":"185690537cc54f4f212a4095ba462b0005008c51a5c67cd52ed6076615c69e22"}
Jul 17 05:33:58.278479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:58.278298    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" event={"ID":"ab218050-1c36-4db2-902d-fe4f7b94b044","Type":"ContainerStarted","Data":"9917b46143d48b2730b18f66ec7a18db9a452c2272221e3b6f13808eb0d157fe"}
Jul 17 05:33:58.278479 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:58.278325    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:33:58.296123 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:33:58.296081    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" podStartSLOduration=17.296066827 podStartE2EDuration="17.296066827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:58.295106037 +0000 UTC m=+56.758290141" watchObservedRunningTime="2026-07-17 05:33:58.296066827 +0000 UTC m=+56.759250931"
Jul 17 05:34:02.330445 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:02.330395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:02.330865 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:02.330457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:02.330865 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:34:02.330557    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:34:02.330865 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:34:02.330607    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls podName:927b0b7e-d2d4-4027-bdb1-74a7415faa99 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:18.330595174 +0000 UTC m=+76.793779256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdwt7" (UID: "927b0b7e-d2d4-4027-bdb1-74a7415faa99") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:34:02.330981 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:02.330927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/927b0b7e-d2d4-4027-bdb1-74a7415faa99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:03.206916 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:03.206887    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgtr8"
Jul 17 05:34:07.770425 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.770385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:34:07.773092 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.773070    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 05:34:07.783268 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.783246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f769d5-02cb-4652-9dea-0876273087c6-metrics-certs\") pod \"network-metrics-daemon-hzh45\" (UID: \"17f769d5-02cb-4652-9dea-0876273087c6\") " pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:34:07.871421 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.871386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:34:07.876560 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.876537    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 05:34:07.883920 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.883902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d69bccb2-b724-47b1-b267-dc685e49047a-original-pull-secret\") pod \"global-pull-secret-syncer-nz2h8\" (UID: \"d69bccb2-b724-47b1-b267-dc685e49047a\") " pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:34:07.925183 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.925153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz2h8"
Jul 17 05:34:07.933109 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.933088    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44td2\""
Jul 17 05:34:07.941313 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.941293    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzh45"
Jul 17 05:34:07.972731 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.972707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:34:07.976878 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.976860    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 05:34:07.989001 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.988978    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 05:34:07.997592 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:07.997563    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7sb\" (UniqueName: \"kubernetes.io/projected/99536fb7-cf9b-478b-b5d6-d8107d887050-kube-api-access-qq7sb\") pod \"network-check-target-kxgzj\" (UID: \"99536fb7-cf9b-478b-b5d6-d8107d887050\") " pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:34:08.090231 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.090202    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nz2h8"]
Jul 17 05:34:08.093572 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:08.093538    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69bccb2_b724_47b1_b267_dc685e49047a.slice/crio-accbb772be6d928533887ede40c8e97de6b9af0fb75c8bce9b6adbbf73f87cda WatchSource:0}: Error finding container accbb772be6d928533887ede40c8e97de6b9af0fb75c8bce9b6adbbf73f87cda: Status 404 returned error can't find the container with id accbb772be6d928533887ede40c8e97de6b9af0fb75c8bce9b6adbbf73f87cda
Jul 17 05:34:08.121192 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.121173    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzh45"]
Jul 17 05:34:08.122361 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:08.122339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f769d5_02cb_4652_9dea_0876273087c6.slice/crio-6090772af4ca774c4860e386aed117b1ef8c6201e262b419fdd9afa4e27d3a75 WatchSource:0}: Error finding container 6090772af4ca774c4860e386aed117b1ef8c6201e262b419fdd9afa4e27d3a75: Status 404 returned error can't find the container with id 6090772af4ca774c4860e386aed117b1ef8c6201e262b419fdd9afa4e27d3a75
Jul 17 05:34:08.196840 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.196814    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"]
Jul 17 05:34:08.227460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.227436    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:34:08.227606 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.227479    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"]
Jul 17 05:34:08.227606 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.227562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.231369 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.231348    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 05:34:08.231616 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.231588    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bmqpz\""
Jul 17 05:34:08.231831 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.231812    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 05:34:08.232342 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.232323    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 05:34:08.232424 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.232360    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 05:34:08.237812 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.237794    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8c5l\""
Jul 17 05:34:08.244853 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.244836    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:34:08.275509 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.275479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a28b940-9eab-4b4f-891a-b99c161d1d27-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.275781 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.275750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjws\" (UniqueName: \"kubernetes.io/projected/7a28b940-9eab-4b4f-891a-b99c161d1d27-kube-api-access-bnjws\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.312401 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.312298    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzh45" event={"ID":"17f769d5-02cb-4652-9dea-0876273087c6","Type":"ContainerStarted","Data":"6090772af4ca774c4860e386aed117b1ef8c6201e262b419fdd9afa4e27d3a75"}
Jul 17 05:34:08.315498 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.315294    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5695c76d95-trtbk"]
Jul 17 05:34:08.329258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.329204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nz2h8" event={"ID":"d69bccb2-b724-47b1-b267-dc685e49047a","Type":"ContainerStarted","Data":"accbb772be6d928533887ede40c8e97de6b9af0fb75c8bce9b6adbbf73f87cda"}
Jul 17 05:34:08.329368 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.329306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.341261 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.341230    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5695c76d95-trtbk"]
Jul 17 05:34:08.376857 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.376829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-bound-sa-token\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377014 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.376892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-certificates\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377014 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.376937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-image-registry-private-configuration\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377014 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.376956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qvj2\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-kube-api-access-9qvj2\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377014 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.376973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-tls\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377014 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.377002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjws\" (UniqueName: \"kubernetes.io/projected/7a28b940-9eab-4b4f-891a-b99c161d1d27-kube-api-access-bnjws\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.377196 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.377129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a28b940-9eab-4b4f-891a-b99c161d1d27-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.377196 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.377150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-ca-trust-extracted\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377196 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.377178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-trusted-ca\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.377326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.377209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-installation-pull-secrets\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.379615 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.379590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a28b940-9eab-4b4f-891a-b99c161d1d27-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.386860 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.386837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjws\" (UniqueName: \"kubernetes.io/projected/7a28b940-9eab-4b4f-891a-b99c161d1d27-kube-api-access-bnjws\") pod \"managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc\" (UID: \"7a28b940-9eab-4b4f-891a-b99c161d1d27\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.396370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.396258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxgzj"]
Jul 17 05:34:08.398651 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:08.398623    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99536fb7_cf9b_478b_b5d6_d8107d887050.slice/crio-e432a33ace914be1d24fe4afb0faaaa4609634e0f19c00c32c5bb5d8324bde37 WatchSource:0}: Error finding container e432a33ace914be1d24fe4afb0faaaa4609634e0f19c00c32c5bb5d8324bde37: Status 404 returned error can't find the container with id e432a33ace914be1d24fe4afb0faaaa4609634e0f19c00c32c5bb5d8324bde37
Jul 17 05:34:08.477945 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.477916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-tls\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.477957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-ca-trust-extracted\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.477986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-trusted-ca\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-installation-pull-secrets\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-bound-sa-token\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-certificates\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478375 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-image-registry-private-configuration\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478375 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qvj2\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-kube-api-access-9qvj2\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.478482 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-ca-trust-extracted\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.479019 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.478991    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-certificates\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.479121 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.479054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-trusted-ca\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.480671 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.480648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-image-registry-private-configuration\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.481049 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.481028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-installation-pull-secrets\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.481179 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.481163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-registry-tls\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.487099 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.487076    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-bound-sa-token\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.487995 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.487977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qvj2\" (UniqueName: \"kubernetes.io/projected/b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05-kube-api-access-9qvj2\") pod \"image-registry-5695c76d95-trtbk\" (UID: \"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05\") " pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.548072 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.548038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"
Jul 17 05:34:08.637979 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.637817    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:08.718477 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.718437    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc"]
Jul 17 05:34:08.726037 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:08.725990    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a28b940_9eab_4b4f_891a_b99c161d1d27.slice/crio-3a7e89dae4630a4a8753c8af0667ff5f6eabc1ac8cff0404223e488988c7545b WatchSource:0}: Error finding container 3a7e89dae4630a4a8753c8af0667ff5f6eabc1ac8cff0404223e488988c7545b: Status 404 returned error can't find the container with id 3a7e89dae4630a4a8753c8af0667ff5f6eabc1ac8cff0404223e488988c7545b
Jul 17 05:34:08.830524 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.830450    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5695c76d95-trtbk"]
Jul 17 05:34:08.837178 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:08.837133    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0db64fd_bb7d_4546_b0b2_dfbe86a1fa05.slice/crio-aaee28f2957080cfa9f957a940db5f044133ff6ba7751a9cb79d53fe1a71b21d WatchSource:0}: Error finding container aaee28f2957080cfa9f957a940db5f044133ff6ba7751a9cb79d53fe1a71b21d: Status 404 returned error can't find the container with id aaee28f2957080cfa9f957a940db5f044133ff6ba7751a9cb79d53fe1a71b21d
Jul 17 05:34:08.882699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.882657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:34:08.892636 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:08.892607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c7e398-971a-4af8-b120-7492f2f91fcb-metrics-tls\") pod \"dns-default-nbvlz\" (UID: \"68c7e398-971a-4af8-b120-7492f2f91fcb\") " pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:34:09.079926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.079894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qq4z7\""
Jul 17 05:34:09.088210 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.088140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:34:09.310961 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.309365    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nbvlz"]
Jul 17 05:34:09.313002 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:09.312965    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c7e398_971a_4af8_b120_7492f2f91fcb.slice/crio-48d2d8b46dd74048a22e2644678a9a48754a99dc5869dd9022af0ed9556d0fc7 WatchSource:0}: Error finding container 48d2d8b46dd74048a22e2644678a9a48754a99dc5869dd9022af0ed9556d0fc7: Status 404 returned error can't find the container with id 48d2d8b46dd74048a22e2644678a9a48754a99dc5869dd9022af0ed9556d0fc7
Jul 17 05:34:09.322623 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.322563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc" event={"ID":"7a28b940-9eab-4b4f-891a-b99c161d1d27","Type":"ContainerStarted","Data":"3a7e89dae4630a4a8753c8af0667ff5f6eabc1ac8cff0404223e488988c7545b"}
Jul 17 05:34:09.324623 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.324568    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxgzj" event={"ID":"99536fb7-cf9b-478b-b5d6-d8107d887050","Type":"ContainerStarted","Data":"e432a33ace914be1d24fe4afb0faaaa4609634e0f19c00c32c5bb5d8324bde37"}
Jul 17 05:34:09.326506 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.326444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzh45" event={"ID":"17f769d5-02cb-4652-9dea-0876273087c6","Type":"ContainerStarted","Data":"93efb12fca1151fa5fcc8fdc4f580b4cba1dbfb58ec5a92d444c80dff18904ea"}
Jul 17 05:34:09.331216 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.330323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbvlz" event={"ID":"68c7e398-971a-4af8-b120-7492f2f91fcb","Type":"ContainerStarted","Data":"48d2d8b46dd74048a22e2644678a9a48754a99dc5869dd9022af0ed9556d0fc7"}
Jul 17 05:34:09.334918 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.334161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c76d95-trtbk" event={"ID":"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05","Type":"ContainerStarted","Data":"1fc8f787a11868a8d8909f1107cebc934f76f3140dd4369de85c2ed22cb44045"}
Jul 17 05:34:09.334918 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.334192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c76d95-trtbk" event={"ID":"b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05","Type":"ContainerStarted","Data":"aaee28f2957080cfa9f957a940db5f044133ff6ba7751a9cb79d53fe1a71b21d"}
Jul 17 05:34:09.334918 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.334876    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:09.357648 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:09.356988    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5695c76d95-trtbk" podStartSLOduration=1.356969455 podStartE2EDuration="1.356969455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:09.355057917 +0000 UTC m=+67.818242022" watchObservedRunningTime="2026-07-17 05:34:09.356969455 +0000 UTC m=+67.820153559"
Jul 17 05:34:10.342723 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:10.342635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzh45" event={"ID":"17f769d5-02cb-4652-9dea-0876273087c6","Type":"ContainerStarted","Data":"9e171ffc82c7aefe32995e7f506de7d6f1d4a8196930b94228fb3e57bec1e368"}
Jul 17 05:34:13.728423 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:13.728377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:34:13.731611 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:13.731583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1ca6cbc-0179-4cb2-ac21-f9557a13a121-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-7p99p\" (UID: \"b1ca6cbc-0179-4cb2-ac21-f9557a13a121\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:34:13.987385 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:13.987306    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5x7r2\""
Jul 17 05:34:13.995774 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:13.995751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"
Jul 17 05:34:15.235460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.233453    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hzh45" podStartSLOduration=72.176458378 podStartE2EDuration="1m13.23343584s" totalImagesPullingTime="1.056977462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:10.362882015 +0000 UTC m=+68.826066121" watchObservedRunningTime="2026-07-17 05:34:15.23343584 +0000 UTC m=+73.696619944"
Jul 17 05:34:15.235460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.234212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p"]
Jul 17 05:34:15.242611 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:15.242581    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ca6cbc_0179_4cb2_ac21_f9557a13a121.slice/crio-c938080e16d2abb7cedbcc550fbb668bba5a98d2f5c89fbd8ad91ba0905dd249 WatchSource:0}: Error finding container c938080e16d2abb7cedbcc550fbb668bba5a98d2f5c89fbd8ad91ba0905dd249: Status 404 returned error can't find the container with id c938080e16d2abb7cedbcc550fbb668bba5a98d2f5c89fbd8ad91ba0905dd249
Jul 17 05:34:15.362828 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.362798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nz2h8" event={"ID":"d69bccb2-b724-47b1-b267-dc685e49047a","Type":"ContainerStarted","Data":"bb3acbadaa4fefa6d4f06208af606e1f49dbaffdb9a32a21822df95c0dc50d82"}
Jul 17 05:34:15.364544 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.364480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc" event={"ID":"7a28b940-9eab-4b4f-891a-b99c161d1d27","Type":"ContainerStarted","Data":"599ba93cb4eed4f4c6693b48b550470fe7dc932b96fdedc209f70f68307bc3da"}
Jul 17 05:34:15.366242 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.366197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxgzj" event={"ID":"99536fb7-cf9b-478b-b5d6-d8107d887050","Type":"ContainerStarted","Data":"97b97d5369515b2aa6f342f793f0eaa319dbf51716f3d7a942cee0b27145a993"}
Jul 17 05:34:15.366331 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.366277    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:34:15.368510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.368491    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbvlz" event={"ID":"68c7e398-971a-4af8-b120-7492f2f91fcb","Type":"ContainerStarted","Data":"f8c35e0fc855b623f7a8b880f7a64f90c10ccd5869f78570fc41d82c60817157"}
Jul 17 05:34:15.369783 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.369766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p" event={"ID":"b1ca6cbc-0179-4cb2-ac21-f9557a13a121","Type":"ContainerStarted","Data":"c938080e16d2abb7cedbcc550fbb668bba5a98d2f5c89fbd8ad91ba0905dd249"}
Jul 17 05:34:15.378894 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.378840    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nz2h8" podStartSLOduration=66.386451932 podStartE2EDuration="1m13.378825794s" totalImagesPullingTime="6.992373862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:15.377534582 +0000 UTC m=+73.840718698" watchObservedRunningTime="2026-07-17 05:34:15.378825794 +0000 UTC m=+73.842009897"
Jul 17 05:34:15.412834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.412786    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kxgzj" podStartSLOduration=66.73499653 podStartE2EDuration="1m13.412770152s" totalImagesPullingTime="6.677773622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:15.393656378 +0000 UTC m=+73.856840483" watchObservedRunningTime="2026-07-17 05:34:15.412770152 +0000 UTC m=+73.875954259"
Jul 17 05:34:15.413042 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:15.413023    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c88fb74fb-hzdrc" podStartSLOduration=1.064267654 podStartE2EDuration="7.413017447s" totalImagesPullingTime="6.348749793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:15.411672004 +0000 UTC m=+73.874856104" watchObservedRunningTime="2026-07-17 05:34:15.413017447 +0000 UTC m=+73.876201550"
Jul 17 05:34:16.374726 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:16.374670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbvlz" event={"ID":"68c7e398-971a-4af8-b120-7492f2f91fcb","Type":"ContainerStarted","Data":"d7514b4330c89661f1f346a7a008232638186ef07342ae0c7eb9ca309d458ddc"}
Jul 17 05:34:16.375144 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:16.374808    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:34:16.376172 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:16.376146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p" event={"ID":"b1ca6cbc-0179-4cb2-ac21-f9557a13a121","Type":"ContainerStarted","Data":"20692dd82903749728886ff586920a1c75f281129b7cb5af360bbb9a544fffad"}
Jul 17 05:34:16.394022 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:16.393979    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nbvlz" podStartSLOduration=34.631512421 podStartE2EDuration="40.393965929s" totalImagesPullingTime="5.762453508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:16.392560264 +0000 UTC m=+74.855744368" watchObservedRunningTime="2026-07-17 05:34:16.393965929 +0000 UTC m=+74.857150080"
Jul 17 05:34:16.407044 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:16.406917    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-7p99p" podStartSLOduration=34.434700442 podStartE2EDuration="35.40690141s" totalImagesPullingTime="972.200968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:16.406874695 +0000 UTC m=+74.870058799" watchObservedRunningTime="2026-07-17 05:34:16.40690141 +0000 UTC m=+74.870085514"
Jul 17 05:34:18.232899 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.232856    2567 patch_prober.go:28] interesting pod/image-registry-57ff6dc86-86x49 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 17 05:34:18.233259 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.232927    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 05:34:18.369968 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.369929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:18.372295 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.372268    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/927b0b7e-d2d4-4027-bdb1-74a7415faa99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdwt7\" (UID: \"927b0b7e-d2d4-4027-bdb1-74a7415faa99\") " pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:18.610948 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.610859    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tk2pd\""
Jul 17 05:34:18.618854 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.618829    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdwt7"
Jul 17 05:34:18.739390 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:18.739346    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdwt7"]
Jul 17 05:34:18.743065 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:18.743028    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927b0b7e_d2d4_4027_bdb1_74a7415faa99.slice/crio-cfc183f8ace2578c62b15727128bc3320066b7db9d61baa72363afdab3a7d15b WatchSource:0}: Error finding container cfc183f8ace2578c62b15727128bc3320066b7db9d61baa72363afdab3a7d15b: Status 404 returned error can't find the container with id cfc183f8ace2578c62b15727128bc3320066b7db9d61baa72363afdab3a7d15b
Jul 17 05:34:19.391825 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:19.391738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdwt7" event={"ID":"927b0b7e-d2d4-4027-bdb1-74a7415faa99","Type":"ContainerStarted","Data":"cfc183f8ace2578c62b15727128bc3320066b7db9d61baa72363afdab3a7d15b"}
Jul 17 05:34:24.413549 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:24.413478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdwt7" event={"ID":"927b0b7e-d2d4-4027-bdb1-74a7415faa99","Type":"ContainerStarted","Data":"e081bdca396da5d848c27a7efa0e876269d266f5de36605884ff4a031e6b8c6c"}
Jul 17 05:34:26.382026 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:26.381996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nbvlz"
Jul 17 05:34:27.426536 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:27.426439    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdwt7" event={"ID":"927b0b7e-d2d4-4027-bdb1-74a7415faa99","Type":"ContainerStarted","Data":"244d2461047a1541bf638e89f761676e3c0d15c0accd1fb93cb16906f20c7c62"}
Jul 17 05:34:28.233299 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.233268    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:34:28.245413 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.245383    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-z79vl"]
Jul 17 05:34:28.248390 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.248365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:28.251495 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.251467    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d967r\""
Jul 17 05:34:28.255611 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.251809    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 05:34:28.255611 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.252529    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 05:34:28.259973 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.259949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z79vl"]
Jul 17 05:34:28.351985 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.351947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twx2k\" (UniqueName: \"kubernetes.io/projected/87d3dc7e-f5db-4563-8c24-47fa5b851b92-kube-api-access-twx2k\") pod \"downloads-5bc67dcd46-z79vl\" (UID: \"87d3dc7e-f5db-4563-8c24-47fa5b851b92\") " pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:28.452924 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.452888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twx2k\" (UniqueName: \"kubernetes.io/projected/87d3dc7e-f5db-4563-8c24-47fa5b851b92-kube-api-access-twx2k\") pod \"downloads-5bc67dcd46-z79vl\" (UID: \"87d3dc7e-f5db-4563-8c24-47fa5b851b92\") " pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:28.467696 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.467648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twx2k\" (UniqueName: \"kubernetes.io/projected/87d3dc7e-f5db-4563-8c24-47fa5b851b92-kube-api-access-twx2k\") pod \"downloads-5bc67dcd46-z79vl\" (UID: \"87d3dc7e-f5db-4563-8c24-47fa5b851b92\") " pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:28.563095 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.563013    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:28.664713 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.663060    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"]
Jul 17 05:34:28.668167 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.668141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.671542 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.671216    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 05:34:28.671542 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.671423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-66t4x\""
Jul 17 05:34:28.672146 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.672118    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 05:34:28.672908 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.672880    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 05:34:28.673109 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.673091    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 05:34:28.673330 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.673313    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 05:34:28.681564 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.680748    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"]
Jul 17 05:34:28.690913 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.690889    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-trbqt"]
Jul 17 05:34:28.694674 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.694642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.697113 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.696932    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 05:34:28.697113 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.697042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 05:34:28.697439 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.697423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vr8h8\""
Jul 17 05:34:28.697553 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.697480    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 05:34:28.727154 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.727127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z79vl"]
Jul 17 05:34:28.730901 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:28.730874    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d3dc7e_f5db_4563_8c24_47fa5b851b92.slice/crio-259231e76546d42d65639e006b6fc4cb3d101535846cd038cdb991a8d23b83c8 WatchSource:0}: Error finding container 259231e76546d42d65639e006b6fc4cb3d101535846cd038cdb991a8d23b83c8: Status 404 returned error can't find the container with id 259231e76546d42d65639e006b6fc4cb3d101535846cd038cdb991a8d23b83c8
Jul 17 05:34:28.856709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-metrics-client-ca\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-textfile\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-sys\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856785    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-root\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856870    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-wtmp\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.856928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcq5\" (UniqueName: \"kubernetes.io/projected/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-kube-api-access-jdcq5\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.857244 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24fn\" (UniqueName: \"kubernetes.io/projected/0f01abfb-f359-4d94-af36-34704ba9836e-kube-api-access-f24fn\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.857244 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.856964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-tls\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.857244 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.857008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.857244 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.857032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f01abfb-f359-4d94-af36-34704ba9836e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.957647 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957647 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f01abfb-f359-4d94-af36-34704ba9836e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-metrics-client-ca\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957745    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-textfile\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-sys\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-root\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.957900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-sys\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-wtmp\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.957998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcq5\" (UniqueName: \"kubernetes.io/projected/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-kube-api-access-jdcq5\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f24fn\" (UniqueName: \"kubernetes.io/projected/0f01abfb-f359-4d94-af36-34704ba9836e-kube-api-access-f24fn\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-root\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958188 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-tls\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958571 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958571 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958432    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-wtmp\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.958571 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f01abfb-f359-4d94-af36-34704ba9836e-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.958757 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.958626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-textfile\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.959468 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.959264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-metrics-client-ca\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.961066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.961040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.961226 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.961109    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.961741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.961673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f01abfb-f359-4d94-af36-34704ba9836e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.964217 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.964172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-node-exporter-tls\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.968139 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.968112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24fn\" (UniqueName: \"kubernetes.io/projected/0f01abfb-f359-4d94-af36-34704ba9836e-kube-api-access-f24fn\") pod \"openshift-state-metrics-79f6958cdf-l2z85\" (UID: \"0f01abfb-f359-4d94-af36-34704ba9836e\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:28.973291 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.973261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcq5\" (UniqueName: \"kubernetes.io/projected/235ab4c9-7d5f-43a1-bd57-336cce7f6bc4-kube-api-access-jdcq5\") pod \"node-exporter-trbqt\" (UID: \"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4\") " pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:28.982992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:28.982964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"
Jul 17 05:34:29.006358 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.006332    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-trbqt"
Jul 17 05:34:29.435377 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.435344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z79vl" event={"ID":"87d3dc7e-f5db-4563-8c24-47fa5b851b92","Type":"ContainerStarted","Data":"259231e76546d42d65639e006b6fc4cb3d101535846cd038cdb991a8d23b83c8"}
Jul 17 05:34:29.743878 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.743849    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:34:29.758267 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.758234    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.760734 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760708    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 05:34:29.760892 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760743    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 05:34:29.760892 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 05:34:29.760892 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760833    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 05:34:29.760892 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 05:34:29.760892 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760881    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l5lj7\""
Jul 17 05:34:29.761239 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.760993    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 05:34:29.761239 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.761088    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 05:34:29.761239 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.761177    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 05:34:29.761829 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.761811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 05:34:29.768940 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.768915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:34:29.866446 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866638 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69x2\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866638 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866638 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866638 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866809    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.866901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.867151 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.866978    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.867151 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.867004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.867151 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.867023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968086 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968086 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69x2\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:34:29.968221    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:34:29.968282    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls podName:601d3f42-8956-4ccd-a4bc-54060817ae69 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:30.468261163 +0000 UTC m=+88.931445263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69") : secret "alertmanager-main-tls" not found
Jul 17 05:34:29.968339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.968748 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.968493    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.970282 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.969988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.970499 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.970457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.972346    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.972416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.972950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.973164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.973179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973393 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.973311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.973603 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.973578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.974166 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.974145    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:29.979087 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:29.979064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69x2\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:30.472880 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.472842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:30.475795 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.475764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:30.670109 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.670072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:34:30.692593 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:30.692388    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235ab4c9_7d5f_43a1_bd57_336cce7f6bc4.slice/crio-76e5bd8775410e5db921f4d3463ed1128f78af0e6b135731f3ee34f78cad0afe WatchSource:0}: Error finding container 76e5bd8775410e5db921f4d3463ed1128f78af0e6b135731f3ee34f78cad0afe: Status 404 returned error can't find the container with id 76e5bd8775410e5db921f4d3463ed1128f78af0e6b135731f3ee34f78cad0afe
Jul 17 05:34:30.735084 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.735054    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"]
Jul 17 05:34:30.743257 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.742998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.747424 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.745947    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 05:34:30.747424 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.746186    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 05:34:30.747823 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.747797    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"]
Jul 17 05:34:30.748144 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.747973    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 05:34:30.748144 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.747999    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 05:34:30.748297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.748179    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7znwp\""
Jul 17 05:34:30.748297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.748239    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 05:34:30.748510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.748456    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2rfpg2pu0md7s\""
Jul 17 05:34:30.828488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.828461    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85"]
Jul 17 05:34:30.831453 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:30.831428    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f01abfb_f359_4d94_af36_34704ba9836e.slice/crio-b84bc0dad2d57ac9b27d4fb8ef4e70d84a5e97f9f696c710530ee7f5f996ede5 WatchSource:0}: Error finding container b84bc0dad2d57ac9b27d4fb8ef4e70d84a5e97f9f696c710530ee7f5f996ede5: Status 404 returned error can't find the container with id b84bc0dad2d57ac9b27d4fb8ef4e70d84a5e97f9f696c710530ee7f5f996ede5
Jul 17 05:34:30.851753 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.851730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:34:30.858889 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:30.858864    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601d3f42_8956_4ccd_a4bc_54060817ae69.slice/crio-bebfca81beed803ea05a4b50614c00d320896ca78e82dea3d1ee0ab6b13f0604 WatchSource:0}: Error finding container bebfca81beed803ea05a4b50614c00d320896ca78e82dea3d1ee0ab6b13f0604: Status 404 returned error can't find the container with id bebfca81beed803ea05a4b50614c00d320896ca78e82dea3d1ee0ab6b13f0604
Jul 17 05:34:30.877909 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.877867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.877921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.877960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdszw\" (UniqueName: \"kubernetes.io/projected/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-kube-api-access-zdszw\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.878012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878197 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.878060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878197 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.878099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878197 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.878130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-metrics-client-ca\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.878197 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.878160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-grpc-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978788 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978788 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978765    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdszw\" (UniqueName: \"kubernetes.io/projected/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-kube-api-access-zdszw\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.978971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978947    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.979258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.978980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-metrics-client-ca\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.979258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.979009    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-grpc-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.979786 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.979740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-metrics-client-ca\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.982376 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.981888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.982376 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.982337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.982376 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.982347    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.982985 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.982963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-grpc-tls\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.983078 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.982967    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.983645 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.983625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:30.987189 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:30.987156    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdszw\" (UniqueName: \"kubernetes.io/projected/d5e34db1-9cb6-44f0-a8db-a87ddb6eea79-kube-api-access-zdszw\") pod \"thanos-querier-7f64c9c54b-4wm56\" (UID: \"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79\") " pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:31.058697 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.058654    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:31.233719 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.233598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"]
Jul 17 05:34:31.236956 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:31.236930    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e34db1_9cb6_44f0_a8db_a87ddb6eea79.slice/crio-19c3818c03a1efc4929ae0eb7e4275ad58f3df71f45647013f2a16180bf52faf WatchSource:0}: Error finding container 19c3818c03a1efc4929ae0eb7e4275ad58f3df71f45647013f2a16180bf52faf: Status 404 returned error can't find the container with id 19c3818c03a1efc4929ae0eb7e4275ad58f3df71f45647013f2a16180bf52faf
Jul 17 05:34:31.354023 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.353986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5695c76d95-trtbk"
Jul 17 05:34:31.447075 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.447030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdwt7" event={"ID":"927b0b7e-d2d4-4027-bdb1-74a7415faa99","Type":"ContainerStarted","Data":"0f0d0ecd6cedb27fa9e1594653fcb0954b463bc49de79f4245e26527108be19a"}
Jul 17 05:34:31.449490 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.449452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"19c3818c03a1efc4929ae0eb7e4275ad58f3df71f45647013f2a16180bf52faf"}
Jul 17 05:34:31.451786 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.451762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-trbqt" event={"ID":"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4","Type":"ContainerStarted","Data":"76e5bd8775410e5db921f4d3463ed1128f78af0e6b135731f3ee34f78cad0afe"}
Jul 17 05:34:31.454002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.453976    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85" event={"ID":"0f01abfb-f359-4d94-af36-34704ba9836e","Type":"ContainerStarted","Data":"b59a7e4a7a492e82fee9ddea113e46dc5017d600319c0bcfcea13bc45a9c46d5"}
Jul 17 05:34:31.454091 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.454028    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85" event={"ID":"0f01abfb-f359-4d94-af36-34704ba9836e","Type":"ContainerStarted","Data":"6c8b3a3e0fcf55ef24f5948d4d4ede494f4f4b694425afb54642d44657866ba3"}
Jul 17 05:34:31.454091 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.454054    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85" event={"ID":"0f01abfb-f359-4d94-af36-34704ba9836e","Type":"ContainerStarted","Data":"b84bc0dad2d57ac9b27d4fb8ef4e70d84a5e97f9f696c710530ee7f5f996ede5"}
Jul 17 05:34:31.455538 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.455515    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"bebfca81beed803ea05a4b50614c00d320896ca78e82dea3d1ee0ab6b13f0604"}
Jul 17 05:34:31.471088 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:31.470262    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jdwt7" podStartSLOduration=33.580617052 podStartE2EDuration="45.470242074s" totalImagesPullingTime="11.889625022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:31.468952972 +0000 UTC m=+89.932137076" watchObservedRunningTime="2026-07-17 05:34:31.470242074 +0000 UTC m=+89.933426181"
Jul 17 05:34:32.462446 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:32.462408    2567 generic.go:356] "Generic (PLEG): container finished" podID="235ab4c9-7d5f-43a1-bd57-336cce7f6bc4" containerID="3cf1215e858b76085ff7305dd848905da1da1e9951e57903b45fad8a57b9c5d7" exitCode=0
Jul 17 05:34:32.462917 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:32.462603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-trbqt" event={"ID":"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4","Type":"ContainerDied","Data":"3cf1215e858b76085ff7305dd848905da1da1e9951e57903b45fad8a57b9c5d7"}
Jul 17 05:34:33.050245 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.050205    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"]
Jul 17 05:34:33.054673 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.054648    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.057807 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.057669    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 05:34:33.057807 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.057737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 05:34:33.057984 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.057814    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 05:34:33.058075 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.058000    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4a9jnklc8d18j\""
Jul 17 05:34:33.058226 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.058204    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 05:34:33.058339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.058311    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-99hqd\""
Jul 17 05:34:33.064308 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.064165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"]
Jul 17 05:34:33.100855 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.100819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-client-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.100855 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.100928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.100855 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.100999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-client-certs\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.101246 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.101030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6xk4\" (UniqueName: \"kubernetes.io/projected/18adf439-a774-4c72-9c27-19b0a0f6ce15-kube-api-access-f6xk4\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.101246 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.101110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-metrics-server-audit-profiles\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.101246 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.101161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-tls\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.101246 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.101184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18adf439-a774-4c72-9c27-19b0a0f6ce15-audit-log\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201625 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-client-certs\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6xk4\" (UniqueName: \"kubernetes.io/projected/18adf439-a774-4c72-9c27-19b0a0f6ce15-kube-api-access-f6xk4\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-metrics-server-audit-profiles\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-tls\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18adf439-a774-4c72-9c27-19b0a0f6ce15-audit-log\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.201816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-client-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.202064 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.201872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.202729 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.202702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.202843 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.202753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18adf439-a774-4c72-9c27-19b0a0f6ce15-audit-log\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.203713 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.203668    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18adf439-a774-4c72-9c27-19b0a0f6ce15-metrics-server-audit-profiles\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.205225 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.205183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-tls\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.205670 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.205641    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-secret-metrics-server-client-certs\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.206996 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.206974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18adf439-a774-4c72-9c27-19b0a0f6ce15-client-ca-bundle\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.214653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.214607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6xk4\" (UniqueName: \"kubernetes.io/projected/18adf439-a774-4c72-9c27-19b0a0f6ce15-kube-api-access-f6xk4\") pod \"metrics-server-6f8bbccccc-fd6n6\" (UID: \"18adf439-a774-4c72-9c27-19b0a0f6ce15\") " pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.248758 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.248717    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerName="registry" containerID="cri-o://185690537cc54f4f212a4095ba462b0005008c51a5c67cd52ed6076615c69e22" gracePeriod=30
Jul 17 05:34:33.367266 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.367183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:33.471561 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.471530    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-trbqt" event={"ID":"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4","Type":"ContainerStarted","Data":"aeccf155bedabb6b21ffb4ca950e18ce69a7cd608b4b4001720db27bc84b2fe3"}
Jul 17 05:34:33.471947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.471598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-trbqt" event={"ID":"235ab4c9-7d5f-43a1-bd57-336cce7f6bc4","Type":"ContainerStarted","Data":"c564784be19c8769ea971be865de45fc082a3b4d6a61dae0b6281c3b6d4bd867"}
Jul 17 05:34:33.476942 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.476872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85" event={"ID":"0f01abfb-f359-4d94-af36-34704ba9836e","Type":"ContainerStarted","Data":"a4a8a93123f45d097cdf64835de8d92ed901e720a451accc69f4d17e37feafe1"}
Jul 17 05:34:33.478535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.478407    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerID="185690537cc54f4f212a4095ba462b0005008c51a5c67cd52ed6076615c69e22" exitCode=0
Jul 17 05:34:33.478535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.478482    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" event={"ID":"ab218050-1c36-4db2-902d-fe4f7b94b044","Type":"ContainerDied","Data":"185690537cc54f4f212a4095ba462b0005008c51a5c67cd52ed6076615c69e22"}
Jul 17 05:34:33.492502 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.492470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"}
Jul 17 05:34:33.492898 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.492442    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f" exitCode=0
Jul 17 05:34:33.515156 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.515100    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-trbqt" podStartSLOduration=4.455956563 podStartE2EDuration="5.515080679s" totalImagesPullingTime="964.832032ms" totalInitContainerRuntime="94.292084ms" isStatefulPod=true podCreationTimestamp="2026-07-17 05:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:33.491767973 +0000 UTC m=+91.954952080" watchObservedRunningTime="2026-07-17 05:34:33.515080679 +0000 UTC m=+91.978264784"
Jul 17 05:34:33.515917 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.515878    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-l2z85" podStartSLOduration=3.963025256 podStartE2EDuration="5.515861001s" totalImagesPullingTime="1.552835745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:33.513234469 +0000 UTC m=+91.976418600" watchObservedRunningTime="2026-07-17 05:34:33.515861001 +0000 UTC m=+91.979045106"
Jul 17 05:34:33.538766 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.538586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"]
Jul 17 05:34:33.580799 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.580737    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:34:33.607773 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607750    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.607895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607826    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.607895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607860    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.607895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.608051 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607928    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.608051 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607961    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.608051 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.607985    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.608051 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.608038    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxdbr\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr\") pod \"ab218050-1c36-4db2-902d-fe4f7b94b044\" (UID: \"ab218050-1c36-4db2-902d-fe4f7b94b044\") "
Jul 17 05:34:33.608774 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.608451    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:34:33.611325 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.611278    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr" (OuterVolumeSpecName: "kube-api-access-qxdbr") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "kube-api-access-qxdbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:34:33.612090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.612046    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:34:33.612400 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.612370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:34:33.613649 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.613613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:34:33.615287 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.615246    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:34:33.615810 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.615773    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:34:33.622548 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.622524    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ab218050-1c36-4db2-902d-fe4f7b94b044" (UID: "ab218050-1c36-4db2-902d-fe4f7b94b044"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709261    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab218050-1c36-4db2-902d-fe4f7b94b044-ca-trust-extracted\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709294    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-trusted-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709309    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-certificates\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709325    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-image-registry-private-configuration\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709340    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab218050-1c36-4db2-902d-fe4f7b94b044-installation-pull-secrets\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709356    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-registry-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709370    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxdbr\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-kube-api-access-qxdbr\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.709407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.709383    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab218050-1c36-4db2-902d-fe4f7b94b044-bound-sa-token\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:34:33.915055 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.914976    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-574fc6996d-vgxzn"]
Jul 17 05:34:33.915374 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.915359    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerName="registry"
Jul 17 05:34:33.915442 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.915375    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerName="registry"
Jul 17 05:34:33.915492 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.915441    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" containerName="registry"
Jul 17 05:34:33.918737 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.918717    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:33.921669 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921435    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 05:34:33.921669 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 05:34:33.921669 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921528    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 05:34:33.921669 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921470    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 05:34:33.921940 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921846    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g2n9q\""
Jul 17 05:34:33.921940 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.921922    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 05:34:33.928341 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.928287    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 05:34:33.936271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:33.936209    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-574fc6996d-vgxzn"]
Jul 17 05:34:34.011930 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.011894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.011940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-federate-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.011969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-metrics-client-ca\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.012005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-serving-certs-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.012052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.012079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7r4\" (UniqueName: \"kubernetes.io/projected/b2ef69e6-903c-433f-b098-af26d603545c-kube-api-access-hl7r4\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.012123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.012420 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.012197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113309 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113273    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-federate-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-metrics-client-ca\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-serving-certs-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113742 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113742 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7r4\" (UniqueName: \"kubernetes.io/projected/b2ef69e6-903c-433f-b098-af26d603545c-kube-api-access-hl7r4\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113742 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.113742 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.113725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.114412 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.114383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-serving-certs-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.114995 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.114953    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-metrics-client-ca\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.115103 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.115066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.117575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.117535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-telemeter-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.118967 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.118927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-federate-client-tls\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.119576 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.119535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.119976 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.119931    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2ef69e6-903c-433f-b098-af26d603545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.122845 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.122822    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7r4\" (UniqueName: \"kubernetes.io/projected/b2ef69e6-903c-433f-b098-af26d603545c-kube-api-access-hl7r4\") pod \"telemeter-client-574fc6996d-vgxzn\" (UID: \"b2ef69e6-903c-433f-b098-af26d603545c\") " pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.231433 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.231397    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn"
Jul 17 05:34:34.422851 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.422793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-574fc6996d-vgxzn"]
Jul 17 05:34:34.505305 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.505221    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57ff6dc86-86x49" event={"ID":"ab218050-1c36-4db2-902d-fe4f7b94b044","Type":"ContainerDied","Data":"9917b46143d48b2730b18f66ec7a18db9a452c2272221e3b6f13808eb0d157fe"}
Jul 17 05:34:34.505305 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.505283    2567 scope.go:117] "RemoveContainer" containerID="185690537cc54f4f212a4095ba462b0005008c51a5c67cd52ed6076615c69e22"
Jul 17 05:34:34.505805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.505460    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57ff6dc86-86x49"
Jul 17 05:34:34.517969 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.517934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"e42346fe0c42e431c3299cf3f55252da76ec80cada562be15c00a0a897faa929"}
Jul 17 05:34:34.518131 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.518091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"64cae8e29a6143a6b6c07166c53b92f19fb2d44d950a3f0616a8a3d6acaaf373"}
Jul 17 05:34:34.518208 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.518165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"f5f1d15d69e7f1491b961b3af0cf9d907540e35bf198918dafca9bb6f68973a5"}
Jul 17 05:34:34.521067 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.521040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6" event={"ID":"18adf439-a774-4c72-9c27-19b0a0f6ce15","Type":"ContainerStarted","Data":"effa38b88beba6145f4ffd3863ec2811c812074f622b40a25a88ad022f53c50a"}
Jul 17 05:34:34.549704 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.549635    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:34:34.555238 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:34.555200    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57ff6dc86-86x49"]
Jul 17 05:34:34.577336 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:34:34.577294    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ef69e6_903c_433f_b098_af26d603545c.slice/crio-a2fa94bc177aa0233c9499371ff2621cce95f809d149ed27aab9590cfac332c2 WatchSource:0}: Error finding container a2fa94bc177aa0233c9499371ff2621cce95f809d149ed27aab9590cfac332c2: Status 404 returned error can't find the container with id a2fa94bc177aa0233c9499371ff2621cce95f809d149ed27aab9590cfac332c2
Jul 17 05:34:35.528552 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:35.528508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"471b5eb760d1e1703806c02f6c56bb482d229839280baa46829e29e89f1858c5"}
Jul 17 05:34:35.529900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:35.529823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn" event={"ID":"b2ef69e6-903c-433f-b098-af26d603545c","Type":"ContainerStarted","Data":"a2fa94bc177aa0233c9499371ff2621cce95f809d149ed27aab9590cfac332c2"}
Jul 17 05:34:36.023881 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.023849    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab218050-1c36-4db2-902d-fe4f7b94b044" path="/var/lib/kubelet/pods/ab218050-1c36-4db2-902d-fe4f7b94b044/volumes"
Jul 17 05:34:36.542511 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.542457    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"e3eab871bd872d5a6e68526695d4d0c9cccce7297ee35afc03ddcac8d656cbfb"}
Jul 17 05:34:36.542976 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.542555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" event={"ID":"d5e34db1-9cb6-44f0-a8db-a87ddb6eea79","Type":"ContainerStarted","Data":"d2892d218d16a3abe5e090c0c203b922a239508efb2e4a562267afee02d8f76f"}
Jul 17 05:34:36.543523 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.543501    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:36.545348 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.545317    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6" event={"ID":"18adf439-a774-4c72-9c27-19b0a0f6ce15","Type":"ContainerStarted","Data":"51f1bfe5ae9efc59589934908860da4e953a8313da76812ffd430c30f873001e"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549454    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"}
Jul 17 05:34:36.549710 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.549616    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerStarted","Data":"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"}
Jul 17 05:34:36.567576 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.567534    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56" podStartSLOduration=3.427668133 podStartE2EDuration="6.567513088s" totalImagesPullingTime="3.139844955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:36.567404387 +0000 UTC m=+95.030588503" watchObservedRunningTime="2026-07-17 05:34:36.567513088 +0000 UTC m=+95.030697193"
Jul 17 05:34:36.587430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.586425    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6" podStartSLOduration=1.5030460030000001 podStartE2EDuration="3.586406642s" totalImagesPullingTime="2.083360639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:36.584903952 +0000 UTC m=+95.048088057" watchObservedRunningTime="2026-07-17 05:34:36.586406642 +0000 UTC m=+95.049590747"
Jul 17 05:34:36.616572 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:36.616497    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.811258593 podStartE2EDuration="7.616472581s" totalImagesPullingTime="3.783487413s" totalInitContainerRuntime="21.726575ms" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:36.61513682 +0000 UTC m=+95.078320929" watchObservedRunningTime="2026-07-17 05:34:36.616472581 +0000 UTC m=+95.079656701"
Jul 17 05:34:37.556304 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:37.556255    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn" event={"ID":"b2ef69e6-903c-433f-b098-af26d603545c","Type":"ContainerStarted","Data":"b68fa86e920303e612bb458a25a16c8aad8f0bce9890d7a63c874a25c466d9ca"}
Jul 17 05:34:37.556747 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:37.556373    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn" event={"ID":"b2ef69e6-903c-433f-b098-af26d603545c","Type":"ContainerStarted","Data":"05b8cefcbfe1a10f35f722fa1d11dcfed61ac186ef432f576b49c27ded4987b0"}
Jul 17 05:34:37.556747 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:37.556408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn" event={"ID":"b2ef69e6-903c-433f-b098-af26d603545c","Type":"ContainerStarted","Data":"e0f40358c0430c1369ebd5546eea624c7ac4111d5a79b324f545fe9845b82714"}
Jul 17 05:34:37.581629 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:37.581578    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-574fc6996d-vgxzn" podStartSLOduration=2.309799081 podStartE2EDuration="4.581562974s" totalImagesPullingTime="2.271763893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:37.579118928 +0000 UTC m=+96.042303033" watchObservedRunningTime="2026-07-17 05:34:37.581562974 +0000 UTC m=+96.044747077"
Jul 17 05:34:38.568718 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:38.568587    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f64c9c54b-4wm56"
Jul 17 05:34:46.379556 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:46.379518    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kxgzj"
Jul 17 05:34:48.608171 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:48.608134    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z79vl" event={"ID":"87d3dc7e-f5db-4563-8c24-47fa5b851b92","Type":"ContainerStarted","Data":"0967c2cfa135b2a8c2b07175a9f59ed552b60d5506f6a4c994f217defc72b633"}
Jul 17 05:34:48.608612 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:48.608282    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:48.609617 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:48.609594    2567 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-z79vl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body=
Jul 17 05:34:48.609734 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:48.609635    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-z79vl" podUID="87d3dc7e-f5db-4563-8c24-47fa5b851b92" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused"
Jul 17 05:34:48.625533 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:48.625490    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-z79vl" podStartSLOduration=0.914459697 podStartE2EDuration="20.625476025s" totalImagesPullingTime="19.711016328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:48.623963807 +0000 UTC m=+107.087147912" watchObservedRunningTime="2026-07-17 05:34:48.625476025 +0000 UTC m=+107.088660129"
Jul 17 05:34:49.629238 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:49.629201    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-z79vl"
Jul 17 05:34:50.336238 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.336203    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:34:50.366594 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.366567    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:34:50.366786 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.366716    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.371797 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.371772    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k5npd\""
Jul 17 05:34:50.371797 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.371774    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 05:34:50.371996 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.371834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 05:34:50.371996 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.371774    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 05:34:50.372225 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.372204    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 05:34:50.372339 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.372204    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 05:34:50.381392 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.381368    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 05:34:50.464467 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464657 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464497    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464657 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464657 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464833 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464833 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx8d5\" (UniqueName: \"kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.464833 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.464745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565291 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565487 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx8d5\" (UniqueName: \"kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565487 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565487 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565487 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565487 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565464    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.565767 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.565495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.566495 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.566462    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.566814 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.566727    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.567135 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.567099    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.567283 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.567258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.568531 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.568506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.568726 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.568706    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.574167 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.574141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx8d5\" (UniqueName: \"kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5\") pod \"console-78678c8dbd-q7r4n\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") " pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.678447 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.678368    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:34:50.866413 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:50.865277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:34:51.627609 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:51.627565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78678c8dbd-q7r4n" event={"ID":"bec97a65-6eb4-4da3-86b5-6a1fec7d218c","Type":"ContainerStarted","Data":"a3b433ec2c0643ba665c1b904b926b73dc57bbe477966c2829fa748373439a41"}
Jul 17 05:34:53.368256 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:53.368212    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:53.368851 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:53.368293    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:34:54.646235 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:54.646197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78678c8dbd-q7r4n" event={"ID":"bec97a65-6eb4-4da3-86b5-6a1fec7d218c","Type":"ContainerStarted","Data":"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"}
Jul 17 05:34:54.664523 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:54.663263    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78678c8dbd-q7r4n" podStartSLOduration=1.127346991 podStartE2EDuration="4.663243499s" totalImagesPullingTime="3.535896508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:54.662238581 +0000 UTC m=+113.125422696" watchObservedRunningTime="2026-07-17 05:34:54.663243499 +0000 UTC m=+113.126427604"
Jul 17 05:34:55.653525 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:55.653432    2567 generic.go:356] "Generic (PLEG): container finished" podID="0085adf7-579e-4c12-b97d-71f186b32796" containerID="859f713f2085b5dd32ed5b67ad3b23460dd0489455e7925cd4f60a767f0f5fe7" exitCode=0
Jul 17 05:34:55.653992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:55.653522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486" event={"ID":"0085adf7-579e-4c12-b97d-71f186b32796","Type":"ContainerDied","Data":"859f713f2085b5dd32ed5b67ad3b23460dd0489455e7925cd4f60a767f0f5fe7"}
Jul 17 05:34:55.654114 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:55.654096    2567 scope.go:117] "RemoveContainer" containerID="859f713f2085b5dd32ed5b67ad3b23460dd0489455e7925cd4f60a767f0f5fe7"
Jul 17 05:34:56.661184 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:34:56.661141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-d8486" event={"ID":"0085adf7-579e-4c12-b97d-71f186b32796","Type":"ContainerStarted","Data":"d38308c5fb7edaed515f36d279afe7d2c3a7c6af05b529566a9ca471c6bf3829"}
Jul 17 05:35:00.678728 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:00.678698    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:35:00.679166 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:00.678752    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:35:00.683440 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:00.683418    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:35:01.685602 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:01.685576    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:35:13.372557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:13.372527    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:35:13.376466 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:13.376440    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f8bbccccc-fd6n6"
Jul 17 05:35:45.118851 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.118817    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:35:45.123876 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.123854    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.132600 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.132579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:35:45.242059 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.242442 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.242272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58kh\" (UniqueName: \"kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343403 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343601 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343601 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343601 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343601 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58kh\" (UniqueName: \"kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.343836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.343753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.344306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.344267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.344434 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.344310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.344434 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.344322    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.344516 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.344494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.346288 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.346264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.346375 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.346269    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.351374 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.351356    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58kh\" (UniqueName: \"kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh\") pod \"console-5f8674c754-z865z\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") " pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.433896 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.433821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:45.560400 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.560371    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:35:45.563615 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:35:45.563589    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aefc402_fe11_408a_9630_09f58a288549.slice/crio-1b3c5ae2d0a39eaec8c864e8e409782e32452fd28ddb70afd77a4165ccacb59e WatchSource:0}: Error finding container 1b3c5ae2d0a39eaec8c864e8e409782e32452fd28ddb70afd77a4165ccacb59e: Status 404 returned error can't find the container with id 1b3c5ae2d0a39eaec8c864e8e409782e32452fd28ddb70afd77a4165ccacb59e
Jul 17 05:35:45.869539 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.869502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8674c754-z865z" event={"ID":"1aefc402-fe11-408a-9630-09f58a288549","Type":"ContainerStarted","Data":"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"}
Jul 17 05:35:45.869771 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.869556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8674c754-z865z" event={"ID":"1aefc402-fe11-408a-9630-09f58a288549","Type":"ContainerStarted","Data":"1b3c5ae2d0a39eaec8c864e8e409782e32452fd28ddb70afd77a4165ccacb59e"}
Jul 17 05:35:45.885875 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:45.885829    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8674c754-z865z" podStartSLOduration=0.885815616 podStartE2EDuration="885.815616ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:35:45.885151097 +0000 UTC m=+164.348335205" watchObservedRunningTime="2026-07-17 05:35:45.885815616 +0000 UTC m=+164.348999719"
Jul 17 05:35:49.111179 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111145    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111444    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="alertmanager" containerID="cri-o://2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511" gracePeriod=120
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111504    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-metric" containerID="cri-o://c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd" gracePeriod=120
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111540    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-web" containerID="cri-o://9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a" gracePeriod=120
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111571    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="config-reloader" containerID="cri-o://d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42" gracePeriod=120
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111580    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="prom-label-proxy" containerID="cri-o://fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093" gracePeriod=120
Jul 17 05:35:49.111672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.111610    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy" containerID="cri-o://d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02" gracePeriod=120
Jul 17 05:35:49.889013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.888980    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093" exitCode=0
Jul 17 05:35:49.889013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889005    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02" exitCode=0
Jul 17 05:35:49.889013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889010    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42" exitCode=0
Jul 17 05:35:49.889013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889016    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511" exitCode=0
Jul 17 05:35:49.889333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"}
Jul 17 05:35:49.889333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"}
Jul 17 05:35:49.889333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889180    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"}
Jul 17 05:35:49.889333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:49.889219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"}
Jul 17 05:35:50.350911 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.350885    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:50.489415 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489388    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489583 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489423    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489583 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489440    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489583 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489474    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489783 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489649    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489783 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489751    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489881 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489806    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.489881 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489843    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.489974    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490020    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490515    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490586    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490621    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490662    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490724    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v69x2\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2\") pod \"601d3f42-8956-4ccd-a4bc-54060817ae69\" (UID: \"601d3f42-8956-4ccd-a4bc-54060817ae69\") "
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.490994    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-main-db\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.491323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.491011    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.492343 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.492312    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume" (OuterVolumeSpecName: "config-volume") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.493112 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.492997    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:35:50.493112 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.493000    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.493112 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.493051    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.493486 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.493349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:35:50.493853 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.493761    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.493936 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.493918    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2" (OuterVolumeSpecName: "kube-api-access-v69x2") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "kube-api-access-v69x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:35:50.494737 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.494710    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out" (OuterVolumeSpecName: "config-out") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:35:50.495052 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.495035    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.497895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.497779    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.504584 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.504565    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config" (OuterVolumeSpecName: "web-config") pod "601d3f42-8956-4ccd-a4bc-54060817ae69" (UID: "601d3f42-8956-4ccd-a4bc-54060817ae69"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:50.592314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592283    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-tls-assets\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592307    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592318    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592328    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-main-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592336    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/601d3f42-8956-4ccd-a4bc-54060817ae69-config-out\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592344    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601d3f42-8956-4ccd-a4bc-54060817ae69-metrics-client-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592352    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v69x2\" (UniqueName: \"kubernetes.io/projected/601d3f42-8956-4ccd-a4bc-54060817ae69-kube-api-access-v69x2\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592359    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-config-volume\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592367    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-web-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592374    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-cluster-tls-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.592488 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.592382    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601d3f42-8956-4ccd-a4bc-54060817ae69-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:35:50.896417 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896330    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd" exitCode=0
Jul 17 05:35:50.896417 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896355    2567 generic.go:356] "Generic (PLEG): container finished" podID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerID="9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a" exitCode=0
Jul 17 05:35:50.896588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"}
Jul 17 05:35:50.896588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896470    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:50.896588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896505    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"}
Jul 17 05:35:50.896588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"601d3f42-8956-4ccd-a4bc-54060817ae69","Type":"ContainerDied","Data":"bebfca81beed803ea05a4b50614c00d320896ca78e82dea3d1ee0ab6b13f0604"}
Jul 17 05:35:50.896588 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.896561    2567 scope.go:117] "RemoveContainer" containerID="fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"
Jul 17 05:35:50.905314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.905295    2567 scope.go:117] "RemoveContainer" containerID="c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"
Jul 17 05:35:50.913950 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.913927    2567 scope.go:117] "RemoveContainer" containerID="d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"
Jul 17 05:35:50.919866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.919846    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:50.921701 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.921608    2567 scope.go:117] "RemoveContainer" containerID="9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"
Jul 17 05:35:50.923407 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.923385    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:50.928583 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.928567    2567 scope.go:117] "RemoveContainer" containerID="d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"
Jul 17 05:35:50.935467 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.935452    2567 scope.go:117] "RemoveContainer" containerID="2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"
Jul 17 05:35:50.942446 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.942430    2567 scope.go:117] "RemoveContainer" containerID="5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"
Jul 17 05:35:50.948789 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.948770    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:50.949065 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949054    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="alertmanager"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949068    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="alertmanager"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949079    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="init-config-reloader"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949084    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="init-config-reloader"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949094    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949100    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949106    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-metric"
Jul 17 05:35:50.949111 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949111    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-metric"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949121    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="prom-label-proxy"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949126    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="prom-label-proxy"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949139    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="config-reloader"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949145    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="config-reloader"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949155    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-web"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949162    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-web"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949242    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="alertmanager"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949251    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="config-reloader"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949256    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="prom-label-proxy"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949268    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-web"
Jul 17 05:35:50.949306 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949273    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" containerName="kube-rbac-proxy-metric"
Jul 17 05:35:50.949788 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.949769    2567 scope.go:117] "RemoveContainer" containerID="fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"
Jul 17 05:35:50.950055 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.950038    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093\": container with ID starting with fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093 not found: ID does not exist" containerID="fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"
Jul 17 05:35:50.950110 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950063    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"} err="failed to get container status \"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093\": rpc error: code = NotFound desc = could not find container \"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093\": container with ID starting with fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093 not found: ID does not exist"
Jul 17 05:35:50.950151 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950111    2567 scope.go:117] "RemoveContainer" containerID="c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"
Jul 17 05:35:50.950366 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.950345    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd\": container with ID starting with c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd not found: ID does not exist" containerID="c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"
Jul 17 05:35:50.950404 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950376    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"} err="failed to get container status \"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd\": rpc error: code = NotFound desc = could not find container \"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd\": container with ID starting with c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd not found: ID does not exist"
Jul 17 05:35:50.950404 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950396    2567 scope.go:117] "RemoveContainer" containerID="d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"
Jul 17 05:35:50.950666 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.950649    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02\": container with ID starting with d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02 not found: ID does not exist" containerID="d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"
Jul 17 05:35:50.950761 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950696    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"} err="failed to get container status \"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02\": rpc error: code = NotFound desc = could not find container \"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02\": container with ID starting with d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02 not found: ID does not exist"
Jul 17 05:35:50.950761 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950720    2567 scope.go:117] "RemoveContainer" containerID="9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"
Jul 17 05:35:50.950973 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.950956    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a\": container with ID starting with 9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a not found: ID does not exist" containerID="9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"
Jul 17 05:35:50.951019 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950979    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"} err="failed to get container status \"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a\": rpc error: code = NotFound desc = could not find container \"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a\": container with ID starting with 9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a not found: ID does not exist"
Jul 17 05:35:50.951019 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.950993    2567 scope.go:117] "RemoveContainer" containerID="d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"
Jul 17 05:35:50.951223 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.951206    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42\": container with ID starting with d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42 not found: ID does not exist" containerID="d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"
Jul 17 05:35:50.951264 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951232    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"} err="failed to get container status \"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42\": rpc error: code = NotFound desc = could not find container \"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42\": container with ID starting with d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42 not found: ID does not exist"
Jul 17 05:35:50.951264 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951248    2567 scope.go:117] "RemoveContainer" containerID="2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"
Jul 17 05:35:50.951503 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.951487    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511\": container with ID starting with 2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511 not found: ID does not exist" containerID="2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"
Jul 17 05:35:50.951555 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951506    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"} err="failed to get container status \"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511\": rpc error: code = NotFound desc = could not find container \"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511\": container with ID starting with 2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511 not found: ID does not exist"
Jul 17 05:35:50.951555 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951520    2567 scope.go:117] "RemoveContainer" containerID="5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"
Jul 17 05:35:50.951745 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:35:50.951729    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f\": container with ID starting with 5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f not found: ID does not exist" containerID="5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"
Jul 17 05:35:50.951785 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951749    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"} err="failed to get container status \"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f\": rpc error: code = NotFound desc = could not find container \"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f\": container with ID starting with 5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f not found: ID does not exist"
Jul 17 05:35:50.951785 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951762    2567 scope.go:117] "RemoveContainer" containerID="fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"
Jul 17 05:35:50.951975 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951958    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093"} err="failed to get container status \"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093\": rpc error: code = NotFound desc = could not find container \"fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093\": container with ID starting with fb1755dea7307ce480f1861290c7513adf464fe370a8ec1360bddc419d7fa093 not found: ID does not exist"
Jul 17 05:35:50.952020 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.951975    2567 scope.go:117] "RemoveContainer" containerID="c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"
Jul 17 05:35:50.952159 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952145    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:50.952200 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952155    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd"} err="failed to get container status \"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd\": rpc error: code = NotFound desc = could not find container \"c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd\": container with ID starting with c30cb6b0c7735cf4bcee3ff22bfb5d32dfa068b38f7d50642437091b2b2906bd not found: ID does not exist"
Jul 17 05:35:50.952200 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952168    2567 scope.go:117] "RemoveContainer" containerID="d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"
Jul 17 05:35:50.952467 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952399    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02"} err="failed to get container status \"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02\": rpc error: code = NotFound desc = could not find container \"d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02\": container with ID starting with d1c1fd4c420bf69522ce584638d753ec465a338003d9c7f5ee958dfd229ceb02 not found: ID does not exist"
Jul 17 05:35:50.952467 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952453    2567 scope.go:117] "RemoveContainer" containerID="9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"
Jul 17 05:35:50.952725 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952697    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a"} err="failed to get container status \"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a\": rpc error: code = NotFound desc = could not find container \"9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a\": container with ID starting with 9335dc2f69e1b6558451a1131c1c3524d4e0b3816d84d33838b0d7a67e0f766a not found: ID does not exist"
Jul 17 05:35:50.952784 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952730    2567 scope.go:117] "RemoveContainer" containerID="d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"
Jul 17 05:35:50.952993 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952975    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42"} err="failed to get container status \"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42\": rpc error: code = NotFound desc = could not find container \"d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42\": container with ID starting with d51d3813824ecc43448751d96d2946206482f617b408f14af71cbac7093e4f42 not found: ID does not exist"
Jul 17 05:35:50.953046 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.952994    2567 scope.go:117] "RemoveContainer" containerID="2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"
Jul 17 05:35:50.953225 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.953205    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511"} err="failed to get container status \"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511\": rpc error: code = NotFound desc = could not find container \"2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511\": container with ID starting with 2eba00e29c47e1a3106ba99b453ea5b5ffa6f9dc8a1955ef499f053413688511 not found: ID does not exist"
Jul 17 05:35:50.953273 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.953226    2567 scope.go:117] "RemoveContainer" containerID="5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"
Jul 17 05:35:50.953497 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.953455    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f"} err="failed to get container status \"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f\": rpc error: code = NotFound desc = could not find container \"5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f\": container with ID starting with 5e64ef2a4b23c552598745a8b5ad63ef3f759b1d7d8ebcba0e2d6d65b0dc6d1f not found: ID does not exist"
Jul 17 05:35:50.954382 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954348    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 05:35:50.954506 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954482    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 05:35:50.954506 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954500    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 05:35:50.954653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 05:35:50.954653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954596    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 05:35:50.954653 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l5lj7\""
Jul 17 05:35:50.954834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954571    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 05:35:50.954834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954764    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 05:35:50.954947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.954905    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 05:35:50.959313 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.959294    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 05:35:50.964742 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:50.964722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:51.096580 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096544    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-config-volume\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096580 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2sb\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-kube-api-access-lk2sb\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.096824 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-web-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.097101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096842    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.097101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.097101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.097101 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.096964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-config-out\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198191 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198223    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-config-out\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-config-volume\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198326 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2sb\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-kube-api-access-lk2sb\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198529 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-web-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198836 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.198959 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.198875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.199737 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.199191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.200722 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.200355    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/104609b2-327d-4d05-8ffa-02fb605df47c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.201616 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.201586    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.201730 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.201591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-config-volume\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.201852 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.201828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.202172 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.202110    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/104609b2-327d-4d05-8ffa-02fb605df47c-config-out\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.202429 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.202391    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.203215 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.203132    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.203408 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.203384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.204042 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.204016    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-web-config\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.204137 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.204124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/104609b2-327d-4d05-8ffa-02fb605df47c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.210117 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.210097    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2sb\" (UniqueName: \"kubernetes.io/projected/104609b2-327d-4d05-8ffa-02fb605df47c-kube-api-access-lk2sb\") pod \"alertmanager-main-0\" (UID: \"104609b2-327d-4d05-8ffa-02fb605df47c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.261723 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.261699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 05:35:51.396373 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.396346    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 05:35:51.399072 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:35:51.399045    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104609b2_327d_4d05_8ffa_02fb605df47c.slice/crio-db721a3feb135002f0c0868ebba0bf85dfae425646e7ee0bb90f10fdd192ccc4 WatchSource:0}: Error finding container db721a3feb135002f0c0868ebba0bf85dfae425646e7ee0bb90f10fdd192ccc4: Status 404 returned error can't find the container with id db721a3feb135002f0c0868ebba0bf85dfae425646e7ee0bb90f10fdd192ccc4
Jul 17 05:35:51.902039 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.902006    2567 generic.go:356] "Generic (PLEG): container finished" podID="104609b2-327d-4d05-8ffa-02fb605df47c" containerID="ad3880c599aae69cfaad581febc80296cf9c0550f77179ec6125ec5f7681268c" exitCode=0
Jul 17 05:35:51.902234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.902100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerDied","Data":"ad3880c599aae69cfaad581febc80296cf9c0550f77179ec6125ec5f7681268c"}
Jul 17 05:35:51.902234 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:51.902184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"db721a3feb135002f0c0868ebba0bf85dfae425646e7ee0bb90f10fdd192ccc4"}
Jul 17 05:35:52.024558 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.023005    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="601d3f42-8956-4ccd-a4bc-54060817ae69" path="/var/lib/kubelet/pods/601d3f42-8956-4ccd-a4bc-54060817ae69/volumes"
Jul 17 05:35:52.909971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.909939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"852169eb3110dc13248c23dc06e2e6e6c4cff4bb02317967ee988ace7cd73e6c"}
Jul 17 05:35:52.910349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.910006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"256351d7a99f9d20c02b26519b6c6b5d68b91a686300227c1f3d813e38ecdfe2"}
Jul 17 05:35:52.910349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.910033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"33f64ef1551bdec0623a66b6f7cee139b77f67eb9e37af24ffaea0d81b4d168f"}
Jul 17 05:35:52.910349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.910056    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"5766e8b796b0761853ec39ad0555a9002cdcbba5ca8572bfcf305d7de8965230"}
Jul 17 05:35:52.910349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.910083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"ec6b859d185db96cf5bf658dd3982996d9d06358cb16c9325967c4d3835dbe86"}
Jul 17 05:35:52.910349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.910106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"104609b2-327d-4d05-8ffa-02fb605df47c","Type":"ContainerStarted","Data":"3669112ccb578097ce681ff7294e7be8afa4e3b6fd1f651bf3d26e6760057deb"}
Jul 17 05:35:52.938293 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:52.938210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.922819091 podStartE2EDuration="2.938195166s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.376075ms" isStatefulPod=false podCreationTimestamp="2026-07-17 05:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:35:52.936508089 +0000 UTC m=+171.399692190" watchObservedRunningTime="2026-07-17 05:35:52.938195166 +0000 UTC m=+171.401379269"
Jul 17 05:35:55.434036 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:55.433995    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:55.434472 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:55.434067    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:55.439028 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:55.439003    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:55.925545 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:55.925517    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:35:55.968418 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:35:55.968386    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:36:20.995258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:20.995214    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78678c8dbd-q7r4n" podUID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" containerName="console" containerID="cri-o://62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0" gracePeriod=15
Jul 17 05:36:21.237450 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.237429    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:36:21.373284 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373220    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx8d5\" (UniqueName: \"kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373284 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373256    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373288    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373323    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373363    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373575 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373426    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert\") pod \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\" (UID: \"bec97a65-6eb4-4da3-86b5-6a1fec7d218c\") "
Jul 17 05:36:21.373854 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373719    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:36:21.373854 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config" (OuterVolumeSpecName: "console-config") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:36:21.373921 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373864    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca" (OuterVolumeSpecName: "service-ca") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:36:21.373953 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.373914    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:36:21.375646 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.375613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5" (OuterVolumeSpecName: "kube-api-access-fx8d5") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "kube-api-access-fx8d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:36:21.375646 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.375628    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:36:21.375834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.375765    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bec97a65-6eb4-4da3-86b5-6a1fec7d218c" (UID: "bec97a65-6eb4-4da3-86b5-6a1fec7d218c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:36:21.474192 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474152    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-serving-cert\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474192 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474184    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-oauth-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474192 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474199    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-oauth-serving-cert\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474210    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx8d5\" (UniqueName: \"kubernetes.io/projected/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-kube-api-access-fx8d5\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474222    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-trusted-ca-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474234    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-console-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:21.474430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:21.474245    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bec97a65-6eb4-4da3-86b5-6a1fec7d218c-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:36:22.026662 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.026625    2567 generic.go:356] "Generic (PLEG): container finished" podID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" containerID="62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0" exitCode=0
Jul 17 05:36:22.027083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.026675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78678c8dbd-q7r4n" event={"ID":"bec97a65-6eb4-4da3-86b5-6a1fec7d218c","Type":"ContainerDied","Data":"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"}
Jul 17 05:36:22.027083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.026713    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78678c8dbd-q7r4n"
Jul 17 05:36:22.027083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.026740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78678c8dbd-q7r4n" event={"ID":"bec97a65-6eb4-4da3-86b5-6a1fec7d218c","Type":"ContainerDied","Data":"a3b433ec2c0643ba665c1b904b926b73dc57bbe477966c2829fa748373439a41"}
Jul 17 05:36:22.027083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.026757    2567 scope.go:117] "RemoveContainer" containerID="62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"
Jul 17 05:36:22.034963 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.034947    2567 scope.go:117] "RemoveContainer" containerID="62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"
Jul 17 05:36:22.035219 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:36:22.035200    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0\": container with ID starting with 62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0 not found: ID does not exist" containerID="62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"
Jul 17 05:36:22.035264 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.035228    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0"} err="failed to get container status \"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0\": rpc error: code = NotFound desc = could not find container \"62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0\": container with ID starting with 62f3541df97cb3438437343121b762e2d272ba5cab46dad62043f0ef2ca130b0 not found: ID does not exist"
Jul 17 05:36:22.042240 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.042199    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:36:22.043993 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:22.043976    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78678c8dbd-q7r4n"]
Jul 17 05:36:24.019513 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:24.019467    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" path="/var/lib/kubelet/pods/bec97a65-6eb4-4da3-86b5-6a1fec7d218c/volumes"
Jul 17 05:36:51.666446 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.666411    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"]
Jul 17 05:36:51.666866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.666803    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" containerName="console"
Jul 17 05:36:51.666866 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.666815    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" containerName="console"
Jul 17 05:36:51.666941 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.666877    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec97a65-6eb4-4da3-86b5-6a1fec7d218c" containerName="console"
Jul 17 05:36:51.669554 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.669538    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.672088 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.672062    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 05:36:51.672203 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.672168    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 05:36:51.672253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.672226    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrtsw\""
Jul 17 05:36:51.679214 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.679190    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"]
Jul 17 05:36:51.721543 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.721519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.721709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.721548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.721709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.721615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkrv4\" (UniqueName: \"kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.822155 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.822119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkrv4\" (UniqueName: \"kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.822301 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.822173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.822301 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.822203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.822570 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.822546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.822617 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.822601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.829940 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.829912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkrv4\" (UniqueName: \"kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:51.978751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:51.978722    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:36:52.109840 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:52.109802    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"]
Jul 17 05:36:52.113021 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:36:52.112991    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68797e75_5309_4207_abed_38d30ec71f78.slice/crio-4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0 WatchSource:0}: Error finding container 4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0: Status 404 returned error can't find the container with id 4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0
Jul 17 05:36:52.152977 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:52.152944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2" event={"ID":"68797e75-5309-4207-abed-38d30ec71f78","Type":"ContainerStarted","Data":"4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0"}
Jul 17 05:36:58.181486 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:58.181448    2567 generic.go:356] "Generic (PLEG): container finished" podID="68797e75-5309-4207-abed-38d30ec71f78" containerID="01e8da64e58f48857aedd61e18d796cedad7387c5d464ea7b331ae4481567c39" exitCode=0
Jul 17 05:36:58.181962 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:36:58.181524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2" event={"ID":"68797e75-5309-4207-abed-38d30ec71f78","Type":"ContainerDied","Data":"01e8da64e58f48857aedd61e18d796cedad7387c5d464ea7b331ae4481567c39"}
Jul 17 05:37:01.196343 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:01.196312    2567 generic.go:356] "Generic (PLEG): container finished" podID="68797e75-5309-4207-abed-38d30ec71f78" containerID="69394ed304ccc532767c52f4d657c4d920b664136e9dfd69a12761893091628f" exitCode=0
Jul 17 05:37:01.196715 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:01.196391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2" event={"ID":"68797e75-5309-4207-abed-38d30ec71f78","Type":"ContainerDied","Data":"69394ed304ccc532767c52f4d657c4d920b664136e9dfd69a12761893091628f"}
Jul 17 05:37:09.234990 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:09.234957    2567 generic.go:356] "Generic (PLEG): container finished" podID="68797e75-5309-4207-abed-38d30ec71f78" containerID="5f51e5beff631d3e431fd503c3c47581c109e1da1a028b3b1d5fea5ba27bdb53" exitCode=0
Jul 17 05:37:09.235370 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:09.235031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2" event={"ID":"68797e75-5309-4207-abed-38d30ec71f78","Type":"ContainerDied","Data":"5f51e5beff631d3e431fd503c3c47581c109e1da1a028b3b1d5fea5ba27bdb53"}
Jul 17 05:37:10.373805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.373779    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:37:10.493954 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.493858    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle\") pod \"68797e75-5309-4207-abed-38d30ec71f78\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") "
Jul 17 05:37:10.493954 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.493923    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util\") pod \"68797e75-5309-4207-abed-38d30ec71f78\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") "
Jul 17 05:37:10.494183 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.493968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkrv4\" (UniqueName: \"kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4\") pod \"68797e75-5309-4207-abed-38d30ec71f78\" (UID: \"68797e75-5309-4207-abed-38d30ec71f78\") "
Jul 17 05:37:10.494580 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.494544    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle" (OuterVolumeSpecName: "bundle") pod "68797e75-5309-4207-abed-38d30ec71f78" (UID: "68797e75-5309-4207-abed-38d30ec71f78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:10.496221 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.496198    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4" (OuterVolumeSpecName: "kube-api-access-kkrv4") pod "68797e75-5309-4207-abed-38d30ec71f78" (UID: "68797e75-5309-4207-abed-38d30ec71f78"). InnerVolumeSpecName "kube-api-access-kkrv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:37:10.499083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.499057    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util" (OuterVolumeSpecName: "util") pod "68797e75-5309-4207-abed-38d30ec71f78" (UID: "68797e75-5309-4207-abed-38d30ec71f78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:10.594486 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.594452    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkrv4\" (UniqueName: \"kubernetes.io/projected/68797e75-5309-4207-abed-38d30ec71f78-kube-api-access-kkrv4\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:10.594486 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.594481    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:10.594486 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:10.594490    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68797e75-5309-4207-abed-38d30ec71f78-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:11.245292 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:11.245261    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2" event={"ID":"68797e75-5309-4207-abed-38d30ec71f78","Type":"ContainerDied","Data":"4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0"}
Jul 17 05:37:11.245292 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:11.245281    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kvnj2"
Jul 17 05:37:11.245485 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:11.245312    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4289e8dbf877367769fe7e17d506a33643ccd0e468d375dcbe924e49be477fa0"
Jul 17 05:37:14.578155 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578121    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"]
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578442    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="pull"
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578453    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="pull"
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578474    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="util"
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578482    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="util"
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578493    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="extract"
Jul 17 05:37:14.578527 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578501    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="extract"
Jul 17 05:37:14.578749 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.578553    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="68797e75-5309-4207-abed-38d30ec71f78" containerName="extract"
Jul 17 05:37:14.621289 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.621258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"]
Jul 17 05:37:14.621442 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.621352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.625515 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.625485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v65fv\""
Jul 17 05:37:14.625635 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.625516    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 17 05:37:14.625776 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.625760    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:37:14.731156 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.731122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.731156 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.731159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bqz\" (UniqueName: \"kubernetes.io/projected/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-kube-api-access-z8bqz\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.832009 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.831925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.832009 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.831962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bqz\" (UniqueName: \"kubernetes.io/projected/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-kube-api-access-z8bqz\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.832358 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.832337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.839895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.839873    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bqz\" (UniqueName: \"kubernetes.io/projected/55ce6b24-16ef-42de-8bfc-2ed3443fe77e-kube-api-access-z8bqz\") pod \"cert-manager-operator-controller-manager-55c444bf86-f8j7m\" (UID: \"55ce6b24-16ef-42de-8bfc-2ed3443fe77e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:14.930503 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:14.930471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"
Jul 17 05:37:15.079708 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:15.079660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m"]
Jul 17 05:37:15.085278 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:15.085206    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ce6b24_16ef_42de_8bfc_2ed3443fe77e.slice/crio-497880852b2228693d4ed5e9fb85b6ed763b7d5b27de92947b4c646a77dea5d8 WatchSource:0}: Error finding container 497880852b2228693d4ed5e9fb85b6ed763b7d5b27de92947b4c646a77dea5d8: Status 404 returned error can't find the container with id 497880852b2228693d4ed5e9fb85b6ed763b7d5b27de92947b4c646a77dea5d8
Jul 17 05:37:15.263367 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:15.263331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m" event={"ID":"55ce6b24-16ef-42de-8bfc-2ed3443fe77e","Type":"ContainerStarted","Data":"497880852b2228693d4ed5e9fb85b6ed763b7d5b27de92947b4c646a77dea5d8"}
Jul 17 05:37:18.278968 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.278920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m" event={"ID":"55ce6b24-16ef-42de-8bfc-2ed3443fe77e","Type":"ContainerStarted","Data":"97c8fdb851d41312f9f35eb7011de01a22de0eb2fd90a148fc8239f0f992cf6c"}
Jul 17 05:37:18.303889 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.303839    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f8j7m" podStartSLOduration=2.073192912 podStartE2EDuration="4.303818561s" totalImagesPullingTime="2.230625649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:18.301940311 +0000 UTC m=+256.765124415" watchObservedRunningTime="2026-07-17 05:37:18.303818561 +0000 UTC m=+256.767002669"
Jul 17 05:37:18.974314 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.974277    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"]
Jul 17 05:37:18.976644 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.976622    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:18.979239 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.979220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 05:37:18.979379 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.979366    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 05:37:18.980323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.980307    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrtsw\""
Jul 17 05:37:18.987333 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:18.987310    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"]
Jul 17 05:37:19.073262 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.073233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.073442 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.073277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.073442 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.073305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwfbc\" (UniqueName: \"kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.174600 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.174560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.174811 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.174632    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.174811 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.174749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwfbc\" (UniqueName: \"kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.175053 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.175034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.175092 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.175054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.182733 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.182703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwfbc\" (UniqueName: \"kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.285445 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.285372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:19.413615 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:19.413593    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"]
Jul 17 05:37:19.416089 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:19.416061    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a76afdf_6b42_42d5_b7fc_61455d504024.slice/crio-a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e WatchSource:0}: Error finding container a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e: Status 404 returned error can't find the container with id a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e
Jul 17 05:37:20.289373 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:20.289341    2567 generic.go:356] "Generic (PLEG): container finished" podID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerID="cd8337b986840864d68564972307b62f181e22e696991302ea8b6db67c0878ed" exitCode=0
Jul 17 05:37:20.289785 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:20.289388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t" event={"ID":"6a76afdf-6b42-42d5-b7fc-61455d504024","Type":"ContainerDied","Data":"cd8337b986840864d68564972307b62f181e22e696991302ea8b6db67c0878ed"}
Jul 17 05:37:20.289785 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:20.289423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t" event={"ID":"6a76afdf-6b42-42d5-b7fc-61455d504024","Type":"ContainerStarted","Data":"a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e"}
Jul 17 05:37:22.301859 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:22.301821    2567 generic.go:356] "Generic (PLEG): container finished" podID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerID="dcedecdd5272352b371097c1d5b68732965e17fc921015bc111ccedaf815319c" exitCode=0
Jul 17 05:37:22.302258 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:22.301909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t" event={"ID":"6a76afdf-6b42-42d5-b7fc-61455d504024","Type":"ContainerDied","Data":"dcedecdd5272352b371097c1d5b68732965e17fc921015bc111ccedaf815319c"}
Jul 17 05:37:23.308002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:23.307918    2567 generic.go:356] "Generic (PLEG): container finished" podID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerID="986f578e22c9741f82ba87393a3f07d101ee72949dad4f291c8ac7f4c7d743dc" exitCode=0
Jul 17 05:37:23.308002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:23.307987    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t" event={"ID":"6a76afdf-6b42-42d5-b7fc-61455d504024","Type":"ContainerDied","Data":"986f578e22c9741f82ba87393a3f07d101ee72949dad4f291c8ac7f4c7d743dc"}
Jul 17 05:37:24.438728 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.438705    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:24.521953 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.521913    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle\") pod \"6a76afdf-6b42-42d5-b7fc-61455d504024\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") "
Jul 17 05:37:24.522115 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.522042    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwfbc\" (UniqueName: \"kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc\") pod \"6a76afdf-6b42-42d5-b7fc-61455d504024\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") "
Jul 17 05:37:24.522115 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.522085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util\") pod \"6a76afdf-6b42-42d5-b7fc-61455d504024\" (UID: \"6a76afdf-6b42-42d5-b7fc-61455d504024\") "
Jul 17 05:37:24.522425 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.522400    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle" (OuterVolumeSpecName: "bundle") pod "6a76afdf-6b42-42d5-b7fc-61455d504024" (UID: "6a76afdf-6b42-42d5-b7fc-61455d504024"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:24.524377 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.524341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc" (OuterVolumeSpecName: "kube-api-access-dwfbc") pod "6a76afdf-6b42-42d5-b7fc-61455d504024" (UID: "6a76afdf-6b42-42d5-b7fc-61455d504024"). InnerVolumeSpecName "kube-api-access-dwfbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:37:24.527606 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.527583    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util" (OuterVolumeSpecName: "util") pod "6a76afdf-6b42-42d5-b7fc-61455d504024" (UID: "6a76afdf-6b42-42d5-b7fc-61455d504024"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:24.623557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.623471    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwfbc\" (UniqueName: \"kubernetes.io/projected/6a76afdf-6b42-42d5-b7fc-61455d504024-kube-api-access-dwfbc\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:24.623557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.623502    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:24.623557 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.623511    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a76afdf-6b42-42d5-b7fc-61455d504024-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:24.978194 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978162    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"]
Jul 17 05:37:24.978491 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978479    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="extract"
Jul 17 05:37:24.978535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978493    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="extract"
Jul 17 05:37:24.978535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978501    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="pull"
Jul 17 05:37:24.978535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978507    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="pull"
Jul 17 05:37:24.978535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978524    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="util"
Jul 17 05:37:24.978535 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978530    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="util"
Jul 17 05:37:24.978709 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.978592    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a76afdf-6b42-42d5-b7fc-61455d504024" containerName="extract"
Jul 17 05:37:24.980388 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.980373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:24.982633 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.982613    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 05:37:24.982783 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.982735    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 05:37:24.983655 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.983631    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9txhd\""
Jul 17 05:37:24.988837 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:24.988815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"]
Jul 17 05:37:25.127839 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.127807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.128037 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.127858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm7lx\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-kube-api-access-mm7lx\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.228721 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.228617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.228721 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.228672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm7lx\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-kube-api-access-mm7lx\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.237809 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.237785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.237948 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.237928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm7lx\" (UniqueName: \"kubernetes.io/projected/2031ef81-071b-4653-9ef7-677b74123e2f-kube-api-access-mm7lx\") pod \"cert-manager-cainjector-559cdd8c87-znqhj\" (UID: \"2031ef81-071b-4653-9ef7-677b74123e2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.289931 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.289889    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"
Jul 17 05:37:25.318750 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.318716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t" event={"ID":"6a76afdf-6b42-42d5-b7fc-61455d504024","Type":"ContainerDied","Data":"a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e"}
Jul 17 05:37:25.318750 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.318744    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6824t"
Jul 17 05:37:25.318919 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.318766    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a87cf42c489565701549cafca82dbb07020598d6113db31328dbccd7b4d1a78e"
Jul 17 05:37:25.417229 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:25.417036    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-znqhj"]
Jul 17 05:37:25.419462 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:25.419439    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2031ef81_071b_4653_9ef7_677b74123e2f.slice/crio-cc695e52b2f64a730ab9b6105dbf0039792352fc2c45f39cdca2d2c8e9a3beb4 WatchSource:0}: Error finding container cc695e52b2f64a730ab9b6105dbf0039792352fc2c45f39cdca2d2c8e9a3beb4: Status 404 returned error can't find the container with id cc695e52b2f64a730ab9b6105dbf0039792352fc2c45f39cdca2d2c8e9a3beb4
Jul 17 05:37:26.326182 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:26.326140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj" event={"ID":"2031ef81-071b-4653-9ef7-677b74123e2f","Type":"ContainerStarted","Data":"cc695e52b2f64a730ab9b6105dbf0039792352fc2c45f39cdca2d2c8e9a3beb4"}
Jul 17 05:37:28.336459 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:28.336421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj" event={"ID":"2031ef81-071b-4653-9ef7-677b74123e2f","Type":"ContainerStarted","Data":"3140f09e6b037bc531961def556c029b59d74c27fc6dd3e6f9e5f86aff31d461"}
Jul 17 05:37:28.351321 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:28.351265    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-znqhj" podStartSLOduration=1.9177666389999999 podStartE2EDuration="4.351250825s" totalImagesPullingTime="2.433484186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:28.349769798 +0000 UTC m=+266.812953903" watchObservedRunningTime="2026-07-17 05:37:28.351250825 +0000 UTC m=+266.814434929"
Jul 17 05:37:38.750472 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.750429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gr9sn"]
Jul 17 05:37:38.755010 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.754985    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.757366 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.757345    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nj5mb\""
Jul 17 05:37:38.761477 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.761455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gr9sn"]
Jul 17 05:37:38.841141 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.841100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzfn\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-kube-api-access-zlzfn\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.841313 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.841200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.942507 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.942471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.942723 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.942541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzfn\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-kube-api-access-zlzfn\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.950300 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.950276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzfn\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-kube-api-access-zlzfn\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:38.950391 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:38.950315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49425c2-b668-402c-a331-a35b773fe6c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gr9sn\" (UID: \"a49425c2-b668-402c-a331-a35b773fe6c1\") " pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:39.065159 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.065079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gr9sn"
Jul 17 05:37:39.206460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.206434    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gr9sn"]
Jul 17 05:37:39.208319 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:39.208292    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49425c2_b668_402c_a331_a35b773fe6c1.slice/crio-00418a123cfe17d3f0c188cc0ff50589885efc57845e6deb78cd25b605a32f5a WatchSource:0}: Error finding container 00418a123cfe17d3f0c188cc0ff50589885efc57845e6deb78cd25b605a32f5a: Status 404 returned error can't find the container with id 00418a123cfe17d3f0c188cc0ff50589885efc57845e6deb78cd25b605a32f5a
Jul 17 05:37:39.389044 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.388965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gr9sn" event={"ID":"a49425c2-b668-402c-a331-a35b773fe6c1","Type":"ContainerStarted","Data":"bedd6e4883b5b50246def4dd3ae916a93d3858d453c11fc31b6cdeac4b4f33c2"}
Jul 17 05:37:39.389044 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.389004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gr9sn" event={"ID":"a49425c2-b668-402c-a331-a35b773fe6c1","Type":"ContainerStarted","Data":"00418a123cfe17d3f0c188cc0ff50589885efc57845e6deb78cd25b605a32f5a"}
Jul 17 05:37:39.405230 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.405182    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gr9sn" podStartSLOduration=1.405166991 podStartE2EDuration="1.405166991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:39.404233597 +0000 UTC m=+277.867417701" watchObservedRunningTime="2026-07-17 05:37:39.405166991 +0000 UTC m=+277.868351095"
Jul 17 05:37:39.929929 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.929894    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"]
Jul 17 05:37:39.947943 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.947917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"]
Jul 17 05:37:39.948085 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.948032    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:39.950524 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.950502    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 05:37:39.951440 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.951424    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 05:37:39.951558 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:39.951444    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrtsw\""
Jul 17 05:37:40.054122 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.054077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.054297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.054133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.054297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.054162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52qn2\" (UniqueName: \"kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.154636 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.154603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.154835 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.154648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.154835 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.154698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52qn2\" (UniqueName: \"kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.155061 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.155043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.155102 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.155066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.162185 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.162162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52qn2\" (UniqueName: \"kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.264331 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.264280    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:40.390919 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:40.390888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"]
Jul 17 05:37:40.392500 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:40.392469    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4097a8df_f4e7_4a50_b00c_ad65a70ebe61.slice/crio-c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4 WatchSource:0}: Error finding container c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4: Status 404 returned error can't find the container with id c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4
Jul 17 05:37:41.399331 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:41.399292    2567 generic.go:356] "Generic (PLEG): container finished" podID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerID="e299c9f4ffe2175fa038e9f7753f317731fba786456665d8ac676e63e3b1534a" exitCode=0
Jul 17 05:37:41.399726 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:41.399343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn" event={"ID":"4097a8df-f4e7-4a50-b00c-ad65a70ebe61","Type":"ContainerDied","Data":"e299c9f4ffe2175fa038e9f7753f317731fba786456665d8ac676e63e3b1534a"}
Jul 17 05:37:41.399726 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:41.399386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn" event={"ID":"4097a8df-f4e7-4a50-b00c-ad65a70ebe61","Type":"ContainerStarted","Data":"c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4"}
Jul 17 05:37:42.405502 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:42.405473    2567 generic.go:356] "Generic (PLEG): container finished" podID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerID="469ca198e597636cf2e892ba64be69f334e19c7bb633c99b6d708f7daf2fb345" exitCode=0
Jul 17 05:37:42.405907 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:42.405559    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn" event={"ID":"4097a8df-f4e7-4a50-b00c-ad65a70ebe61","Type":"ContainerDied","Data":"469ca198e597636cf2e892ba64be69f334e19c7bb633c99b6d708f7daf2fb345"}
Jul 17 05:37:43.411919 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:43.411885    2567 generic.go:356] "Generic (PLEG): container finished" podID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerID="a2f91309d8408b8da8aa23c10f824e6f3b0cc6576feeca14450f63085857c983" exitCode=0
Jul 17 05:37:43.412293 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:43.411972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn" event={"ID":"4097a8df-f4e7-4a50-b00c-ad65a70ebe61","Type":"ContainerDied","Data":"a2f91309d8408b8da8aa23c10f824e6f3b0cc6576feeca14450f63085857c983"}
Jul 17 05:37:44.547960 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.547937    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:44.590654 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.590627    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle\") pod \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") "
Jul 17 05:37:44.590806 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.590714    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util\") pod \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") "
Jul 17 05:37:44.590806 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.590739    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52qn2\" (UniqueName: \"kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2\") pod \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\" (UID: \"4097a8df-f4e7-4a50-b00c-ad65a70ebe61\") "
Jul 17 05:37:44.591323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.591296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle" (OuterVolumeSpecName: "bundle") pod "4097a8df-f4e7-4a50-b00c-ad65a70ebe61" (UID: "4097a8df-f4e7-4a50-b00c-ad65a70ebe61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:44.592903 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.592874    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2" (OuterVolumeSpecName: "kube-api-access-52qn2") pod "4097a8df-f4e7-4a50-b00c-ad65a70ebe61" (UID: "4097a8df-f4e7-4a50-b00c-ad65a70ebe61"). InnerVolumeSpecName "kube-api-access-52qn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:37:44.596130 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.596112    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util" (OuterVolumeSpecName: "util") pod "4097a8df-f4e7-4a50-b00c-ad65a70ebe61" (UID: "4097a8df-f4e7-4a50-b00c-ad65a70ebe61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:44.691945 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.691922    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:44.692082 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.691946    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52qn2\" (UniqueName: \"kubernetes.io/projected/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-kube-api-access-52qn2\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:44.692082 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:44.691958    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4097a8df-f4e7-4a50-b00c-ad65a70ebe61-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:37:45.422199 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:45.422163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn" event={"ID":"4097a8df-f4e7-4a50-b00c-ad65a70ebe61","Type":"ContainerDied","Data":"c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4"}
Jul 17 05:37:45.422199 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:45.422200    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm4htn"
Jul 17 05:37:45.422368 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:45.422219    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c76a1faa6895c892e09b4d61df614a7265057834ffcbb9567004bb67048455e4"
Jul 17 05:37:51.052280 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052244    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"]
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052547    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="extract"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052558    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="extract"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052569    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="pull"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052576    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="pull"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052590    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="util"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052596    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="util"
Jul 17 05:37:51.052751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.052654    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4097a8df-f4e7-4a50-b00c-ad65a70ebe61" containerName="extract"
Jul 17 05:37:51.058581 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.058555    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.060905 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.060880    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 05:37:51.060905 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.060898    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 05:37:51.061074 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.061060    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jtkvf\""
Jul 17 05:37:51.061211 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.061193    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 05:37:51.061315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.061237    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 05:37:51.077083 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.077060    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"]
Jul 17 05:37:51.144237 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.144206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.144400 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.144376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.144446 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.144418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.144534 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.144516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446fk\" (UniqueName: \"kubernetes.io/projected/524c1673-0d90-4752-bdba-c749ca935f94-kube-api-access-446fk\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.144570 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.144555    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245218 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245397 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245397 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245397 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446fk\" (UniqueName: \"kubernetes.io/projected/524c1673-0d90-4752-bdba-c749ca935f94-kube-api-access-446fk\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245397 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.245756 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.245725    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.247550 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.247528    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524c1673-0d90-4752-bdba-c749ca935f94-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.247766 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.247748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.247819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.247749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524c1673-0d90-4752-bdba-c749ca935f94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.252690 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.252654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-446fk\" (UniqueName: \"kubernetes.io/projected/524c1673-0d90-4752-bdba-c749ca935f94-kube-api-access-446fk\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-cjchn\" (UID: \"524c1673-0d90-4752-bdba-c749ca935f94\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.369201 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.369127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:51.506460 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:51.506439    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"]
Jul 17 05:37:51.509170 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:37:51.509131    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524c1673_0d90_4752_bdba_c749ca935f94.slice/crio-79c88250f84e46d531e8fa04f8363f99d61e20fa35446cb072e3c39d4d116465 WatchSource:0}: Error finding container 79c88250f84e46d531e8fa04f8363f99d61e20fa35446cb072e3c39d4d116465: Status 404 returned error can't find the container with id 79c88250f84e46d531e8fa04f8363f99d61e20fa35446cb072e3c39d4d116465
Jul 17 05:37:52.459550 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:52.459518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn" event={"ID":"524c1673-0d90-4752-bdba-c749ca935f94","Type":"ContainerStarted","Data":"79c88250f84e46d531e8fa04f8363f99d61e20fa35446cb072e3c39d4d116465"}
Jul 17 05:37:55.477871 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:55.477833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn" event={"ID":"524c1673-0d90-4752-bdba-c749ca935f94","Type":"ContainerStarted","Data":"3ba4c4a0e352c6959d7425338c6d4e0c036c02a2d55220d791445bfc3d5aae03"}
Jul 17 05:37:56.483875 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:56.483842    2567 generic.go:356] "Generic (PLEG): container finished" podID="524c1673-0d90-4752-bdba-c749ca935f94" containerID="3ba4c4a0e352c6959d7425338c6d4e0c036c02a2d55220d791445bfc3d5aae03" exitCode=0
Jul 17 05:37:56.484350 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:56.483887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn" event={"ID":"524c1673-0d90-4752-bdba-c749ca935f94","Type":"ContainerDied","Data":"3ba4c4a0e352c6959d7425338c6d4e0c036c02a2d55220d791445bfc3d5aae03"}
Jul 17 05:37:57.490069 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:57.490037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn" event={"ID":"524c1673-0d90-4752-bdba-c749ca935f94","Type":"ContainerStarted","Data":"1f395573d34a8e35304edb2e5272dc144918aaaac550894521347f118153a392"}
Jul 17 05:37:57.490500 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:57.490165    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:37:57.513485 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:37:57.513431    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn" podStartSLOduration=2.108602105 podStartE2EDuration="6.513414373s" totalImagesPullingTime="3.36585158s" totalInitContainerRuntime="1.038960688s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:57.511573101 +0000 UTC m=+295.974757207" watchObservedRunningTime="2026-07-17 05:37:57.513414373 +0000 UTC m=+295.976598477"
Jul 17 05:38:01.961872 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:01.961835    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:38:01.962349 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:01.962331    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:38:01.968533 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:01.968513    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 05:38:08.496611 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:08.496580    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-cjchn"
Jul 17 05:38:10.724106 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.724071    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"]
Jul 17 05:38:10.727325 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.727309    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.729719 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.729699    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 05:38:10.729828 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.729704    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 05:38:10.730843 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.730829    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 05:38:10.730934 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.730845    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mkh8b\""
Jul 17 05:38:10.730934 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.730885    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:38:10.730934 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.730902    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 05:38:10.735767 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.735740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"]
Jul 17 05:38:10.825601 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.825569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-metrics-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.825801 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.825637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-manager-config\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.825801 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.825675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfml\" (UniqueName: \"kubernetes.io/projected/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-kube-api-access-wkfml\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.825801 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.825721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.927307 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.927268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.927489 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.927331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-metrics-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.927489 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.927426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-manager-config\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.927489 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.927479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfml\" (UniqueName: \"kubernetes.io/projected/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-kube-api-access-wkfml\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.928387 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.928357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-manager-config\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.929986 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.929959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-metrics-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.930227 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.930204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-cert\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:10.944817 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:10.944792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfml\" (UniqueName: \"kubernetes.io/projected/0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6-kube-api-access-wkfml\") pod \"lws-controller-manager-6687b4bb84-ksj5k\" (UID: \"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6\") " pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:11.037038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:11.036954    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:11.174200 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:11.174174    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"]
Jul 17 05:38:11.176235 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:38:11.176212    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2571a4_0913_4dd5_a5d1_fd22bedc1cb6.slice/crio-4dd189ed63fd90a07b5d6ba48aed9f733fb5795f97c6c8843e3034f452afa050 WatchSource:0}: Error finding container 4dd189ed63fd90a07b5d6ba48aed9f733fb5795f97c6c8843e3034f452afa050: Status 404 returned error can't find the container with id 4dd189ed63fd90a07b5d6ba48aed9f733fb5795f97c6c8843e3034f452afa050
Jul 17 05:38:11.178224 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:11.178204    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:38:11.556185 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:11.556154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k" event={"ID":"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6","Type":"ContainerStarted","Data":"4dd189ed63fd90a07b5d6ba48aed9f733fb5795f97c6c8843e3034f452afa050"}
Jul 17 05:38:13.568056 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:13.568024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k" event={"ID":"0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6","Type":"ContainerStarted","Data":"5ce60527585da26a161ddb0e73f11644886deae651efc685ef041a5a4a0b3c32"}
Jul 17 05:38:13.568521 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:13.568145    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:38:13.584582 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:13.584538    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k" podStartSLOduration=2.035318994 podStartE2EDuration="3.584523056s" totalImagesPullingTime="1.549204062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:13.583257601 +0000 UTC m=+312.046441706" watchObservedRunningTime="2026-07-17 05:38:13.584523056 +0000 UTC m=+312.047707220"
Jul 17 05:38:18.566961 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.566921    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"]
Jul 17 05:38:18.570511 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.570488    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.573206 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 05:38:18.573329 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573185    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 05:38:18.573329 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6d4db\""
Jul 17 05:38:18.573452 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573332    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 05:38:18.573452 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573437    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 05:38:18.573556 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573453    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 05:38:18.573735 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.573716    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 05:38:18.585145 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.585121    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"]
Jul 17 05:38:18.594845 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.594971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef0f3a8-46ff-4498-92e8-01fcc11082b4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.594971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.594971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.594971 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.595116 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.594988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trk7\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-kube-api-access-9trk7\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.595116 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.595098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695746 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef0f3a8-46ff-4498-92e8-01fcc11082b4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.695926 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.695897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trk7\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-kube-api-access-9trk7\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.697799 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.697765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.698659 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.698629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.698796 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.698635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.698796 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.698716    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef0f3a8-46ff-4498-92e8-01fcc11082b4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.698908 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.698844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.703313 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.703285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.704772 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.704736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trk7\" (UniqueName: \"kubernetes.io/projected/eef0f3a8-46ff-4498-92e8-01fcc11082b4-kube-api-access-9trk7\") pod \"istiod-openshift-gateway-94bb8fbfd-rb4wh\" (UID: \"eef0f3a8-46ff-4498-92e8-01fcc11082b4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:18.880525 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:18.880434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:19.018719 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:19.018692    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"]
Jul 17 05:38:19.021059 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:38:19.021030    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef0f3a8_46ff_4498_92e8_01fcc11082b4.slice/crio-bfa12e4d2b0d230ca2e83ed39e06f12c84ddd2703d4b133f27cba12a1b9f76ca WatchSource:0}: Error finding container bfa12e4d2b0d230ca2e83ed39e06f12c84ddd2703d4b133f27cba12a1b9f76ca: Status 404 returned error can't find the container with id bfa12e4d2b0d230ca2e83ed39e06f12c84ddd2703d4b133f27cba12a1b9f76ca
Jul 17 05:38:19.601475 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:19.601399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh" event={"ID":"eef0f3a8-46ff-4498-92e8-01fcc11082b4","Type":"ContainerStarted","Data":"bfa12e4d2b0d230ca2e83ed39e06f12c84ddd2703d4b133f27cba12a1b9f76ca"}
Jul 17 05:38:21.229412 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:21.229375    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 05:38:21.229674 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:21.229446    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 05:38:21.616950 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:21.616812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh" event={"ID":"eef0f3a8-46ff-4498-92e8-01fcc11082b4","Type":"ContainerStarted","Data":"62a8eee8337ca2baa526f4559796f6220413bc003b67fdd78a913c72300476c1"}
Jul 17 05:38:21.616950 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:21.616903    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:21.641002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:21.640950    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh" podStartSLOduration=1.435014829 podStartE2EDuration="3.640934143s" totalImagesPullingTime="2.205919314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:21.638990325 +0000 UTC m=+320.102174429" watchObservedRunningTime="2026-07-17 05:38:21.640934143 +0000 UTC m=+320.104118247"
Jul 17 05:38:22.623912 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:22.623881    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rb4wh"
Jul 17 05:38:24.575213 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:38:24.575178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6687b4bb84-ksj5k"
Jul 17 05:39:28.013135 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.013057    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"]
Jul 17 05:39:28.016645 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.016626    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.018916 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.018896    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 05:39:28.019736 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.019717    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 05:39:28.019843 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.019719    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mmw6m\""
Jul 17 05:39:28.024731 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.024625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"]
Jul 17 05:39:28.098729 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.098662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzs4\" (UniqueName: \"kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.098904 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.098744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.098904 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.098783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.200046 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.200013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzs4\" (UniqueName: \"kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.200212 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.200058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.200212 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.200095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.200420 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.200405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.200485 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.200468    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.208114 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.208084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzs4\" (UniqueName: \"kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.327664 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.327572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:28.459253 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.459230    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"]
Jul 17 05:39:28.461351 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:39:28.461320    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42833256_4c78_41a9_bb16_6b7fb95eee71.slice/crio-cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430 WatchSource:0}: Error finding container cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430: Status 404 returned error can't find the container with id cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430
Jul 17 05:39:28.605229 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.605161    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"]
Jul 17 05:39:28.608559 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.608538    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.616690 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.616649    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"]
Jul 17 05:39:28.704670 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.704636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcr2m\" (UniqueName: \"kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.704880 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.704784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.704880 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.704847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.805621 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.805586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.805813 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.805644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.805813 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.805705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcr2m\" (UniqueName: \"kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.806041 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.806024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.806113 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.806091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.814409 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.814387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcr2m\" (UniqueName: \"kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:28.935987 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.935904    2567 generic.go:356] "Generic (PLEG): container finished" podID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerID="c290e2af9e4f63a0a7ebffcacc2e3dad3c1a555f0f82f3c6bd19e737ce642be2" exitCode=0
Jul 17 05:39:28.936132 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.935988    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq" event={"ID":"42833256-4c78-41a9-bb16-6b7fb95eee71","Type":"ContainerDied","Data":"c290e2af9e4f63a0a7ebffcacc2e3dad3c1a555f0f82f3c6bd19e737ce642be2"}
Jul 17 05:39:28.936132 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.936038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq" event={"ID":"42833256-4c78-41a9-bb16-6b7fb95eee71","Type":"ContainerStarted","Data":"cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430"}
Jul 17 05:39:28.948943 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:28.948923    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:29.009323 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.009294    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"]
Jul 17 05:39:29.020192 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.020158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.021481 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.021452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"]
Jul 17 05:39:29.087280 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.087256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"]
Jul 17 05:39:29.088799 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:39:29.088768    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53285704_cfe5_413a_8377_f4fccf17b9f0.slice/crio-eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc WatchSource:0}: Error finding container eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc: Status 404 returned error can't find the container with id eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc
Jul 17 05:39:29.107311 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.107285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtj9d\" (UniqueName: \"kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.107435 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.107320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.107435 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.107376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.208392 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.208366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtj9d\" (UniqueName: \"kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.208549 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.208414    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.208549 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.208468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.208891 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.208865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.208989 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.208904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.216145 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.216125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtj9d\" (UniqueName: \"kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.330186 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.330151    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:29.408552 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.408517    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"]
Jul 17 05:39:29.412354 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.412332    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.420856 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.420793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"]
Jul 17 05:39:29.470016 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.469994    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"]
Jul 17 05:39:29.472135 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:39:29.472103    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d8c185_a108_4a57_b0c7_070093642a06.slice/crio-aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c WatchSource:0}: Error finding container aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c: Status 404 returned error can't find the container with id aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c
Jul 17 05:39:29.521513 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.521077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.521513 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.521124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.521513 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.521163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.621904 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.621876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.622050 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.621909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.622050 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.621948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.622221 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.622201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.622351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.622326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.631426 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.631398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.726315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.726267    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:29.861564 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.861541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"]
Jul 17 05:39:29.864058 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:39:29.864031    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d88cdfb_cbed_44d1_bc4b_729b1083a824.slice/crio-86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58 WatchSource:0}: Error finding container 86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58: Status 404 returned error can't find the container with id 86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58
Jul 17 05:39:29.943402 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.943368    2567 generic.go:356] "Generic (PLEG): container finished" podID="c4d8c185-a108-4a57-b0c7-070093642a06" containerID="98787781081ac6d0d5189ee0242d8ecfe31e1bcfdc58da684ecf2df7b3af73a4" exitCode=0
Jul 17 05:39:29.943548 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.943437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96" event={"ID":"c4d8c185-a108-4a57-b0c7-070093642a06","Type":"ContainerDied","Data":"98787781081ac6d0d5189ee0242d8ecfe31e1bcfdc58da684ecf2df7b3af73a4"}
Jul 17 05:39:29.943548 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.943506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96" event={"ID":"c4d8c185-a108-4a57-b0c7-070093642a06","Type":"ContainerStarted","Data":"aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c"}
Jul 17 05:39:29.945099 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.945045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerStarted","Data":"fc11ce0eca95263ce9e6386df3022ad8c848fc50eb476b9571a2dcafe01dc1dd"}
Jul 17 05:39:29.945099 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.945094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerStarted","Data":"86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58"}
Jul 17 05:39:29.946478 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.946456    2567 generic.go:356] "Generic (PLEG): container finished" podID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerID="922f109e4950d85447c10b578ac762aedd823f633f0ec11f07e3f7fa9779541c" exitCode=0
Jul 17 05:39:29.946603 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.946527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d" event={"ID":"53285704-cfe5-413a-8377-f4fccf17b9f0","Type":"ContainerDied","Data":"922f109e4950d85447c10b578ac762aedd823f633f0ec11f07e3f7fa9779541c"}
Jul 17 05:39:29.946603 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.946584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d" event={"ID":"53285704-cfe5-413a-8377-f4fccf17b9f0","Type":"ContainerStarted","Data":"eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc"}
Jul 17 05:39:29.948856 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.948832    2567 generic.go:356] "Generic (PLEG): container finished" podID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerID="b857d134231958fe9ac17bd4f2a67b34f1ceed129cb6b9302d69880b457ff4f4" exitCode=0
Jul 17 05:39:29.948981 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:29.948920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq" event={"ID":"42833256-4c78-41a9-bb16-6b7fb95eee71","Type":"ContainerDied","Data":"b857d134231958fe9ac17bd4f2a67b34f1ceed129cb6b9302d69880b457ff4f4"}
Jul 17 05:39:30.956206 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.956178    2567 generic.go:356] "Generic (PLEG): container finished" podID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerID="8666830916d34ddc8261f531d79b7888d71385464ee9fa723a5042c19618e6bf" exitCode=0
Jul 17 05:39:30.956587 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.956268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq" event={"ID":"42833256-4c78-41a9-bb16-6b7fb95eee71","Type":"ContainerDied","Data":"8666830916d34ddc8261f531d79b7888d71385464ee9fa723a5042c19618e6bf"}
Jul 17 05:39:30.958072 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.958047    2567 generic.go:356] "Generic (PLEG): container finished" podID="c4d8c185-a108-4a57-b0c7-070093642a06" containerID="ae23e06c44b5714d906dde4a2d4168e4cb7c255eedf67a6bf787dd4cb39b2fa8" exitCode=0
Jul 17 05:39:30.958196 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.958117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96" event={"ID":"c4d8c185-a108-4a57-b0c7-070093642a06","Type":"ContainerDied","Data":"ae23e06c44b5714d906dde4a2d4168e4cb7c255eedf67a6bf787dd4cb39b2fa8"}
Jul 17 05:39:30.959749 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.959724    2567 generic.go:356] "Generic (PLEG): container finished" podID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerID="fc11ce0eca95263ce9e6386df3022ad8c848fc50eb476b9571a2dcafe01dc1dd" exitCode=0
Jul 17 05:39:30.959847 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:30.959757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerDied","Data":"fc11ce0eca95263ce9e6386df3022ad8c848fc50eb476b9571a2dcafe01dc1dd"}
Jul 17 05:39:31.967042 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.967005    2567 generic.go:356] "Generic (PLEG): container finished" podID="c4d8c185-a108-4a57-b0c7-070093642a06" containerID="be9961c0bfa26cacbd6ea9c474a76356f0c8e46824803bf61f7664475648b3fb" exitCode=0
Jul 17 05:39:31.967441 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.967090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96" event={"ID":"c4d8c185-a108-4a57-b0c7-070093642a06","Type":"ContainerDied","Data":"be9961c0bfa26cacbd6ea9c474a76356f0c8e46824803bf61f7664475648b3fb"}
Jul 17 05:39:31.968889 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.968867    2567 generic.go:356] "Generic (PLEG): container finished" podID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerID="88cac369d420156f226134ce3079b4d1e0691dd5e903d9dd85fb6a35b89da168" exitCode=0
Jul 17 05:39:31.968998 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.968938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerDied","Data":"88cac369d420156f226134ce3079b4d1e0691dd5e903d9dd85fb6a35b89da168"}
Jul 17 05:39:31.970741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.970722    2567 generic.go:356] "Generic (PLEG): container finished" podID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerID="9b1aa642ebb81c2ced0059699817f8c3ddf63d124769d1584d34412d59e5a3d6" exitCode=0
Jul 17 05:39:31.970834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:31.970783    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d" event={"ID":"53285704-cfe5-413a-8377-f4fccf17b9f0","Type":"ContainerDied","Data":"9b1aa642ebb81c2ced0059699817f8c3ddf63d124769d1584d34412d59e5a3d6"}
Jul 17 05:39:32.101416 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.101389    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:32.247800 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.247771    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util\") pod \"42833256-4c78-41a9-bb16-6b7fb95eee71\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") "
Jul 17 05:39:32.247901 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.247822    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle\") pod \"42833256-4c78-41a9-bb16-6b7fb95eee71\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") "
Jul 17 05:39:32.247972 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.247958    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqzs4\" (UniqueName: \"kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4\") pod \"42833256-4c78-41a9-bb16-6b7fb95eee71\" (UID: \"42833256-4c78-41a9-bb16-6b7fb95eee71\") "
Jul 17 05:39:32.248364 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.248340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle" (OuterVolumeSpecName: "bundle") pod "42833256-4c78-41a9-bb16-6b7fb95eee71" (UID: "42833256-4c78-41a9-bb16-6b7fb95eee71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:32.250369 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.250330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4" (OuterVolumeSpecName: "kube-api-access-nqzs4") pod "42833256-4c78-41a9-bb16-6b7fb95eee71" (UID: "42833256-4c78-41a9-bb16-6b7fb95eee71"). InnerVolumeSpecName "kube-api-access-nqzs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:39:32.253415 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.253392    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util" (OuterVolumeSpecName: "util") pod "42833256-4c78-41a9-bb16-6b7fb95eee71" (UID: "42833256-4c78-41a9-bb16-6b7fb95eee71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:32.349125 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.349096    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqzs4\" (UniqueName: \"kubernetes.io/projected/42833256-4c78-41a9-bb16-6b7fb95eee71-kube-api-access-nqzs4\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:32.349125 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.349124    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:32.349125 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.349134    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42833256-4c78-41a9-bb16-6b7fb95eee71-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:32.977829 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.977799    2567 generic.go:356] "Generic (PLEG): container finished" podID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerID="c0580953914d552a3bb548445950fc99f8322d4e058b8ae7ad7f692eccd94166" exitCode=0
Jul 17 05:39:32.978269 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.977878    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerDied","Data":"c0580953914d552a3bb548445950fc99f8322d4e058b8ae7ad7f692eccd94166"}
Jul 17 05:39:32.979935 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.979913    2567 generic.go:356] "Generic (PLEG): container finished" podID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerID="ed889e9290be44fe59d89f8ba5d286e152a3333d01c4fafed5f55e6e924e281a" exitCode=0
Jul 17 05:39:32.980074 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.979990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d" event={"ID":"53285704-cfe5-413a-8377-f4fccf17b9f0","Type":"ContainerDied","Data":"ed889e9290be44fe59d89f8ba5d286e152a3333d01c4fafed5f55e6e924e281a"}
Jul 17 05:39:32.981835 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.981813    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq"
Jul 17 05:39:32.981918 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.981850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq" event={"ID":"42833256-4c78-41a9-bb16-6b7fb95eee71","Type":"ContainerDied","Data":"cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430"}
Jul 17 05:39:32.981918 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:32.981880    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc69f100acd469ab04d7886e314eabf4d5893ead4c3f8fde3981c6bf7cf5b430"
Jul 17 05:39:33.117945 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.117920    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:33.255795 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.255704    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util\") pod \"c4d8c185-a108-4a57-b0c7-070093642a06\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") "
Jul 17 05:39:33.255795 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.255772    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtj9d\" (UniqueName: \"kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d\") pod \"c4d8c185-a108-4a57-b0c7-070093642a06\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") "
Jul 17 05:39:33.255795 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.255793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle\") pod \"c4d8c185-a108-4a57-b0c7-070093642a06\" (UID: \"c4d8c185-a108-4a57-b0c7-070093642a06\") "
Jul 17 05:39:33.256351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.256326    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle" (OuterVolumeSpecName: "bundle") pod "c4d8c185-a108-4a57-b0c7-070093642a06" (UID: "c4d8c185-a108-4a57-b0c7-070093642a06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:33.257938 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.257915    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d" (OuterVolumeSpecName: "kube-api-access-jtj9d") pod "c4d8c185-a108-4a57-b0c7-070093642a06" (UID: "c4d8c185-a108-4a57-b0c7-070093642a06"). InnerVolumeSpecName "kube-api-access-jtj9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:39:33.261126 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.261095    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util" (OuterVolumeSpecName: "util") pod "c4d8c185-a108-4a57-b0c7-070093642a06" (UID: "c4d8c185-a108-4a57-b0c7-070093642a06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:33.357115 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.357074    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:33.357115 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.357108    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtj9d\" (UniqueName: \"kubernetes.io/projected/c4d8c185-a108-4a57-b0c7-070093642a06-kube-api-access-jtj9d\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:33.357115 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.357119    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4d8c185-a108-4a57-b0c7-070093642a06-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:33.989505 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.989459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96" event={"ID":"c4d8c185-a108-4a57-b0c7-070093642a06","Type":"ContainerDied","Data":"aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c"}
Jul 17 05:39:33.990015 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.989521    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa0132f16082f539c3f0a29b7a8003552abf6a427017fba37e3ca4a8ba3b444c"
Jul 17 05:39:33.990015 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:33.989811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96"
Jul 17 05:39:34.149352 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.149328    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:34.151468 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.151452    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:34.264876 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.264803    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util\") pod \"53285704-cfe5-413a-8377-f4fccf17b9f0\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") "
Jul 17 05:39:34.264876 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.264857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq\") pod \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") "
Jul 17 05:39:34.265090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.264906    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle\") pod \"53285704-cfe5-413a-8377-f4fccf17b9f0\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") "
Jul 17 05:39:34.265090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.264944    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcr2m\" (UniqueName: \"kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m\") pod \"53285704-cfe5-413a-8377-f4fccf17b9f0\" (UID: \"53285704-cfe5-413a-8377-f4fccf17b9f0\") "
Jul 17 05:39:34.265090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.264963    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle\") pod \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") "
Jul 17 05:39:34.265090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.265034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util\") pod \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\" (UID: \"7d88cdfb-cbed-44d1-bc4b-729b1083a824\") "
Jul 17 05:39:34.265672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.265580    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle" (OuterVolumeSpecName: "bundle") pod "53285704-cfe5-413a-8377-f4fccf17b9f0" (UID: "53285704-cfe5-413a-8377-f4fccf17b9f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:34.265672 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.265587    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle" (OuterVolumeSpecName: "bundle") pod "7d88cdfb-cbed-44d1-bc4b-729b1083a824" (UID: "7d88cdfb-cbed-44d1-bc4b-729b1083a824"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:34.267207 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.267181    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m" (OuterVolumeSpecName: "kube-api-access-pcr2m") pod "53285704-cfe5-413a-8377-f4fccf17b9f0" (UID: "53285704-cfe5-413a-8377-f4fccf17b9f0"). InnerVolumeSpecName "kube-api-access-pcr2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:39:34.267469 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.267452    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq" (OuterVolumeSpecName: "kube-api-access-ntmwq") pod "7d88cdfb-cbed-44d1-bc4b-729b1083a824" (UID: "7d88cdfb-cbed-44d1-bc4b-729b1083a824"). InnerVolumeSpecName "kube-api-access-ntmwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:39:34.270969 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.270922    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util" (OuterVolumeSpecName: "util") pod "7d88cdfb-cbed-44d1-bc4b-729b1083a824" (UID: "7d88cdfb-cbed-44d1-bc4b-729b1083a824"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:34.271556 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.271539    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util" (OuterVolumeSpecName: "util") pod "53285704-cfe5-413a-8377-f4fccf17b9f0" (UID: "53285704-cfe5-413a-8377-f4fccf17b9f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366785    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366821    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcr2m\" (UniqueName: \"kubernetes.io/projected/53285704-cfe5-413a-8377-f4fccf17b9f0-kube-api-access-pcr2m\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366837    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366856    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d88cdfb-cbed-44d1-bc4b-729b1083a824-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366868    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53285704-cfe5-413a-8377-f4fccf17b9f0-util\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.371463 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.366881    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntmwq\" (UniqueName: \"kubernetes.io/projected/7d88cdfb-cbed-44d1-bc4b-729b1083a824-kube-api-access-ntmwq\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:39:34.996421 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.996390    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj"
Jul 17 05:39:34.996923 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.996385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj" event={"ID":"7d88cdfb-cbed-44d1-bc4b-729b1083a824","Type":"ContainerDied","Data":"86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58"}
Jul 17 05:39:34.996923 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.996564    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86026e2a9a32d1e7282b0200e88da132fd1e61c8639577ee510f2339d33c5d58"
Jul 17 05:39:34.998254 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.998236    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d"
Jul 17 05:39:34.998360 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.998260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d" event={"ID":"53285704-cfe5-413a-8377-f4fccf17b9f0","Type":"ContainerDied","Data":"eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc"}
Jul 17 05:39:34.998360 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:34.998294    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb8f6f2d61c513e06b615f2bc959d5bb7b4add8f995f2c41b1337400e67ba7fc"
Jul 17 05:39:57.209800 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:39:57.209765    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:40:22.230471 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.230427    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f8674c754-z865z" podUID="1aefc402-fe11-408a-9630-09f58a288549" containerName="console" containerID="cri-o://57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8" gracePeriod=15
Jul 17 05:40:22.486761 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.486675    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:40:22.595122 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595086    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m58kh\" (UniqueName: \"kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595136    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595153    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595169    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595224    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595248    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595315 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert\") pod \"1aefc402-fe11-408a-9630-09f58a288549\" (UID: \"1aefc402-fe11-408a-9630-09f58a288549\") "
Jul 17 05:40:22.595637 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595584    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca" (OuterVolumeSpecName: "service-ca") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:40:22.595637 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595622    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:40:22.595773 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595732    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config" (OuterVolumeSpecName: "console-config") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:40:22.595828 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.595811    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:40:22.597510 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.597489    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh" (OuterVolumeSpecName: "kube-api-access-m58kh") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "kube-api-access-m58kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:40:22.597618 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.597542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:40:22.597661 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.597646    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1aefc402-fe11-408a-9630-09f58a288549" (UID: "1aefc402-fe11-408a-9630-09f58a288549"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:40:22.696292 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696255    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m58kh\" (UniqueName: \"kubernetes.io/projected/1aefc402-fe11-408a-9630-09f58a288549-kube-api-access-m58kh\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696292 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696284    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-trusted-ca-bundle\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696292 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696294    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696522 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696303    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-console-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696522 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696311    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-oauth-config\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696522 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696319    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1aefc402-fe11-408a-9630-09f58a288549-console-serving-cert\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:22.696522 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:22.696327    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1aefc402-fe11-408a-9630-09f58a288549-oauth-serving-cert\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:40:23.245305 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.245269    2567 generic.go:356] "Generic (PLEG): container finished" podID="1aefc402-fe11-408a-9630-09f58a288549" containerID="57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8" exitCode=0
Jul 17 05:40:23.245805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.245340    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8674c754-z865z"
Jul 17 05:40:23.245805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.245356    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8674c754-z865z" event={"ID":"1aefc402-fe11-408a-9630-09f58a288549","Type":"ContainerDied","Data":"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"}
Jul 17 05:40:23.245805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.245408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8674c754-z865z" event={"ID":"1aefc402-fe11-408a-9630-09f58a288549","Type":"ContainerDied","Data":"1b3c5ae2d0a39eaec8c864e8e409782e32452fd28ddb70afd77a4165ccacb59e"}
Jul 17 05:40:23.245805 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.245428    2567 scope.go:117] "RemoveContainer" containerID="57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"
Jul 17 05:40:23.255814 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.255787    2567 scope.go:117] "RemoveContainer" containerID="57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"
Jul 17 05:40:23.256137 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:40:23.256109    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8\": container with ID starting with 57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8 not found: ID does not exist" containerID="57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"
Jul 17 05:40:23.256237 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.256150    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8"} err="failed to get container status \"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8\": rpc error: code = NotFound desc = could not find container \"57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8\": container with ID starting with 57fdca988fe389456916e71dc40c7854436f1a9fb988609c380f5bd33687f6d8 not found: ID does not exist"
Jul 17 05:40:23.270492 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.270466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:40:23.277844 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:23.277818    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8674c754-z865z"]
Jul 17 05:40:24.020939 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:40:24.020906    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aefc402-fe11-408a-9630-09f58a288549" path="/var/lib/kubelet/pods/1aefc402-fe11-408a-9630-09f58a288549/volumes"
Jul 17 05:41:02.842452 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842417    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842803    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842814    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842824    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842830    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842841    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842849    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="extract"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842870    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="util"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842880    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="util"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842892    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="util"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842901    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="util"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842909    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="pull"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842913    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="pull"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842918    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aefc402-fe11-408a-9630-09f58a288549" containerName="console"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842923    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aefc402-fe11-408a-9630-09f58a288549" containerName="console"
Jul 17 05:41:02.842928 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842933    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="util"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842939    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="util"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842948    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="extract"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842953    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="extract"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842961    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="util"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842966    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="util"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842971    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842977    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842983    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842987    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842993    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.842998    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="pull"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.843054    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4d8c185-a108-4a57-b0c7-070093642a06" containerName="extract"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.843061    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d88cdfb-cbed-44d1-bc4b-729b1083a824" containerName="extract"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.843069    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aefc402-fe11-408a-9630-09f58a288549" containerName="console"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.843076    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42833256-4c78-41a9-bb16-6b7fb95eee71" containerName="extract"
Jul 17 05:41:02.843431 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.843081    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="53285704-cfe5-413a-8377-f4fccf17b9f0" containerName="extract"
Jul 17 05:41:02.846273 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.846258    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:02.848859 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.848832    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 05:41:02.849002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.848875    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 05:41:02.849002 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.848880    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 05:41:02.849736 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.849723    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mmw6m\""
Jul 17 05:41:02.855560 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.855535    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:41:02.885338 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.885299    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:41:02.959778 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.959743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8szr\" (UniqueName: \"kubernetes.io/projected/3a33fff3-ea18-4ffa-9cb5-16100f96c070-kube-api-access-t8szr\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:02.959962 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:02.959864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a33fff3-ea18-4ffa-9cb5-16100f96c070-config-file\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.060297 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.060263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8szr\" (UniqueName: \"kubernetes.io/projected/3a33fff3-ea18-4ffa-9cb5-16100f96c070-kube-api-access-t8szr\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.060474 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.060350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a33fff3-ea18-4ffa-9cb5-16100f96c070-config-file\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.060973 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.060954    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a33fff3-ea18-4ffa-9cb5-16100f96c070-config-file\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.068087 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.068054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8szr\" (UniqueName: \"kubernetes.io/projected/3a33fff3-ea18-4ffa-9cb5-16100f96c070-kube-api-access-t8szr\") pod \"limitador-limitador-54d6d988d5-w29xv\" (UID: \"3a33fff3-ea18-4ffa-9cb5-16100f96c070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.157735 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.157619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:03.293012 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.292984    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:41:03.451231 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:03.451198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv" event={"ID":"3a33fff3-ea18-4ffa-9cb5-16100f96c070","Type":"ContainerStarted","Data":"4af2460efe2be35a49444d32ff56b8f3959bc215deaf36cba3c0f009f5676e6c"}
Jul 17 05:41:06.472369 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:06.472334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv" event={"ID":"3a33fff3-ea18-4ffa-9cb5-16100f96c070","Type":"ContainerStarted","Data":"36c100ce04b0672b3c2a518b32ffbed4347fbb3020dbf7875188aacd650eef1a"}
Jul 17 05:41:06.472786 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:06.472400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:41:06.487367 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:06.487316    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv" podStartSLOduration=1.989204388 podStartE2EDuration="4.487299344s" totalImagesPullingTime="2.498094956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:06.486236786 +0000 UTC m=+484.949420890" watchObservedRunningTime="2026-07-17 05:41:06.487299344 +0000 UTC m=+484.950483447"
Jul 17 05:41:17.479457 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:41:17.479427    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-w29xv"
Jul 17 05:42:16.039594 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:16.039501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:42:35.120747 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.120714    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"]
Jul 17 05:42:35.124244 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.124228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.126838 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.126819    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 05:42:35.127563 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.127544    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vzdzz\""
Jul 17 05:42:35.127651 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.127569    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 05:42:35.127651 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.127551    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 05:42:35.136211 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.136183    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"]
Jul 17 05:42:35.260810 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.260775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.260810 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.260815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.261070 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.260894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.261070 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.260948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.261070 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.260999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svm2g\" (UniqueName: \"kubernetes.io/projected/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-kube-api-access-svm2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.261070 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.261036    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362136 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362136 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362387 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362276    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362387 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362387 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svm2g\" (UniqueName: \"kubernetes.io/projected/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-kube-api-access-svm2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362533 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362647 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362755 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362725    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.362879 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.362810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.364489 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.364470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.364779 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.364763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.370335 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.370315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svm2g\" (UniqueName: \"kubernetes.io/projected/04eeba1b-609d-4c89-a32d-e1eaac7b3cae-kube-api-access-svm2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t\" (UID: \"04eeba1b-609d-4c89-a32d-e1eaac7b3cae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.435107 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.435010    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:35.570051 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.570023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"]
Jul 17 05:42:35.571724 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:42:35.571700    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04eeba1b_609d_4c89_a32d_e1eaac7b3cae.slice/crio-b859ff9b287d4eb75f556a369ad5fc56728a4225a8073cf8dafbc5d291339140 WatchSource:0}: Error finding container b859ff9b287d4eb75f556a369ad5fc56728a4225a8073cf8dafbc5d291339140: Status 404 returned error can't find the container with id b859ff9b287d4eb75f556a369ad5fc56728a4225a8073cf8dafbc5d291339140
Jul 17 05:42:35.817145 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.817112    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:42:35.929703 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:35.929645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t" event={"ID":"04eeba1b-609d-4c89-a32d-e1eaac7b3cae","Type":"ContainerStarted","Data":"b859ff9b287d4eb75f556a369ad5fc56728a4225a8073cf8dafbc5d291339140"}
Jul 17 05:42:36.936415 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:36.936381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t" event={"ID":"04eeba1b-609d-4c89-a32d-e1eaac7b3cae","Type":"ContainerStarted","Data":"6361c785299026654a1847adb9c581f5b82bee7b4baabf707031aed02ca44eaa"}
Jul 17 05:42:36.955390 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:36.955336    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t" podStartSLOduration=0.820921578 podStartE2EDuration="1.955319891s" totalImagesPullingTime="1.134398313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:36.954016185 +0000 UTC m=+575.417200289" watchObservedRunningTime="2026-07-17 05:42:36.955319891 +0000 UTC m=+575.418503973"
Jul 17 05:42:45.435478 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:45.435431    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:45.435943 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:45.435524    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:45.447997 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:45.447973    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:45.999496 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:45.999465    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t"
Jul 17 05:42:52.012556 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:42:52.012518    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:43:02.005109 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:02.005081    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:43:02.005542 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:02.005359    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:43:12.020774 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:12.020746    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:43:17.920659 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:17.920622    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:43:23.221237 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:23.221161    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:43:33.017204 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:43:33.017171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:45:00.145595 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.145512    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"]
Jul 17 05:45:00.148919 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.148903    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"
Jul 17 05:45:00.151597 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.151571    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 05:45:00.155816 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.155793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"]
Jul 17 05:45:00.160834 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.160810    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"
Jul 17 05:45:00.302528 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.302505    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"]
Jul 17 05:45:00.304870 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:45:00.304844    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2387dbb_f6be_4e94_b754_48abfad0676a.slice/crio-462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637 WatchSource:0}: Error finding container 462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637: Status 404 returned error can't find the container with id 462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637
Jul 17 05:45:00.306764 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.306750    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:45:00.692335 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:00.692299    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss" event={"ID":"c2387dbb-f6be-4e94-b754-48abfad0676a","Type":"ContainerStarted","Data":"462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637"}
Jul 17 05:45:03.711621 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:03.711585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss" event={"ID":"c2387dbb-f6be-4e94-b754-48abfad0676a","Type":"ContainerStarted","Data":"95aeafb7e89d9c976a88f2505b5b7be9ce96a1af28a9eda97ee1c2b6fb8f44c7"}
Jul 17 05:45:03.727859 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:03.727809    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss" podStartSLOduration=1.187263442 podStartE2EDuration="3.727792246s" totalImagesPullingTime="2.540528804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:45:03.726702159 +0000 UTC m=+722.189886258" watchObservedRunningTime="2026-07-17 05:45:03.727792246 +0000 UTC m=+722.190976366"
Jul 17 05:45:04.718566 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:04.718532    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2387dbb-f6be-4e94-b754-48abfad0676a" containerID="95aeafb7e89d9c976a88f2505b5b7be9ce96a1af28a9eda97ee1c2b6fb8f44c7" exitCode=0
Jul 17 05:45:04.718995 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:04.718621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss" event={"ID":"c2387dbb-f6be-4e94-b754-48abfad0676a","Type":"ContainerDied","Data":"95aeafb7e89d9c976a88f2505b5b7be9ce96a1af28a9eda97ee1c2b6fb8f44c7"}
Jul 17 05:45:05.856230 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:05.856199    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"
Jul 17 05:45:06.730149 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:06.730119    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"
Jul 17 05:45:06.730319 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:06.730117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss" event={"ID":"c2387dbb-f6be-4e94-b754-48abfad0676a","Type":"ContainerDied","Data":"462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637"}
Jul 17 05:45:06.730319 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:06.730247    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="462145fb4a0ac1dd14452f02b0ce459c2271f8cc20d50d72d899f15e95058637"
Jul 17 05:45:07.628714 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:07.628663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:45:17.937961 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:17.937923    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:45:29.234843 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:45:29.234806    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:47:09.312794 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:47:09.312762    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:47:47.616457 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:47:47.616415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:47:55.711648 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:47:55.711561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:02.040413 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:02.040387    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:48:02.042960 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:02.042940    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:48:06.723113 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:06.723073    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:16.217038 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:16.217007    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:25.119454 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:25.119419    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:35.015425 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:35.015388    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:46.818122 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:46.818085    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:48:57.318951 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:48:57.318912    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:49:19.219576 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:49:19.219540    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:49:28.718351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:49:28.718244    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:49:51.109269 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:49:51.109231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:01.730876 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:01.730838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:18.823578 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:18.823541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:28.626773 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:28.626743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:38.419435 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:38.419397    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:48.223329 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:48.223289    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:50:58.759900 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:50:58.759806    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:52:48.612276 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:52:48.612234    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:52:57.718169 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:52:57.718123    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:53:02.077721 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:02.077674    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:53:02.081896 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:02.081875    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:53:10.521348 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:10.521305    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:53:22.526136 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:22.526097    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:53:32.411366 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:32.411319    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:53:44.628670 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:44.628631    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:53:53.122727 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:53:53.122624    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:54:04.215761 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:54:04.215720    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:54:13.719699 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:54:13.719646    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:54:24.516555 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:54:24.516511    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:54:36.918860 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:54:36.918825    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:54:58.818902 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:54:58.818864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:55:07.926917 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:55:07.926877    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:55:17.817819 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:55:17.817776    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:55:30.510673 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:55:30.510579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:55:46.523237 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:55:46.523203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:55:56.222829 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:55:56.222779    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:06.222102 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:06.222067    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:15.421090 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:15.421057    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:25.515318 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:25.515280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:34.815049 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:34.815011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:48.527133 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:48.527099    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:56:57.812298 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:56:57.812201    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:57:07.435609 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:57:07.435574    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:57:20.216052 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:57:20.216019    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:57:29.630648 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:57:29.630605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:57:36.234085 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:57:36.234051    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:57:52.718396 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:57:52.718358    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:58:02.123276 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:02.123246    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:58:02.127177 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:02.127147    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 05:58:05.418741 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:05.418704    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:58:16.414129 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:16.414075    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:58:31.023066 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:31.023035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 05:58:33.095968 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.095934    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:33.096351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.096328    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2387dbb-f6be-4e94-b754-48abfad0676a" containerName="cleanup"
Jul 17 05:58:33.096351 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.096339    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2387dbb-f6be-4e94-b754-48abfad0676a" containerName="cleanup"
Jul 17 05:58:33.096430 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.096413    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2387dbb-f6be-4e94-b754-48abfad0676a" containerName="cleanup"
Jul 17 05:58:33.099481 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.099463    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:33.101909 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.101886    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:58:33.102008 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.101894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 05:58:33.105878 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.105820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:33.227015 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.226983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-27jzj\" (UID: \"3350ccd8-bc96-4fc6-936d-535c53167778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:33.328121 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.328083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-27jzj\" (UID: \"3350ccd8-bc96-4fc6-936d-535c53167778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:33.328827 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.328809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-27jzj\" (UID: \"3350ccd8-bc96-4fc6-936d-535c53167778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:33.411825 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.411739    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:33.547422 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.547400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:33.549770 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:58:33.549744    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3350ccd8_bc96_4fc6_936d_535c53167778.slice/crio-76b2c0663314322c021f312d538c2f4b55a5d5b0705419643b83d61e60a005f2 WatchSource:0}: Error finding container 76b2c0663314322c021f312d538c2f4b55a5d5b0705419643b83d61e60a005f2: Status 404 returned error can't find the container with id 76b2c0663314322c021f312d538c2f4b55a5d5b0705419643b83d61e60a005f2
Jul 17 05:58:33.893641 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.893611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerStarted","Data":"05a4c5c7dbc5a8ddc637b5bfb0885d1b0aee43937e3636db0c27565d5f8f8a64"}
Jul 17 05:58:33.893806 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.893667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerStarted","Data":"76b2c0663314322c021f312d538c2f4b55a5d5b0705419643b83d61e60a005f2"}
Jul 17 05:58:33.909512 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:33.909461    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" podStartSLOduration=0.909446693 podStartE2EDuration="909.446693ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:58:33.906650303 +0000 UTC m=+1532.369834407" watchObservedRunningTime="2026-07-17 05:58:33.909446693 +0000 UTC m=+1532.372630798"
Jul 17 05:58:34.900013 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:34.899979    2567 generic.go:356] "Generic (PLEG): container finished" podID="3350ccd8-bc96-4fc6-936d-535c53167778" containerID="05a4c5c7dbc5a8ddc637b5bfb0885d1b0aee43937e3636db0c27565d5f8f8a64" exitCode=7
Jul 17 05:58:34.900469 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:34.900061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerDied","Data":"05a4c5c7dbc5a8ddc637b5bfb0885d1b0aee43937e3636db0c27565d5f8f8a64"}
Jul 17 05:58:34.900469 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:34.900207    2567 scope.go:117] "RemoveContainer" containerID="05a4c5c7dbc5a8ddc637b5bfb0885d1b0aee43937e3636db0c27565d5f8f8a64"
Jul 17 05:58:35.906847 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:35.906756    2567 generic.go:356] "Generic (PLEG): container finished" podID="3350ccd8-bc96-4fc6-936d-535c53167778" containerID="f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce" exitCode=7
Jul 17 05:58:35.907271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:35.906847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerDied","Data":"f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce"}
Jul 17 05:58:35.907271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:35.906918    2567 scope.go:117] "RemoveContainer" containerID="05a4c5c7dbc5a8ddc637b5bfb0885d1b0aee43937e3636db0c27565d5f8f8a64"
Jul 17 05:58:35.907271 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:35.907024    2567 scope.go:117] "RemoveContainer" containerID="f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce"
Jul 17 05:58:35.907271 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:58:35.907246    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-27jzj_odh-ai-gateway-infra(3350ccd8-bc96-4fc6-936d-535c53167778)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" podUID="3350ccd8-bc96-4fc6-936d-535c53167778"
Jul 17 05:58:36.913952 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:36.913922    2567 scope.go:117] "RemoveContainer" containerID="f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce"
Jul 17 05:58:36.914408 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:58:36.914178    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-27jzj_odh-ai-gateway-infra(3350ccd8-bc96-4fc6-936d-535c53167778)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" podUID="3350ccd8-bc96-4fc6-936d-535c53167778"
Jul 17 05:58:50.015568 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:50.015534    2567 scope.go:117] "RemoveContainer" containerID="f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce"
Jul 17 05:58:50.985855 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:50.985822    2567 generic.go:356] "Generic (PLEG): container finished" podID="3350ccd8-bc96-4fc6-936d-535c53167778" containerID="e825203d65956b69edf58e91bc3746ea4443e709fbffe76b578ce6c5e8cec170" exitCode=7
Jul 17 05:58:50.986025 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:50.985891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerDied","Data":"e825203d65956b69edf58e91bc3746ea4443e709fbffe76b578ce6c5e8cec170"}
Jul 17 05:58:50.986025 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:50.985953    2567 scope.go:117] "RemoveContainer" containerID="f76481b4846f1ce32f6405ed489e05d19dd14a0363ee09c06e5754fa10c800ce"
Jul 17 05:58:50.986289 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:50.986267    2567 scope.go:117] "RemoveContainer" containerID="e825203d65956b69edf58e91bc3746ea4443e709fbffe76b578ce6c5e8cec170"
Jul 17 05:58:50.986547 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:58:50.986507    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-27jzj_odh-ai-gateway-infra(3350ccd8-bc96-4fc6-936d-535c53167778)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" podUID="3350ccd8-bc96-4fc6-936d-535c53167778"
Jul 17 05:58:52.011933 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.011903    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:52.145003 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.144980    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:52.197227 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.197173    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca\") pod \"3350ccd8-bc96-4fc6-936d-535c53167778\" (UID: \"3350ccd8-bc96-4fc6-936d-535c53167778\") "
Jul 17 05:58:52.197518 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.197494    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3350ccd8-bc96-4fc6-936d-535c53167778" (UID: "3350ccd8-bc96-4fc6-936d-535c53167778"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:58:52.298107 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.298026    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3350ccd8-bc96-4fc6-936d-535c53167778-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:58:52.999675 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.999644    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"
Jul 17 05:58:52.999895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.999701    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj" event={"ID":"3350ccd8-bc96-4fc6-936d-535c53167778","Type":"ContainerDied","Data":"76b2c0663314322c021f312d538c2f4b55a5d5b0705419643b83d61e60a005f2"}
Jul 17 05:58:52.999895 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:52.999761    2567 scope.go:117] "RemoveContainer" containerID="e825203d65956b69edf58e91bc3746ea4443e709fbffe76b578ce6c5e8cec170"
Jul 17 05:58:53.023393 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:53.023359    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:53.030329 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:53.030303    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-27jzj"]
Jul 17 05:58:54.019992 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:58:54.019957    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" path="/var/lib/kubelet/pods/3350ccd8-bc96-4fc6-936d-535c53167778/volumes"
Jul 17 05:59:23.146469 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146425    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146808    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146822    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146834    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146840    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146853    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146858    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146918    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.146947 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.146927    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 05:59:23.151077 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.151061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:23.154991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.154434    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:59:23.154991 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.154458    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 05:59:23.157448 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.157386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:23.283751 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.283706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-smlsk\" (UID: \"726cf813-e82f-468a-ad44-7fa7d4344922\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:23.384960 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.384931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-smlsk\" (UID: \"726cf813-e82f-468a-ad44-7fa7d4344922\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:23.385518 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.385498    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-smlsk\" (UID: \"726cf813-e82f-468a-ad44-7fa7d4344922\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:23.464036 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.464008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:23.599183 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:23.599155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:23.600615 ip-10-0-142-187 kubenswrapper[2567]: W0717 05:59:23.600577    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726cf813_e82f_468a_ad44_7fa7d4344922.slice/crio-7370f0eb244ef8eca8b1b10754c90600850fa6948419d42fcc4a39023fc2a0f7 WatchSource:0}: Error finding container 7370f0eb244ef8eca8b1b10754c90600850fa6948419d42fcc4a39023fc2a0f7: Status 404 returned error can't find the container with id 7370f0eb244ef8eca8b1b10754c90600850fa6948419d42fcc4a39023fc2a0f7
Jul 17 05:59:24.165445 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:24.165359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerStarted","Data":"2c3988860f6590863d6bc14597cda514adefe3756585b2ea6fc32f9eb565f3cd"}
Jul 17 05:59:24.165445 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:24.165408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerStarted","Data":"7370f0eb244ef8eca8b1b10754c90600850fa6948419d42fcc4a39023fc2a0f7"}
Jul 17 05:59:24.182865 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:24.182703    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" podStartSLOduration=1.182660604 podStartE2EDuration="1.182660604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:59:24.179206221 +0000 UTC m=+1582.642390321" watchObservedRunningTime="2026-07-17 05:59:24.182660604 +0000 UTC m=+1582.645844710"
Jul 17 05:59:25.172172 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:25.172136    2567 generic.go:356] "Generic (PLEG): container finished" podID="726cf813-e82f-468a-ad44-7fa7d4344922" containerID="2c3988860f6590863d6bc14597cda514adefe3756585b2ea6fc32f9eb565f3cd" exitCode=7
Jul 17 05:59:25.172596 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:25.172234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerDied","Data":"2c3988860f6590863d6bc14597cda514adefe3756585b2ea6fc32f9eb565f3cd"}
Jul 17 05:59:25.172596 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:25.172408    2567 scope.go:117] "RemoveContainer" containerID="2c3988860f6590863d6bc14597cda514adefe3756585b2ea6fc32f9eb565f3cd"
Jul 17 05:59:26.179148 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:26.179065    2567 generic.go:356] "Generic (PLEG): container finished" podID="726cf813-e82f-468a-ad44-7fa7d4344922" containerID="7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6" exitCode=7
Jul 17 05:59:26.179546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:26.179152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerDied","Data":"7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6"}
Jul 17 05:59:26.179546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:26.179210    2567 scope.go:117] "RemoveContainer" containerID="2c3988860f6590863d6bc14597cda514adefe3756585b2ea6fc32f9eb565f3cd"
Jul 17 05:59:26.179546 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:26.179334    2567 scope.go:117] "RemoveContainer" containerID="7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6"
Jul 17 05:59:26.179705 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:59:26.179557    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-smlsk_odh-ai-gateway-infra(726cf813-e82f-468a-ad44-7fa7d4344922)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" podUID="726cf813-e82f-468a-ad44-7fa7d4344922"
Jul 17 05:59:27.185873 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:27.185841    2567 scope.go:117] "RemoveContainer" containerID="7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6"
Jul 17 05:59:27.186290 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:59:27.186049    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-smlsk_odh-ai-gateway-infra(726cf813-e82f-468a-ad44-7fa7d4344922)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" podUID="726cf813-e82f-468a-ad44-7fa7d4344922"
Jul 17 05:59:38.015017 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:38.014986    2567 scope.go:117] "RemoveContainer" containerID="7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6"
Jul 17 05:59:39.249093 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:39.249063    2567 generic.go:356] "Generic (PLEG): container finished" podID="726cf813-e82f-468a-ad44-7fa7d4344922" containerID="51b0c1a9348e630c0ae8861fc0eaa5d139fdff8272982bcc162e1436eff75561" exitCode=7
Jul 17 05:59:39.249495 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:39.249132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerDied","Data":"51b0c1a9348e630c0ae8861fc0eaa5d139fdff8272982bcc162e1436eff75561"}
Jul 17 05:59:39.249495 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:39.249186    2567 scope.go:117] "RemoveContainer" containerID="7188b51c5e283bb9844f14010189febf284c94c346cee1254c78f74fa19e22f6"
Jul 17 05:59:39.249589 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:39.249563    2567 scope.go:117] "RemoveContainer" containerID="51b0c1a9348e630c0ae8861fc0eaa5d139fdff8272982bcc162e1436eff75561"
Jul 17 05:59:39.249847 ip-10-0-142-187 kubenswrapper[2567]: E0717 05:59:39.249821    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-smlsk_odh-ai-gateway-infra(726cf813-e82f-468a-ad44-7fa7d4344922)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" podUID="726cf813-e82f-468a-ad44-7fa7d4344922"
Jul 17 05:59:40.274846 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:40.274813    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:40.411291 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:40.411266    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:40.536975 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:40.536876    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca\") pod \"726cf813-e82f-468a-ad44-7fa7d4344922\" (UID: \"726cf813-e82f-468a-ad44-7fa7d4344922\") "
Jul 17 05:59:40.537250 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:40.537223    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "726cf813-e82f-468a-ad44-7fa7d4344922" (UID: "726cf813-e82f-468a-ad44-7fa7d4344922"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:59:40.637629 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:40.637602    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/726cf813-e82f-468a-ad44-7fa7d4344922-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 05:59:41.262593 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:41.262564    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"
Jul 17 05:59:41.262811 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:41.262609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk" event={"ID":"726cf813-e82f-468a-ad44-7fa7d4344922","Type":"ContainerDied","Data":"7370f0eb244ef8eca8b1b10754c90600850fa6948419d42fcc4a39023fc2a0f7"}
Jul 17 05:59:41.262811 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:41.262666    2567 scope.go:117] "RemoveContainer" containerID="51b0c1a9348e630c0ae8861fc0eaa5d139fdff8272982bcc162e1436eff75561"
Jul 17 05:59:41.286289 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:41.286259    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:41.292033 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:41.292008    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-smlsk"]
Jul 17 05:59:42.020462 ip-10-0-142-187 kubenswrapper[2567]: I0717 05:59:42.020426    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" path="/var/lib/kubelet/pods/726cf813-e82f-468a-ad44-7fa7d4344922/volumes"
Jul 17 06:00:00.144177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144082    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"]
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144440    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144452    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144466    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144471    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144534    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144542    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.144551    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3350ccd8-bc96-4fc6-936d-535c53167778" containerName="revoke-keys"
Jul 17 06:00:00.148816 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.148796    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:00.148958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.148936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"
Jul 17 06:00:00.149119 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.149104    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.149119 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.149118    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.149227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.149207    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="726cf813-e82f-468a-ad44-7fa7d4344922" containerName="revoke-keys"
Jul 17 06:00:00.151921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.151902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"
Jul 17 06:00:00.155241 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.155219    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:00:00.160646 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.160464    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"
Jul 17 06:00:00.162337 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.162314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"]
Jul 17 06:00:00.165422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.165399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:00.168784 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.168760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"
Jul 17 06:00:00.326671 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.326635    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"]
Jul 17 06:00:00.330721 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:00:00.330695    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c05c5e_e425_4199_aa02_f844177259ac.slice/crio-4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40 WatchSource:0}: Error finding container 4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40: Status 404 returned error can't find the container with id 4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40
Jul 17 06:00:00.355164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.355133    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:00.356202 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:00:00.356173    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9041a7f4_6a4a_48df_a901_fe38d6d0171d.slice/crio-6e66b1d0eafca9e039b6f96262b21d5a3e7d6a4935f2cc8cadae5f605f1c4d06 WatchSource:0}: Error finding container 6e66b1d0eafca9e039b6f96262b21d5a3e7d6a4935f2cc8cadae5f605f1c4d06: Status 404 returned error can't find the container with id 6e66b1d0eafca9e039b6f96262b21d5a3e7d6a4935f2cc8cadae5f605f1c4d06
Jul 17 06:00:00.370497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.370470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr" event={"ID":"d3c05c5e-e425-4199-aa02-f844177259ac","Type":"ContainerStarted","Data":"4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40"}
Jul 17 06:00:00.371729 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:00.371704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerStarted","Data":"6e66b1d0eafca9e039b6f96262b21d5a3e7d6a4935f2cc8cadae5f605f1c4d06"}
Jul 17 06:00:01.378786 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:01.378753    2567 generic.go:356] "Generic (PLEG): container finished" podID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerID="87dcb03f8fe94650f3343424372d3185bac41b5170532a7bd2d7f5286f9b685b" exitCode=7
Jul 17 06:00:01.379235 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:01.378848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerDied","Data":"87dcb03f8fe94650f3343424372d3185bac41b5170532a7bd2d7f5286f9b685b"}
Jul 17 06:00:01.379235 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:01.378985    2567 scope.go:117] "RemoveContainer" containerID="87dcb03f8fe94650f3343424372d3185bac41b5170532a7bd2d7f5286f9b685b"
Jul 17 06:00:01.380427 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:01.380409    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3c05c5e-e425-4199-aa02-f844177259ac" containerID="a4ae33b24117a93bf68fa322f39ac9a9a91245314924eb41a67fe3409f70970b" exitCode=0
Jul 17 06:00:01.380509 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:01.380442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr" event={"ID":"d3c05c5e-e425-4199-aa02-f844177259ac","Type":"ContainerDied","Data":"a4ae33b24117a93bf68fa322f39ac9a9a91245314924eb41a67fe3409f70970b"}
Jul 17 06:00:02.387308 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:02.387217    2567 generic.go:356] "Generic (PLEG): container finished" podID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerID="6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0" exitCode=7
Jul 17 06:00:02.387739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:02.387305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerDied","Data":"6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0"}
Jul 17 06:00:02.387739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:02.387364    2567 scope.go:117] "RemoveContainer" containerID="87dcb03f8fe94650f3343424372d3185bac41b5170532a7bd2d7f5286f9b685b"
Jul 17 06:00:02.387739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:02.387539    2567 scope.go:117] "RemoveContainer" containerID="6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0"
Jul 17 06:00:02.388141 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:02.387831    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl_odh-ai-gateway-infra(9041a7f4-6a4a-48df-a901-fe38d6d0171d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d"
Jul 17 06:00:02.530085 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:02.530050    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"
Jul 17 06:00:03.394109 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:03.394078    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr"
Jul 17 06:00:03.394109 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:03.394091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737800-fxhtr" event={"ID":"d3c05c5e-e425-4199-aa02-f844177259ac","Type":"ContainerDied","Data":"4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40"}
Jul 17 06:00:03.394569 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:03.394133    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4519c2b4e612c43c565262e42090fe964af62b997d725c0802c41472f6cdbd40"
Jul 17 06:00:03.395795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:03.395775    2567 scope.go:117] "RemoveContainer" containerID="6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0"
Jul 17 06:00:03.395985 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:03.395967    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl_odh-ai-gateway-infra(9041a7f4-6a4a-48df-a901-fe38d6d0171d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d"
Jul 17 06:00:13.184938 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.184896    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:13.186435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.186404    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c05c5e-e425-4199-aa02-f844177259ac" containerName="cleanup"
Jul 17 06:00:13.186610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.186597    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c05c5e-e425-4199-aa02-f844177259ac" containerName="cleanup"
Jul 17 06:00:13.186896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.186880    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c05c5e-e425-4199-aa02-f844177259ac" containerName="cleanup"
Jul 17 06:00:13.191116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.191092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:13.192199 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.192172    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:13.193606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.193581    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:00:13.245763 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.245731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg\" (UID: \"612cba16-6d7c-4ae3-a8be-5515f9d2631e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:13.347162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.347119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg\" (UID: \"612cba16-6d7c-4ae3-a8be-5515f9d2631e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:13.347780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.347760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg\" (UID: \"612cba16-6d7c-4ae3-a8be-5515f9d2631e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:13.502219 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.502176    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:13.634434 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:13.634404    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:13.635859 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:00:13.635823    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612cba16_6d7c_4ae3_a8be_5515f9d2631e.slice/crio-1d39feb2932d131cb6243eb8da2ce32b5e48b790278150a5b83fdabc6a8da0ae WatchSource:0}: Error finding container 1d39feb2932d131cb6243eb8da2ce32b5e48b790278150a5b83fdabc6a8da0ae: Status 404 returned error can't find the container with id 1d39feb2932d131cb6243eb8da2ce32b5e48b790278150a5b83fdabc6a8da0ae
Jul 17 06:00:14.457658 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:14.457621    2567 generic.go:356] "Generic (PLEG): container finished" podID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerID="3918094f28a13abda8c19f0aea23fa884db39d06b338a47ce6d2c8a2c2497b29" exitCode=7
Jul 17 06:00:14.458126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:14.457710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerDied","Data":"3918094f28a13abda8c19f0aea23fa884db39d06b338a47ce6d2c8a2c2497b29"}
Jul 17 06:00:14.458126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:14.457764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerStarted","Data":"1d39feb2932d131cb6243eb8da2ce32b5e48b790278150a5b83fdabc6a8da0ae"}
Jul 17 06:00:14.458126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:14.457927    2567 scope.go:117] "RemoveContainer" containerID="3918094f28a13abda8c19f0aea23fa884db39d06b338a47ce6d2c8a2c2497b29"
Jul 17 06:00:15.464807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:15.464770    2567 generic.go:356] "Generic (PLEG): container finished" podID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerID="e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e" exitCode=7
Jul 17 06:00:15.465221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:15.464857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerDied","Data":"e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e"}
Jul 17 06:00:15.465221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:15.464922    2567 scope.go:117] "RemoveContainer" containerID="3918094f28a13abda8c19f0aea23fa884db39d06b338a47ce6d2c8a2c2497b29"
Jul 17 06:00:15.465221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:15.465124    2567 scope.go:117] "RemoveContainer" containerID="e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e"
Jul 17 06:00:15.465438 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:15.465352    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg_odh-ai-gateway-infra(612cba16-6d7c-4ae3-a8be-5515f9d2631e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e"
Jul 17 06:00:16.472072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:16.472046    2567 scope.go:117] "RemoveContainer" containerID="e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e"
Jul 17 06:00:16.472463 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:16.472255    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg_odh-ai-gateway-infra(612cba16-6d7c-4ae3-a8be-5515f9d2631e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e"
Jul 17 06:00:19.015472 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:19.015439    2567 scope.go:117] "RemoveContainer" containerID="6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0"
Jul 17 06:00:19.489036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:19.489004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerStarted","Data":"885cc0dd1099fa829a8999ad109910205a3b1c3811ede40a277813c14cba17c7"}
Jul 17 06:00:19.505415 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:19.505370    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" podStartSLOduration=19.505354791 podStartE2EDuration="19.505354791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:00:19.502805076 +0000 UTC m=+1637.965989182" watchObservedRunningTime="2026-07-17 06:00:19.505354791 +0000 UTC m=+1637.968538916"
Jul 17 06:00:20.497101 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:20.497070    2567 generic.go:356] "Generic (PLEG): container finished" podID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerID="885cc0dd1099fa829a8999ad109910205a3b1c3811ede40a277813c14cba17c7" exitCode=7
Jul 17 06:00:20.497510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:20.497144    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerDied","Data":"885cc0dd1099fa829a8999ad109910205a3b1c3811ede40a277813c14cba17c7"}
Jul 17 06:00:20.497510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:20.497208    2567 scope.go:117] "RemoveContainer" containerID="6500df2e1a3ac1d5ddc29296c5b0ed37150e76eb794f7b292beec958812feed0"
Jul 17 06:00:20.497510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:20.497461    2567 scope.go:117] "RemoveContainer" containerID="885cc0dd1099fa829a8999ad109910205a3b1c3811ede40a277813c14cba17c7"
Jul 17 06:00:20.497723 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:20.497700    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl_odh-ai-gateway-infra(9041a7f4-6a4a-48df-a901-fe38d6d0171d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d"
Jul 17 06:00:20.512907 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:20.512885    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:21.637835 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:21.637810    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"
Jul 17 06:00:22.510019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:22.509988    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl" event={"ID":"9041a7f4-6a4a-48df-a901-fe38d6d0171d","Type":"ContainerDied","Data":"6e66b1d0eafca9e039b6f96262b21d5a3e7d6a4935f2cc8cadae5f605f1c4d06"}
Jul 17 06:00:22.510215 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:22.510050    2567 scope.go:117] "RemoveContainer" containerID="885cc0dd1099fa829a8999ad109910205a3b1c3811ede40a277813c14cba17c7"
Jul 17 06:00:22.510215 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:22.510004    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"
Jul 17 06:00:22.529820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:22.529795    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:22.534918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:22.534893    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-81346fa0-29737800-8rlcl"]
Jul 17 06:00:24.027893 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:24.027862    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" path="/var/lib/kubelet/pods/9041a7f4-6a4a-48df-a901-fe38d6d0171d/volumes"
Jul 17 06:00:31.015600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:31.015569    2567 scope.go:117] "RemoveContainer" containerID="e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e"
Jul 17 06:00:31.561148 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:31.561056    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerStarted","Data":"505a9cf16c58f727bdf78bc1de100c9a15642cd59c74ca1c3f312c1e90d564f3"}
Jul 17 06:00:31.578523 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:31.578473    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" podStartSLOduration=18.578447361 podStartE2EDuration="18.578447361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:00:31.576633053 +0000 UTC m=+1650.039817157" watchObservedRunningTime="2026-07-17 06:00:31.578447361 +0000 UTC m=+1650.041631464"
Jul 17 06:00:32.567437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:32.567403    2567 generic.go:356] "Generic (PLEG): container finished" podID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerID="505a9cf16c58f727bdf78bc1de100c9a15642cd59c74ca1c3f312c1e90d564f3" exitCode=7
Jul 17 06:00:32.567958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:32.567479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerDied","Data":"505a9cf16c58f727bdf78bc1de100c9a15642cd59c74ca1c3f312c1e90d564f3"}
Jul 17 06:00:32.567958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:32.567555    2567 scope.go:117] "RemoveContainer" containerID="e9c31b5bd2afbb3bdfe6e0db95599723b334f7620d7bc27fccadf9b04f91882e"
Jul 17 06:00:32.567958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:32.567879    2567 scope.go:117] "RemoveContainer" containerID="505a9cf16c58f727bdf78bc1de100c9a15642cd59c74ca1c3f312c1e90d564f3"
Jul 17 06:00:32.568091 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:00:32.568073    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg_odh-ai-gateway-infra(612cba16-6d7c-4ae3-a8be-5515f9d2631e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e"
Jul 17 06:00:32.588645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:32.588623    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:33.705075 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:33.705052    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:33.829243 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:33.829158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca\") pod \"612cba16-6d7c-4ae3-a8be-5515f9d2631e\" (UID: \"612cba16-6d7c-4ae3-a8be-5515f9d2631e\") "
Jul 17 06:00:33.829560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:33.829536    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "612cba16-6d7c-4ae3-a8be-5515f9d2631e" (UID: "612cba16-6d7c-4ae3-a8be-5515f9d2631e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:00:33.930150 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:33.930117    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/612cba16-6d7c-4ae3-a8be-5515f9d2631e-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:00:34.581164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:34.581129    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"
Jul 17 06:00:34.581164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:34.581162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg" event={"ID":"612cba16-6d7c-4ae3-a8be-5515f9d2631e","Type":"ContainerDied","Data":"1d39feb2932d131cb6243eb8da2ce32b5e48b790278150a5b83fdabc6a8da0ae"}
Jul 17 06:00:34.581395 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:34.581224    2567 scope.go:117] "RemoveContainer" containerID="505a9cf16c58f727bdf78bc1de100c9a15642cd59c74ca1c3f312c1e90d564f3"
Jul 17 06:00:34.596993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:34.596964    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:34.602720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:34.602697    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-lfvcg"]
Jul 17 06:00:36.020435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:00:36.020401    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" path="/var/lib/kubelet/pods/612cba16-6d7c-4ae3-a8be-5515f9d2631e/volumes"
Jul 17 06:01:13.232781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.232734    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233111    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233121    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233135    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233140    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233151    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233156    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233167    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233171    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233177    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233182    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233238    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233247    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:13.233547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233259    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.233547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.233264    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9041a7f4-6a4a-48df-a901-fe38d6d0171d" containerName="cleanup"
Jul 17 06:01:13.237688 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.237661    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:13.240142 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.240121    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:01:13.240310 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.240212    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:01:13.244793 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.244750    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:13.389737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.389700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-wntrh\" (UID: \"8aed5b93-f89b-4cc4-8ba1-052c3117b767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:13.490800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.490673    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-wntrh\" (UID: \"8aed5b93-f89b-4cc4-8ba1-052c3117b767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:13.491295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.491273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-wntrh\" (UID: \"8aed5b93-f89b-4cc4-8ba1-052c3117b767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:13.551148 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.551102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:13.684899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.684739    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:13.687288 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:01:13.687266    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aed5b93_f89b_4cc4_8ba1_052c3117b767.slice/crio-634a2820fb9b5ae1b551f120bc64fc40faa13e12a1058a8adc0a0e5295087f5e WatchSource:0}: Error finding container 634a2820fb9b5ae1b551f120bc64fc40faa13e12a1058a8adc0a0e5295087f5e: Status 404 returned error can't find the container with id 634a2820fb9b5ae1b551f120bc64fc40faa13e12a1058a8adc0a0e5295087f5e
Jul 17 06:01:13.789330 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:13.789236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" event={"ID":"8aed5b93-f89b-4cc4-8ba1-052c3117b767","Type":"ContainerStarted","Data":"634a2820fb9b5ae1b551f120bc64fc40faa13e12a1058a8adc0a0e5295087f5e"}
Jul 17 06:01:14.796790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:14.796750    2567 generic.go:356] "Generic (PLEG): container finished" podID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerID="f351d7e26f06f6cfcba06ec2b68d8abe84c07af7068e042afad74f371ce79926" exitCode=7
Jul 17 06:01:14.797181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:14.796814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" event={"ID":"8aed5b93-f89b-4cc4-8ba1-052c3117b767","Type":"ContainerDied","Data":"f351d7e26f06f6cfcba06ec2b68d8abe84c07af7068e042afad74f371ce79926"}
Jul 17 06:01:14.797181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:14.797066    2567 scope.go:117] "RemoveContainer" containerID="f351d7e26f06f6cfcba06ec2b68d8abe84c07af7068e042afad74f371ce79926"
Jul 17 06:01:15.804143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:15.804110    2567 generic.go:356] "Generic (PLEG): container finished" podID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerID="904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204" exitCode=7
Jul 17 06:01:15.804546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:15.804193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" event={"ID":"8aed5b93-f89b-4cc4-8ba1-052c3117b767","Type":"ContainerDied","Data":"904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204"}
Jul 17 06:01:15.804546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:15.804254    2567 scope.go:117] "RemoveContainer" containerID="f351d7e26f06f6cfcba06ec2b68d8abe84c07af7068e042afad74f371ce79926"
Jul 17 06:01:15.804546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:15.804375    2567 scope.go:117] "RemoveContainer" containerID="904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204"
Jul 17 06:01:15.804697 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:01:15.804606    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-wntrh_odh-ai-gateway-infra(8aed5b93-f89b-4cc4-8ba1-052c3117b767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767"
Jul 17 06:01:16.812296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:16.812268    2567 scope.go:117] "RemoveContainer" containerID="904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204"
Jul 17 06:01:16.812698 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:01:16.812460    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-wntrh_odh-ai-gateway-infra(8aed5b93-f89b-4cc4-8ba1-052c3117b767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767"
Jul 17 06:01:28.015639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:28.015554    2567 scope.go:117] "RemoveContainer" containerID="904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204"
Jul 17 06:01:28.879226 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:28.879137    2567 generic.go:356] "Generic (PLEG): container finished" podID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerID="54de941efe7c30d97d15dd39fe223dd5c63b6473127bba27e66a3e4d6ba89718" exitCode=7
Jul 17 06:01:28.879226 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:28.879208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" event={"ID":"8aed5b93-f89b-4cc4-8ba1-052c3117b767","Type":"ContainerDied","Data":"54de941efe7c30d97d15dd39fe223dd5c63b6473127bba27e66a3e4d6ba89718"}
Jul 17 06:01:28.879467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:28.879266    2567 scope.go:117] "RemoveContainer" containerID="904da8f66ece9dcbfd4fce208c68c849dc65bc70cff4e48c958e45b105984204"
Jul 17 06:01:28.879628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:28.879612    2567 scope.go:117] "RemoveContainer" containerID="54de941efe7c30d97d15dd39fe223dd5c63b6473127bba27e66a3e4d6ba89718"
Jul 17 06:01:28.879904 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:01:28.879883    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-wntrh_odh-ai-gateway-infra(8aed5b93-f89b-4cc4-8ba1-052c3117b767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767"
Jul 17 06:01:29.906768 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:29.906732    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:30.042301 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.042274    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:30.145329 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.145299    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca\") pod \"8aed5b93-f89b-4cc4-8ba1-052c3117b767\" (UID: \"8aed5b93-f89b-4cc4-8ba1-052c3117b767\") "
Jul 17 06:01:30.145670 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.145648    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8aed5b93-f89b-4cc4-8ba1-052c3117b767" (UID: "8aed5b93-f89b-4cc4-8ba1-052c3117b767"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:01:30.246072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.246041    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aed5b93-f89b-4cc4-8ba1-052c3117b767-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:01:30.894095 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.894068    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"
Jul 17 06:01:30.894267 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.894100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh" event={"ID":"8aed5b93-f89b-4cc4-8ba1-052c3117b767","Type":"ContainerDied","Data":"634a2820fb9b5ae1b551f120bc64fc40faa13e12a1058a8adc0a0e5295087f5e"}
Jul 17 06:01:30.894267 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.894179    2567 scope.go:117] "RemoveContainer" containerID="54de941efe7c30d97d15dd39fe223dd5c63b6473127bba27e66a3e4d6ba89718"
Jul 17 06:01:30.921544 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.921508    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:30.925187 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:30.925161    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-wntrh"]
Jul 17 06:01:32.020421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:32.020391    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" path="/var/lib/kubelet/pods/8aed5b93-f89b-4cc4-8ba1-052c3117b767/volumes"
Jul 17 06:01:36.024806 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:36.024773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:01:49.720948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:49.720915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:01:51.593497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593820    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593832    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593846    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593851    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593861    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593866    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593881    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:51.593906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:51.594164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593933    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="612cba16-6d7c-4ae3-a8be-5515f9d2631e" containerName="revoke-keys"
Jul 17 06:01:51.594164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593943    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.594164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593949    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.594164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.593955    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aed5b93-f89b-4cc4-8ba1-052c3117b767" containerName="revoke-keys"
Jul 17 06:01:51.597152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.597135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:01:51.599522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.599497    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:01:51.599648 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.599549    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:01:51.604774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.604586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:01:51.734637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.734594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2\" (UID: \"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:01:51.836026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.835989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2\" (UID: \"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:01:51.836638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.836613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2\" (UID: \"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:01:51.909561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:51.909461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:01:52.049856 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:52.049819    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:01:52.051108 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:01:52.051087    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549fa625_8f2e_4f21_9aa8_7c7fb1930a2a.slice/crio-f19dcacf63c975143b744b5be46424a1ce5589c829ce83dd51397ad2bbd9cf91 WatchSource:0}: Error finding container f19dcacf63c975143b744b5be46424a1ce5589c829ce83dd51397ad2bbd9cf91: Status 404 returned error can't find the container with id f19dcacf63c975143b744b5be46424a1ce5589c829ce83dd51397ad2bbd9cf91
Jul 17 06:01:53.012324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:53.012289    2567 generic.go:356] "Generic (PLEG): container finished" podID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerID="90deedb27e5c014a0fc52a76b467396572f29a4c3fe30ca5d04f659bffb4cec9" exitCode=7
Jul 17 06:01:53.012757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:53.012370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" event={"ID":"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a","Type":"ContainerDied","Data":"90deedb27e5c014a0fc52a76b467396572f29a4c3fe30ca5d04f659bffb4cec9"}
Jul 17 06:01:53.012757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:53.012422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" event={"ID":"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a","Type":"ContainerStarted","Data":"f19dcacf63c975143b744b5be46424a1ce5589c829ce83dd51397ad2bbd9cf91"}
Jul 17 06:01:53.012757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:53.012501    2567 scope.go:117] "RemoveContainer" containerID="90deedb27e5c014a0fc52a76b467396572f29a4c3fe30ca5d04f659bffb4cec9"
Jul 17 06:01:54.019993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:54.019962    2567 generic.go:356] "Generic (PLEG): container finished" podID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerID="29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb" exitCode=7
Jul 17 06:01:54.020357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:54.020256    2567 scope.go:117] "RemoveContainer" containerID="29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb"
Jul 17 06:01:54.020446 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:01:54.020429    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2_odh-ai-gateway-infra(549fa625-8f2e-4f21-9aa8-7c7fb1930a2a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a"
Jul 17 06:01:54.020486 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:54.020461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" event={"ID":"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a","Type":"ContainerDied","Data":"29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb"}
Jul 17 06:01:54.020526 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:54.020514    2567 scope.go:117] "RemoveContainer" containerID="90deedb27e5c014a0fc52a76b467396572f29a4c3fe30ca5d04f659bffb4cec9"
Jul 17 06:01:55.026768 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:01:55.026739    2567 scope.go:117] "RemoveContainer" containerID="29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb"
Jul 17 06:01:55.027171 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:01:55.026941    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2_odh-ai-gateway-infra(549fa625-8f2e-4f21-9aa8-7c7fb1930a2a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a"
Jul 17 06:02:03.279107 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.279069    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:03.282474 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.282456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:03.290348 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.289942    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:03.439853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.439805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-88lvr\" (UID: \"b6a44c41-6059-4cca-813a-ab11a5af0da4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:03.541222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.541143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-88lvr\" (UID: \"b6a44c41-6059-4cca-813a-ab11a5af0da4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:03.541863 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.541843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-88lvr\" (UID: \"b6a44c41-6059-4cca-813a-ab11a5af0da4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:03.594305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.594264    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:03.733798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:03.733768    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:03.735597 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:02:03.735567    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a44c41_6059_4cca_813a_ab11a5af0da4.slice/crio-cb2e68bb82642f965d8fac1cbf75d40e4ff1bba9d85e82f173d2aad707ef8b4e WatchSource:0}: Error finding container cb2e68bb82642f965d8fac1cbf75d40e4ff1bba9d85e82f173d2aad707ef8b4e: Status 404 returned error can't find the container with id cb2e68bb82642f965d8fac1cbf75d40e4ff1bba9d85e82f173d2aad707ef8b4e
Jul 17 06:02:04.077391 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:04.077360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerStarted","Data":"c1de0ad2eccfae8a95e70b48fc9630f2a2e0cf67e15b484c6da6f2fa99faf230"}
Jul 17 06:02:04.077391 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:04.077410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerStarted","Data":"cb2e68bb82642f965d8fac1cbf75d40e4ff1bba9d85e82f173d2aad707ef8b4e"}
Jul 17 06:02:04.094016 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:04.093961    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" podStartSLOduration=1.093946354 podStartE2EDuration="1.093946354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:02:04.091624208 +0000 UTC m=+1742.554808336" watchObservedRunningTime="2026-07-17 06:02:04.093946354 +0000 UTC m=+1742.557130458"
Jul 17 06:02:05.084259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:05.084218    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerID="c1de0ad2eccfae8a95e70b48fc9630f2a2e0cf67e15b484c6da6f2fa99faf230" exitCode=6
Jul 17 06:02:05.084651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:05.084308    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerDied","Data":"c1de0ad2eccfae8a95e70b48fc9630f2a2e0cf67e15b484c6da6f2fa99faf230"}
Jul 17 06:02:05.084651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:05.084457    2567 scope.go:117] "RemoveContainer" containerID="c1de0ad2eccfae8a95e70b48fc9630f2a2e0cf67e15b484c6da6f2fa99faf230"
Jul 17 06:02:06.090944 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:06.090914    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerID="ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a" exitCode=6
Jul 17 06:02:06.091412 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:06.091004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerDied","Data":"ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a"}
Jul 17 06:02:06.091412 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:06.091062    2567 scope.go:117] "RemoveContainer" containerID="c1de0ad2eccfae8a95e70b48fc9630f2a2e0cf67e15b484c6da6f2fa99faf230"
Jul 17 06:02:06.091412 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:06.091304    2567 scope.go:117] "RemoveContainer" containerID="ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a"
Jul 17 06:02:06.091578 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:06.091499    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-88lvr_odh-ai-gateway-infra(b6a44c41-6059-4cca-813a-ab11a5af0da4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4"
Jul 17 06:02:07.097960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:07.097930    2567 scope.go:117] "RemoveContainer" containerID="ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a"
Jul 17 06:02:07.098433 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:07.098166    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-88lvr_odh-ai-gateway-infra(b6a44c41-6059-4cca-813a-ab11a5af0da4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4"
Jul 17 06:02:09.015223 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:09.015191    2567 scope.go:117] "RemoveContainer" containerID="29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb"
Jul 17 06:02:10.114374 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:10.114337    2567 generic.go:356] "Generic (PLEG): container finished" podID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerID="67c217fc2d28ea6f74df15145c562946e90da33b5000c79d751615a780027ca7" exitCode=7
Jul 17 06:02:10.114847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:10.114412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" event={"ID":"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a","Type":"ContainerDied","Data":"67c217fc2d28ea6f74df15145c562946e90da33b5000c79d751615a780027ca7"}
Jul 17 06:02:10.114847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:10.114479    2567 scope.go:117] "RemoveContainer" containerID="29e2f576f660a139797e22e85c0c6df63bd5ece95a650d0b246ea689291b4bcb"
Jul 17 06:02:10.114847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:10.114781    2567 scope.go:117] "RemoveContainer" containerID="67c217fc2d28ea6f74df15145c562946e90da33b5000c79d751615a780027ca7"
Jul 17 06:02:10.115002 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:10.114983    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2_odh-ai-gateway-infra(549fa625-8f2e-4f21-9aa8-7c7fb1930a2a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a"
Jul 17 06:02:11.142903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:11.142857    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:02:11.292757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:11.292734    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:02:11.414528 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:11.414424    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca\") pod \"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a\" (UID: \"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a\") "
Jul 17 06:02:11.414824 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:11.414803    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" (UID: "549fa625-8f2e-4f21-9aa8-7c7fb1930a2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:02:11.516130 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:11.516090    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:02:12.127565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:12.127527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2" event={"ID":"549fa625-8f2e-4f21-9aa8-7c7fb1930a2a","Type":"ContainerDied","Data":"f19dcacf63c975143b744b5be46424a1ce5589c829ce83dd51397ad2bbd9cf91"}
Jul 17 06:02:12.127565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:12.127551    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"
Jul 17 06:02:12.127815 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:12.127603    2567 scope.go:117] "RemoveContainer" containerID="67c217fc2d28ea6f74df15145c562946e90da33b5000c79d751615a780027ca7"
Jul 17 06:02:12.143098 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:12.143070    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:02:12.146790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:12.146767    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4jnv2"]
Jul 17 06:02:14.021060 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:14.021025    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" path="/var/lib/kubelet/pods/549fa625-8f2e-4f21-9aa8-7c7fb1930a2a/volumes"
Jul 17 06:02:21.015562 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:21.015523    2567 scope.go:117] "RemoveContainer" containerID="ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a"
Jul 17 06:02:22.184600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:22.184569    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerID="2266c51674f9a77c99e12ef1e1d5faa91d00a95ae4db4637f94192049bd46203" exitCode=6
Jul 17 06:02:22.185042 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:22.184647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerDied","Data":"2266c51674f9a77c99e12ef1e1d5faa91d00a95ae4db4637f94192049bd46203"}
Jul 17 06:02:22.185042 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:22.184728    2567 scope.go:117] "RemoveContainer" containerID="ec026d3ccd95efc2f835e1ccf0742df6ab25839c11228a05d57468323373b68a"
Jul 17 06:02:22.185156 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:22.185067    2567 scope.go:117] "RemoveContainer" containerID="2266c51674f9a77c99e12ef1e1d5faa91d00a95ae4db4637f94192049bd46203"
Jul 17 06:02:22.185310 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:22.185284    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-88lvr_odh-ai-gateway-infra(b6a44c41-6059-4cca-813a-ab11a5af0da4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4"
Jul 17 06:02:23.210315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:23.210277    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:23.345796 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:23.345767    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:23.418307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:23.418274    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca\") pod \"b6a44c41-6059-4cca-813a-ab11a5af0da4\" (UID: \"b6a44c41-6059-4cca-813a-ab11a5af0da4\") "
Jul 17 06:02:23.418719 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:23.418670    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6a44c41-6059-4cca-813a-ab11a5af0da4" (UID: "b6a44c41-6059-4cca-813a-ab11a5af0da4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:02:23.519890 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:23.519789    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6a44c41-6059-4cca-813a-ab11a5af0da4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:02:24.198659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:24.198634    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"
Jul 17 06:02:24.198848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:24.198674    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr" event={"ID":"b6a44c41-6059-4cca-813a-ab11a5af0da4","Type":"ContainerDied","Data":"cb2e68bb82642f965d8fac1cbf75d40e4ff1bba9d85e82f173d2aad707ef8b4e"}
Jul 17 06:02:24.198848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:24.198750    2567 scope.go:117] "RemoveContainer" containerID="2266c51674f9a77c99e12ef1e1d5faa91d00a95ae4db4637f94192049bd46203"
Jul 17 06:02:24.217966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:24.217941    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:24.223144 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:24.223119    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-88lvr"]
Jul 17 06:02:26.020828 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:26.020796    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" path="/var/lib/kubelet/pods/b6a44c41-6059-4cca-813a-ab11a5af0da4/volumes"
Jul 17 06:02:51.647058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647021    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647373    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647389    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647403    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647409    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647416    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647422    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647435    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647443    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647457    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647465    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647530    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647538    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647548    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647555    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.647722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.647561    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a44c41-6059-4cca-813a-ab11a5af0da4" containerName="revoke-keys"
Jul 17 06:02:51.651400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.651383    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:02:51.653940 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.653916    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:02:51.654052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.653916    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:02:51.659567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.659402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:02:51.783855 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.783822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-ks79q\" (UID: \"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:02:51.885053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.885017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-ks79q\" (UID: \"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:02:51.885645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.885623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-ks79q\" (UID: \"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:02:51.963257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:51.963226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:02:52.098420 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:52.098393    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:02:52.100406 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:02:52.100382    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c94f39_3665_4bb7_b7e9_0dec5cf8b34d.slice/crio-19129fd1a03e60538fb807490abbcbee55b8bd9c2f658ccb3acef00ed00b8a60 WatchSource:0}: Error finding container 19129fd1a03e60538fb807490abbcbee55b8bd9c2f658ccb3acef00ed00b8a60: Status 404 returned error can't find the container with id 19129fd1a03e60538fb807490abbcbee55b8bd9c2f658ccb3acef00ed00b8a60
Jul 17 06:02:52.348017 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:52.347983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerStarted","Data":"19129fd1a03e60538fb807490abbcbee55b8bd9c2f658ccb3acef00ed00b8a60"}
Jul 17 06:02:53.354726 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:53.354669    2567 generic.go:356] "Generic (PLEG): container finished" podID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerID="32b4dab2d6e78aac171b3534efe13bd7af0aaa6e67940ddfc740b3c7535efecb" exitCode=7
Jul 17 06:02:53.354726 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:53.354715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerDied","Data":"32b4dab2d6e78aac171b3534efe13bd7af0aaa6e67940ddfc740b3c7535efecb"}
Jul 17 06:02:53.355265 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:53.355024    2567 scope.go:117] "RemoveContainer" containerID="32b4dab2d6e78aac171b3534efe13bd7af0aaa6e67940ddfc740b3c7535efecb"
Jul 17 06:02:54.362162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:54.362059    2567 generic.go:356] "Generic (PLEG): container finished" podID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerID="d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b" exitCode=7
Jul 17 06:02:54.362714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:54.362152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerDied","Data":"d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b"}
Jul 17 06:02:54.362714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:54.362213    2567 scope.go:117] "RemoveContainer" containerID="32b4dab2d6e78aac171b3534efe13bd7af0aaa6e67940ddfc740b3c7535efecb"
Jul 17 06:02:54.362714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:54.362464    2567 scope.go:117] "RemoveContainer" containerID="d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b"
Jul 17 06:02:54.362913 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:54.362733    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-ks79q_odh-ai-gateway-infra(17c94f39-3665-4bb7-b7e9-0dec5cf8b34d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d"
Jul 17 06:02:54.719563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:54.719515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:02:55.369510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:02:55.369486    2567 scope.go:117] "RemoveContainer" containerID="d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b"
Jul 17 06:02:55.369912 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:02:55.369701    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-ks79q_odh-ai-gateway-infra(17c94f39-3665-4bb7-b7e9-0dec5cf8b34d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d"
Jul 17 06:03:02.162011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:02.161981    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:03:02.168528 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:02.168505    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:03:03.333142 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.333057    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:03.333505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.333405    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:03:03.333505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.333416    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:03:03.333505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.333502    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="549fa625-8f2e-4f21-9aa8-7c7fb1930a2a" containerName="revoke-keys"
Jul 17 06:03:03.336550 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.336534    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:03.344973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.344947    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:03.394555 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.394510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m\" (UID: \"57e45300-f9a4-49cc-84fa-17818fa2c079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:03.495400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.495352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m\" (UID: \"57e45300-f9a4-49cc-84fa-17818fa2c079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:03.496031 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.496010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m\" (UID: \"57e45300-f9a4-49cc-84fa-17818fa2c079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:03.648054 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.647953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:03.997571 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:03.997546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:03.999733 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:03:03.999702    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e45300_f9a4_49cc_84fa_17818fa2c079.slice/crio-2b535b82ad3bdb9fdce0c947d174ce205aa07e57c350dafc2ffcc8ca77c383ca WatchSource:0}: Error finding container 2b535b82ad3bdb9fdce0c947d174ce205aa07e57c350dafc2ffcc8ca77c383ca: Status 404 returned error can't find the container with id 2b535b82ad3bdb9fdce0c947d174ce205aa07e57c350dafc2ffcc8ca77c383ca
Jul 17 06:03:04.418925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:04.418888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerStarted","Data":"bb639a29020e5da8dd511236137956954c459e61e1bc167a1eb68a7cc8f39b5c"}
Jul 17 06:03:04.419350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:04.418945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerStarted","Data":"2b535b82ad3bdb9fdce0c947d174ce205aa07e57c350dafc2ffcc8ca77c383ca"}
Jul 17 06:03:04.433917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:04.433867    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" podStartSLOduration=1.433847175 podStartE2EDuration="1.433847175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:03:04.432938089 +0000 UTC m=+1802.896122193" watchObservedRunningTime="2026-07-17 06:03:04.433847175 +0000 UTC m=+1802.897031281"
Jul 17 06:03:05.426259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:05.426224    2567 generic.go:356] "Generic (PLEG): container finished" podID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerID="bb639a29020e5da8dd511236137956954c459e61e1bc167a1eb68a7cc8f39b5c" exitCode=6
Jul 17 06:03:05.426716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:05.426316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerDied","Data":"bb639a29020e5da8dd511236137956954c459e61e1bc167a1eb68a7cc8f39b5c"}
Jul 17 06:03:05.426716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:05.426503    2567 scope.go:117] "RemoveContainer" containerID="bb639a29020e5da8dd511236137956954c459e61e1bc167a1eb68a7cc8f39b5c"
Jul 17 06:03:06.433650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:06.433546    2567 generic.go:356] "Generic (PLEG): container finished" podID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerID="b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74" exitCode=6
Jul 17 06:03:06.434074 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:06.433645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerDied","Data":"b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74"}
Jul 17 06:03:06.434074 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:06.433719    2567 scope.go:117] "RemoveContainer" containerID="bb639a29020e5da8dd511236137956954c459e61e1bc167a1eb68a7cc8f39b5c"
Jul 17 06:03:06.434074 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:06.433817    2567 scope.go:117] "RemoveContainer" containerID="b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74"
Jul 17 06:03:06.434074 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:06.434039    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m_odh-ai-gateway-infra(57e45300-f9a4-49cc-84fa-17818fa2c079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079"
Jul 17 06:03:07.015321 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:07.015295    2567 scope.go:117] "RemoveContainer" containerID="d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b"
Jul 17 06:03:07.441295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:07.441265    2567 scope.go:117] "RemoveContainer" containerID="b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74"
Jul 17 06:03:07.441763 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:07.441488    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m_odh-ai-gateway-infra(57e45300-f9a4-49cc-84fa-17818fa2c079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079"
Jul 17 06:03:07.442839 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:07.442816    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerStarted","Data":"c42d1516bb7f7225edb849d801a97af3ae9cf72def310b11857704e9055f37e3"}
Jul 17 06:03:07.482139 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:07.482083    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" podStartSLOduration=16.48206498 podStartE2EDuration="16.48206498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:03:07.480311051 +0000 UTC m=+1805.943495158" watchObservedRunningTime="2026-07-17 06:03:07.48206498 +0000 UTC m=+1805.945249084"
Jul 17 06:03:07.619503 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:07.619420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:03:08.450385 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:08.450355    2567 generic.go:356] "Generic (PLEG): container finished" podID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerID="c42d1516bb7f7225edb849d801a97af3ae9cf72def310b11857704e9055f37e3" exitCode=6
Jul 17 06:03:08.450826 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:08.450435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerDied","Data":"c42d1516bb7f7225edb849d801a97af3ae9cf72def310b11857704e9055f37e3"}
Jul 17 06:03:08.450826 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:08.450507    2567 scope.go:117] "RemoveContainer" containerID="d6e7e0784e6436b6400302b423731d9b6545a0822b6030f58809452070ecd58b"
Jul 17 06:03:08.450959 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:08.450825    2567 scope.go:117] "RemoveContainer" containerID="c42d1516bb7f7225edb849d801a97af3ae9cf72def310b11857704e9055f37e3"
Jul 17 06:03:08.451076 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:08.451057    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-ks79q_odh-ai-gateway-infra(17c94f39-3665-4bb7-b7e9-0dec5cf8b34d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d"
Jul 17 06:03:08.492204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:08.492167    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:03:09.592284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:09.592260    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:03:09.653143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:09.653109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca\") pod \"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d\" (UID: \"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d\") "
Jul 17 06:03:09.653473 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:09.653446    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" (UID: "17c94f39-3665-4bb7-b7e9-0dec5cf8b34d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:03:09.754413 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:09.754328    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:03:10.045037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.044998    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:10.045422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045404    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.045499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045425    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.045499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045448    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.045499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045458    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.045650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045559    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.045650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.045576    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:10.048621 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.048601    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:10.057216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.057184    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:10.158382 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.158338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vzlbk\" (UID: \"63d0609f-17e3-46ff-847a-25990e794b61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:10.259755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.259716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vzlbk\" (UID: \"63d0609f-17e3-46ff-847a-25990e794b61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:10.260314 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.260293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vzlbk\" (UID: \"63d0609f-17e3-46ff-847a-25990e794b61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:10.359745 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.359657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:10.464797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.464448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q" event={"ID":"17c94f39-3665-4bb7-b7e9-0dec5cf8b34d","Type":"ContainerDied","Data":"19129fd1a03e60538fb807490abbcbee55b8bd9c2f658ccb3acef00ed00b8a60"}
Jul 17 06:03:10.464797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.464523    2567 scope.go:117] "RemoveContainer" containerID="c42d1516bb7f7225edb849d801a97af3ae9cf72def310b11857704e9055f37e3"
Jul 17 06:03:10.464797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.464554    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"
Jul 17 06:03:10.505281 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.505246    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:03:10.514133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.514107    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-ks79q"]
Jul 17 06:03:10.566361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:10.566340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:10.568443 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:03:10.568404    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d0609f_17e3_46ff_847a_25990e794b61.slice/crio-967b37f15d309b31e3846c7ae9d431152a30c3e6e2c67274cd86758ad1dce27e WatchSource:0}: Error finding container 967b37f15d309b31e3846c7ae9d431152a30c3e6e2c67274cd86758ad1dce27e: Status 404 returned error can't find the container with id 967b37f15d309b31e3846c7ae9d431152a30c3e6e2c67274cd86758ad1dce27e
Jul 17 06:03:11.472501 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:11.472468    2567 generic.go:356] "Generic (PLEG): container finished" podID="63d0609f-17e3-46ff-847a-25990e794b61" containerID="99c935e0628c614a6d0c95546efb8f9a93c9eba81bdfe58d1c7e879416054266" exitCode=7
Jul 17 06:03:11.472905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:11.472558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerDied","Data":"99c935e0628c614a6d0c95546efb8f9a93c9eba81bdfe58d1c7e879416054266"}
Jul 17 06:03:11.472905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:11.472611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerStarted","Data":"967b37f15d309b31e3846c7ae9d431152a30c3e6e2c67274cd86758ad1dce27e"}
Jul 17 06:03:11.472905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:11.472741    2567 scope.go:117] "RemoveContainer" containerID="99c935e0628c614a6d0c95546efb8f9a93c9eba81bdfe58d1c7e879416054266"
Jul 17 06:03:12.020712 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:12.020667    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" path="/var/lib/kubelet/pods/17c94f39-3665-4bb7-b7e9-0dec5cf8b34d/volumes"
Jul 17 06:03:12.480291 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:12.480258    2567 generic.go:356] "Generic (PLEG): container finished" podID="63d0609f-17e3-46ff-847a-25990e794b61" containerID="eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb" exitCode=7
Jul 17 06:03:12.480764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:12.480351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerDied","Data":"eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb"}
Jul 17 06:03:12.480764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:12.480405    2567 scope.go:117] "RemoveContainer" containerID="99c935e0628c614a6d0c95546efb8f9a93c9eba81bdfe58d1c7e879416054266"
Jul 17 06:03:12.480764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:12.480520    2567 scope.go:117] "RemoveContainer" containerID="eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb"
Jul 17 06:03:12.480764 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:12.480739    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vzlbk_odh-ai-gateway-infra(63d0609f-17e3-46ff-847a-25990e794b61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" podUID="63d0609f-17e3-46ff-847a-25990e794b61"
Jul 17 06:03:13.487437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:13.487411    2567 scope.go:117] "RemoveContainer" containerID="eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb"
Jul 17 06:03:13.487908 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:13.487711    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vzlbk_odh-ai-gateway-infra(63d0609f-17e3-46ff-847a-25990e794b61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" podUID="63d0609f-17e3-46ff-847a-25990e794b61"
Jul 17 06:03:19.015525 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:19.015496    2567 scope.go:117] "RemoveContainer" containerID="b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74"
Jul 17 06:03:19.520536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:19.520501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerStarted","Data":"5382292151d604729a992f9f36260fd3175b53b7e55bb65835022afb7190c65c"}
Jul 17 06:03:20.527918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:20.527883    2567 generic.go:356] "Generic (PLEG): container finished" podID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerID="5382292151d604729a992f9f36260fd3175b53b7e55bb65835022afb7190c65c" exitCode=6
Jul 17 06:03:20.528325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:20.527965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerDied","Data":"5382292151d604729a992f9f36260fd3175b53b7e55bb65835022afb7190c65c"}
Jul 17 06:03:20.528325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:20.528031    2567 scope.go:117] "RemoveContainer" containerID="b122d27e1ad60d129d89e0e30e2e74e8d2d4696d6239e60ddcf4f59bd2d58d74"
Jul 17 06:03:20.528458 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:20.528330    2567 scope.go:117] "RemoveContainer" containerID="5382292151d604729a992f9f36260fd3175b53b7e55bb65835022afb7190c65c"
Jul 17 06:03:20.528558 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:20.528540    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m_odh-ai-gateway-infra(57e45300-f9a4-49cc-84fa-17818fa2c079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079"
Jul 17 06:03:20.556000 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:20.555975    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:21.667092 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:21.667061    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:21.766746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:21.766712    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca\") pod \"57e45300-f9a4-49cc-84fa-17818fa2c079\" (UID: \"57e45300-f9a4-49cc-84fa-17818fa2c079\") "
Jul 17 06:03:21.767115 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:21.767095    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57e45300-f9a4-49cc-84fa-17818fa2c079" (UID: "57e45300-f9a4-49cc-84fa-17818fa2c079"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:03:21.868444 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:21.868361    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e45300-f9a4-49cc-84fa-17818fa2c079-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:03:22.541138 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:22.541107    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"
Jul 17 06:03:22.541319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:22.541104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m" event={"ID":"57e45300-f9a4-49cc-84fa-17818fa2c079","Type":"ContainerDied","Data":"2b535b82ad3bdb9fdce0c947d174ce205aa07e57c350dafc2ffcc8ca77c383ca"}
Jul 17 06:03:22.541319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:22.541230    2567 scope.go:117] "RemoveContainer" containerID="5382292151d604729a992f9f36260fd3175b53b7e55bb65835022afb7190c65c"
Jul 17 06:03:22.557897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:22.557873    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:22.560671 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:22.560647    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zq7m"]
Jul 17 06:03:24.020590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:24.020552    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" path="/var/lib/kubelet/pods/57e45300-f9a4-49cc-84fa-17818fa2c079/volumes"
Jul 17 06:03:27.015273 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:27.015244    2567 scope.go:117] "RemoveContainer" containerID="eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb"
Jul 17 06:03:27.570696 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:27.570644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerStarted","Data":"610083108cd7d752c53d3bf8ed336df1c972a7d57f40c40f8c0a35c67f0961ee"}
Jul 17 06:03:27.588840 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:27.588794    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" podStartSLOduration=17.588775057 podStartE2EDuration="17.588775057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:03:27.587733046 +0000 UTC m=+1826.050917152" watchObservedRunningTime="2026-07-17 06:03:27.588775057 +0000 UTC m=+1826.051959164"
Jul 17 06:03:28.577694 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:28.577640    2567 generic.go:356] "Generic (PLEG): container finished" podID="63d0609f-17e3-46ff-847a-25990e794b61" containerID="610083108cd7d752c53d3bf8ed336df1c972a7d57f40c40f8c0a35c67f0961ee" exitCode=7
Jul 17 06:03:28.578143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:28.577716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerDied","Data":"610083108cd7d752c53d3bf8ed336df1c972a7d57f40c40f8c0a35c67f0961ee"}
Jul 17 06:03:28.578143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:28.577786    2567 scope.go:117] "RemoveContainer" containerID="eb08777b27f5cbb4efad0113e15477891a54b490e76dd271064cc6cc27a33ceb"
Jul 17 06:03:28.578143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:28.578051    2567 scope.go:117] "RemoveContainer" containerID="610083108cd7d752c53d3bf8ed336df1c972a7d57f40c40f8c0a35c67f0961ee"
Jul 17 06:03:28.578288 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:28.578264    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vzlbk_odh-ai-gateway-infra(63d0609f-17e3-46ff-847a-25990e794b61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" podUID="63d0609f-17e3-46ff-847a-25990e794b61"
Jul 17 06:03:28.629031 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:28.629004    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:29.721145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:29.721116    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:29.838617 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:29.838529    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca\") pod \"63d0609f-17e3-46ff-847a-25990e794b61\" (UID: \"63d0609f-17e3-46ff-847a-25990e794b61\") "
Jul 17 06:03:29.838911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:29.838887    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63d0609f-17e3-46ff-847a-25990e794b61" (UID: "63d0609f-17e3-46ff-847a-25990e794b61"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:03:29.939897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:29.939859    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d0609f-17e3-46ff-847a-25990e794b61-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:03:30.591787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:30.591754    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"
Jul 17 06:03:30.591977 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:30.591788    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk" event={"ID":"63d0609f-17e3-46ff-847a-25990e794b61","Type":"ContainerDied","Data":"967b37f15d309b31e3846c7ae9d431152a30c3e6e2c67274cd86758ad1dce27e"}
Jul 17 06:03:30.591977 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:30.591853    2567 scope.go:117] "RemoveContainer" containerID="610083108cd7d752c53d3bf8ed336df1c972a7d57f40c40f8c0a35c67f0961ee"
Jul 17 06:03:30.609009 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:30.608984    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:30.615853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:30.615831    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vzlbk"]
Jul 17 06:03:32.020571 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:32.020542    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d0609f-17e3-46ff-847a-25990e794b61" path="/var/lib/kubelet/pods/63d0609f-17e3-46ff-847a-25990e794b61/volumes"
Jul 17 06:03:41.711366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711336    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711692    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711706    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711723    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711733    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711744    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711749    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711757    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711762    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711767    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711773    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711780    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.711787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711785    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.712181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711865    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.712181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711875    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.712181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711886    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:41.712181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711893    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c94f39-3665-4bb7-b7e9-0dec5cf8b34d" containerName="revoke-keys"
Jul 17 06:03:41.712181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.711901    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:41.714947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.714930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:41.717497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.717476    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:03:41.717948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.717929    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:03:41.724150 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.724129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:03:41.849895 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.849855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-57g4s\" (UID: \"e534443f-95b3-4bba-a873-525a40286dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:41.950601 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.950565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-57g4s\" (UID: \"e534443f-95b3-4bba-a873-525a40286dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:41.951202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:41.951180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-57g4s\" (UID: \"e534443f-95b3-4bba-a873-525a40286dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:42.025628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:42.025541    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:42.165368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:42.165341    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:03:42.166877 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:03:42.166843    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode534443f_95b3_4bba_a873_525a40286dd6.slice/crio-d2133ba47468cad3540de72d30fe7df6513fc07deceb8d6e8da2505c697bbda2 WatchSource:0}: Error finding container d2133ba47468cad3540de72d30fe7df6513fc07deceb8d6e8da2505c697bbda2: Status 404 returned error can't find the container with id d2133ba47468cad3540de72d30fe7df6513fc07deceb8d6e8da2505c697bbda2
Jul 17 06:03:42.657749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:42.657639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerStarted","Data":"d28c5c87ce873a4722045045695b63d026f364fa079c1119f629797ead1fe2fd"}
Jul 17 06:03:42.657749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:42.657719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerStarted","Data":"d2133ba47468cad3540de72d30fe7df6513fc07deceb8d6e8da2505c697bbda2"}
Jul 17 06:03:42.677381 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:42.677321    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" podStartSLOduration=1.67730743 podStartE2EDuration="1.67730743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:03:42.675154434 +0000 UTC m=+1841.138338539" watchObservedRunningTime="2026-07-17 06:03:42.67730743 +0000 UTC m=+1841.140491533"
Jul 17 06:03:43.664205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:43.664165    2567 generic.go:356] "Generic (PLEG): container finished" podID="e534443f-95b3-4bba-a873-525a40286dd6" containerID="d28c5c87ce873a4722045045695b63d026f364fa079c1119f629797ead1fe2fd" exitCode=6
Jul 17 06:03:43.664610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:43.664256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerDied","Data":"d28c5c87ce873a4722045045695b63d026f364fa079c1119f629797ead1fe2fd"}
Jul 17 06:03:43.664610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:43.664423    2567 scope.go:117] "RemoveContainer" containerID="d28c5c87ce873a4722045045695b63d026f364fa079c1119f629797ead1fe2fd"
Jul 17 06:03:44.672620 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:44.672583    2567 generic.go:356] "Generic (PLEG): container finished" podID="e534443f-95b3-4bba-a873-525a40286dd6" containerID="5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef" exitCode=6
Jul 17 06:03:44.673061 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:44.672628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerDied","Data":"5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef"}
Jul 17 06:03:44.673061 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:44.672695    2567 scope.go:117] "RemoveContainer" containerID="d28c5c87ce873a4722045045695b63d026f364fa079c1119f629797ead1fe2fd"
Jul 17 06:03:44.673061 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:44.672888    2567 scope.go:117] "RemoveContainer" containerID="5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef"
Jul 17 06:03:44.673186 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:44.673103    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-57g4s_odh-ai-gateway-infra(e534443f-95b3-4bba-a873-525a40286dd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" podUID="e534443f-95b3-4bba-a873-525a40286dd6"
Jul 17 06:03:45.679660 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:45.679634    2567 scope.go:117] "RemoveContainer" containerID="5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef"
Jul 17 06:03:45.680063 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:45.679855    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-57g4s_odh-ai-gateway-infra(e534443f-95b3-4bba-a873-525a40286dd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" podUID="e534443f-95b3-4bba-a873-525a40286dd6"
Jul 17 06:03:53.385384 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.385354    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:03:53.385777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.385721    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:53.385777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.385734    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:53.385851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.385806    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d0609f-17e3-46ff-847a-25990e794b61" containerName="revoke-keys"
Jul 17 06:03:53.385851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.385818    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e45300-f9a4-49cc-84fa-17818fa2c079" containerName="revoke-keys"
Jul 17 06:03:53.390073 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.390056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:03:53.399752 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.399727    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:03:53.438193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.438159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm\" (UID: \"bebfc41d-eef8-47f0-8a83-56ec056a0842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:03:53.539437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.539399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm\" (UID: \"bebfc41d-eef8-47f0-8a83-56ec056a0842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:03:53.540043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.540022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm\" (UID: \"bebfc41d-eef8-47f0-8a83-56ec056a0842\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:03:53.702180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:53.702149    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:03:54.058755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:54.058729    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:03:54.060840 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:03:54.060815    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebfc41d_eef8_47f0_8a83_56ec056a0842.slice/crio-328161e6a0bf4b0944bc74e784132702f05bfb39774cf7754f90e7a71d2304e1 WatchSource:0}: Error finding container 328161e6a0bf4b0944bc74e784132702f05bfb39774cf7754f90e7a71d2304e1: Status 404 returned error can't find the container with id 328161e6a0bf4b0944bc74e784132702f05bfb39774cf7754f90e7a71d2304e1
Jul 17 06:03:54.730363 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:54.730327    2567 generic.go:356] "Generic (PLEG): container finished" podID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerID="f24ac0d392fb13b7bc226d925225cd807e9cd1959da585e1271864fdacc10f8c" exitCode=6
Jul 17 06:03:54.730774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:54.730414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" event={"ID":"bebfc41d-eef8-47f0-8a83-56ec056a0842","Type":"ContainerDied","Data":"f24ac0d392fb13b7bc226d925225cd807e9cd1959da585e1271864fdacc10f8c"}
Jul 17 06:03:54.730774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:54.730479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" event={"ID":"bebfc41d-eef8-47f0-8a83-56ec056a0842","Type":"ContainerStarted","Data":"328161e6a0bf4b0944bc74e784132702f05bfb39774cf7754f90e7a71d2304e1"}
Jul 17 06:03:54.730774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:54.730592    2567 scope.go:117] "RemoveContainer" containerID="f24ac0d392fb13b7bc226d925225cd807e9cd1959da585e1271864fdacc10f8c"
Jul 17 06:03:55.736847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:55.736816    2567 generic.go:356] "Generic (PLEG): container finished" podID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerID="649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30" exitCode=6
Jul 17 06:03:55.737317 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:55.736886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" event={"ID":"bebfc41d-eef8-47f0-8a83-56ec056a0842","Type":"ContainerDied","Data":"649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30"}
Jul 17 06:03:55.737317 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:55.736948    2567 scope.go:117] "RemoveContainer" containerID="f24ac0d392fb13b7bc226d925225cd807e9cd1959da585e1271864fdacc10f8c"
Jul 17 06:03:55.737317 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:55.737141    2567 scope.go:117] "RemoveContainer" containerID="649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30"
Jul 17 06:03:55.737438 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:55.737386    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm_odh-ai-gateway-infra(bebfc41d-eef8-47f0-8a83-56ec056a0842)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842"
Jul 17 06:03:56.015047 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.014960    2567 scope.go:117] "RemoveContainer" containerID="5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef"
Jul 17 06:03:56.743983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.743951    2567 generic.go:356] "Generic (PLEG): container finished" podID="e534443f-95b3-4bba-a873-525a40286dd6" containerID="d59f84a28226776198369015ef5b14d0557743403b0d7cd268abc476a0666b70" exitCode=6
Jul 17 06:03:56.744416 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.744034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerDied","Data":"d59f84a28226776198369015ef5b14d0557743403b0d7cd268abc476a0666b70"}
Jul 17 06:03:56.744416 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.744101    2567 scope.go:117] "RemoveContainer" containerID="5bcbe4edf6a2ac1b0ec1ee05076bb74a08cf131d947b4b77d1187f53cfbc5cef"
Jul 17 06:03:56.744556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.744503    2567 scope.go:117] "RemoveContainer" containerID="d59f84a28226776198369015ef5b14d0557743403b0d7cd268abc476a0666b70"
Jul 17 06:03:56.744797 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:56.744763    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-57g4s_odh-ai-gateway-infra(e534443f-95b3-4bba-a873-525a40286dd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" podUID="e534443f-95b3-4bba-a873-525a40286dd6"
Jul 17 06:03:56.745905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:56.745891    2567 scope.go:117] "RemoveContainer" containerID="649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30"
Jul 17 06:03:56.746053 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:03:56.746037    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm_odh-ai-gateway-infra(bebfc41d-eef8-47f0-8a83-56ec056a0842)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842"
Jul 17 06:03:57.772497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:57.772460    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:03:57.907504 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:57.907480    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:57.979547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:57.979513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca\") pod \"e534443f-95b3-4bba-a873-525a40286dd6\" (UID: \"e534443f-95b3-4bba-a873-525a40286dd6\") "
Jul 17 06:03:57.979911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:57.979889    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e534443f-95b3-4bba-a873-525a40286dd6" (UID: "e534443f-95b3-4bba-a873-525a40286dd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:03:58.080193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.080164    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e534443f-95b3-4bba-a873-525a40286dd6-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:03:58.758956 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.758920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s" event={"ID":"e534443f-95b3-4bba-a873-525a40286dd6","Type":"ContainerDied","Data":"d2133ba47468cad3540de72d30fe7df6513fc07deceb8d6e8da2505c697bbda2"}
Jul 17 06:03:58.758956 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.758953    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"
Jul 17 06:03:58.759226 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.758986    2567 scope.go:117] "RemoveContainer" containerID="d59f84a28226776198369015ef5b14d0557743403b0d7cd268abc476a0666b70"
Jul 17 06:03:58.775492 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.775457    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:03:58.781296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:03:58.781274    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-57g4s"]
Jul 17 06:04:00.021326 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:00.021289    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e534443f-95b3-4bba-a873-525a40286dd6" path="/var/lib/kubelet/pods/e534443f-95b3-4bba-a873-525a40286dd6/volumes"
Jul 17 06:04:08.015344 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.015316    2567 scope.go:117] "RemoveContainer" containerID="649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30"
Jul 17 06:04:08.812022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.811987    2567 generic.go:356] "Generic (PLEG): container finished" podID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerID="0ea633c131cd25a972561d44f217337ac03b3c95e228c59f712eed0435b58d16" exitCode=6
Jul 17 06:04:08.812197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.812060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" event={"ID":"bebfc41d-eef8-47f0-8a83-56ec056a0842","Type":"ContainerDied","Data":"0ea633c131cd25a972561d44f217337ac03b3c95e228c59f712eed0435b58d16"}
Jul 17 06:04:08.812197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.812122    2567 scope.go:117] "RemoveContainer" containerID="649a433aaaf357cdf918208bf3d2ec9b1f0f2ebb733c7913e178945e05dabb30"
Jul 17 06:04:08.812426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.812405    2567 scope.go:117] "RemoveContainer" containerID="0ea633c131cd25a972561d44f217337ac03b3c95e228c59f712eed0435b58d16"
Jul 17 06:04:08.812640 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:08.812616    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm_odh-ai-gateway-infra(bebfc41d-eef8-47f0-8a83-56ec056a0842)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842"
Jul 17 06:04:08.912065 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:08.911976    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:04:09.956082 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:09.956053    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:04:10.088812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.088725    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca\") pod \"bebfc41d-eef8-47f0-8a83-56ec056a0842\" (UID: \"bebfc41d-eef8-47f0-8a83-56ec056a0842\") "
Jul 17 06:04:10.089205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.089175    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bebfc41d-eef8-47f0-8a83-56ec056a0842" (UID: "bebfc41d-eef8-47f0-8a83-56ec056a0842"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:04:10.112652 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.112616    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:10.112983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.112969    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.112984    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.112999    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113004    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113010    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113016    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113024    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113029    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113038    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113043    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113103    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113110    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113117    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113123    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:10.113319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.113128    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:10.116148 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.116130    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:10.122924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.122900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:10.190011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.189976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-x5fn6\" (UID: \"cdc2ce75-21a3-4c32-a018-031ee226dd5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:10.190205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.190142    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebfc41d-eef8-47f0-8a83-56ec056a0842-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:04:10.291499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.291456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-x5fn6\" (UID: \"cdc2ce75-21a3-4c32-a018-031ee226dd5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:10.292076 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.292056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-x5fn6\" (UID: \"cdc2ce75-21a3-4c32-a018-031ee226dd5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:10.428052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.427962    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:10.561707 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.561658    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:10.563143 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:04:10.563111    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc2ce75_21a3_4c32_a018_031ee226dd5a.slice/crio-01009ba1bdf099a0671aa0683e0132e843b61ffd27774f0fb256a676c136c16d WatchSource:0}: Error finding container 01009ba1bdf099a0671aa0683e0132e843b61ffd27774f0fb256a676c136c16d: Status 404 returned error can't find the container with id 01009ba1bdf099a0671aa0683e0132e843b61ffd27774f0fb256a676c136c16d
Jul 17 06:04:10.825640 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.825603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" event={"ID":"cdc2ce75-21a3-4c32-a018-031ee226dd5a","Type":"ContainerStarted","Data":"01009ba1bdf099a0671aa0683e0132e843b61ffd27774f0fb256a676c136c16d"}
Jul 17 06:04:10.826953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.826931    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm" event={"ID":"bebfc41d-eef8-47f0-8a83-56ec056a0842","Type":"ContainerDied","Data":"328161e6a0bf4b0944bc74e784132702f05bfb39774cf7754f90e7a71d2304e1"}
Jul 17 06:04:10.827046 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.826958    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"
Jul 17 06:04:10.827046 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.826986    2567 scope.go:117] "RemoveContainer" containerID="0ea633c131cd25a972561d44f217337ac03b3c95e228c59f712eed0435b58d16"
Jul 17 06:04:10.848530 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.848502    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:04:10.855707 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:10.852915    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-2bgwm"]
Jul 17 06:04:11.834999 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:11.834966    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerID="1ea7c7b956da98aea57f64e8719f46957d9269039624557b68cbc663154fd276" exitCode=7
Jul 17 06:04:11.835418 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:11.835050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" event={"ID":"cdc2ce75-21a3-4c32-a018-031ee226dd5a","Type":"ContainerDied","Data":"1ea7c7b956da98aea57f64e8719f46957d9269039624557b68cbc663154fd276"}
Jul 17 06:04:11.835418 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:11.835210    2567 scope.go:117] "RemoveContainer" containerID="1ea7c7b956da98aea57f64e8719f46957d9269039624557b68cbc663154fd276"
Jul 17 06:04:12.022086 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:12.022053    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" path="/var/lib/kubelet/pods/bebfc41d-eef8-47f0-8a83-56ec056a0842/volumes"
Jul 17 06:04:12.843076 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:12.843043    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerID="665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b" exitCode=7
Jul 17 06:04:12.843522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:12.843123    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" event={"ID":"cdc2ce75-21a3-4c32-a018-031ee226dd5a","Type":"ContainerDied","Data":"665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b"}
Jul 17 06:04:12.843522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:12.843177    2567 scope.go:117] "RemoveContainer" containerID="1ea7c7b956da98aea57f64e8719f46957d9269039624557b68cbc663154fd276"
Jul 17 06:04:12.843522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:12.843392    2567 scope.go:117] "RemoveContainer" containerID="665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b"
Jul 17 06:04:12.843736 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:12.843622    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-x5fn6_odh-ai-gateway-infra(cdc2ce75-21a3-4c32-a018-031ee226dd5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a"
Jul 17 06:04:13.849744 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:13.849719    2567 scope.go:117] "RemoveContainer" containerID="665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b"
Jul 17 06:04:13.850197 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:13.849989    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-x5fn6_odh-ai-gateway-infra(cdc2ce75-21a3-4c32-a018-031ee226dd5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a"
Jul 17 06:04:26.014930 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:26.014853    2567 scope.go:117] "RemoveContainer" containerID="665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b"
Jul 17 06:04:26.919362 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:26.919329    2567 generic.go:356] "Generic (PLEG): container finished" podID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerID="2c247ffd839de38e299af5cc7051221fe72e4d563e0f1b8717db7fafffe45822" exitCode=7
Jul 17 06:04:26.919609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:26.919407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" event={"ID":"cdc2ce75-21a3-4c32-a018-031ee226dd5a","Type":"ContainerDied","Data":"2c247ffd839de38e299af5cc7051221fe72e4d563e0f1b8717db7fafffe45822"}
Jul 17 06:04:26.919609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:26.919479    2567 scope.go:117] "RemoveContainer" containerID="665c7a77d6439e4bf135cb1c315ec44db2c3828f2f9c5c7f69bb7c5d56e6a11b"
Jul 17 06:04:26.919853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:26.919832    2567 scope.go:117] "RemoveContainer" containerID="2c247ffd839de38e299af5cc7051221fe72e4d563e0f1b8717db7fafffe45822"
Jul 17 06:04:26.920067 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:26.920046    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-x5fn6_odh-ai-gateway-infra(cdc2ce75-21a3-4c32-a018-031ee226dd5a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a"
Jul 17 06:04:27.944037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:27.944004    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:28.077668 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.077636    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:28.251350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.251241    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca\") pod \"cdc2ce75-21a3-4c32-a018-031ee226dd5a\" (UID: \"cdc2ce75-21a3-4c32-a018-031ee226dd5a\") "
Jul 17 06:04:28.251603 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.251577    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cdc2ce75-21a3-4c32-a018-031ee226dd5a" (UID: "cdc2ce75-21a3-4c32-a018-031ee226dd5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:04:28.352749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.352709    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc2ce75-21a3-4c32-a018-031ee226dd5a-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:04:28.931958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.931927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"
Jul 17 06:04:28.932157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.931964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6" event={"ID":"cdc2ce75-21a3-4c32-a018-031ee226dd5a","Type":"ContainerDied","Data":"01009ba1bdf099a0671aa0683e0132e843b61ffd27774f0fb256a676c136c16d"}
Jul 17 06:04:28.932157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.932022    2567 scope.go:117] "RemoveContainer" containerID="2c247ffd839de38e299af5cc7051221fe72e4d563e0f1b8717db7fafffe45822"
Jul 17 06:04:28.956546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.956518    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:28.964643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:28.964605    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-x5fn6"]
Jul 17 06:04:30.020427 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:30.020392    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" path="/var/lib/kubelet/pods/cdc2ce75-21a3-4c32-a018-031ee226dd5a/volumes"
Jul 17 06:04:31.749419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749390    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749750    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749762    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749771    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749777    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749788    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749795    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749807    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:31.749820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749812    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebfc41d-eef8-47f0-8a83-56ec056a0842" containerName="revoke-keys"
Jul 17 06:04:31.750081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749864    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.750081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749873    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e534443f-95b3-4bba-a873-525a40286dd6" containerName="revoke-keys"
Jul 17 06:04:31.750081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749880    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.750081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.749886    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc2ce75-21a3-4c32-a018-031ee226dd5a" containerName="revoke-keys"
Jul 17 06:04:31.754311 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.754293    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:31.757066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.757042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:04:31.757066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.757052    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:04:31.761503 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.761401    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:31.889043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.889002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf\" (UID: \"87b8a39f-27f0-4763-bb92-f1066b7b8927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:31.989619 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.989583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf\" (UID: \"87b8a39f-27f0-4763-bb92-f1066b7b8927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:31.990270 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:31.990247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf\" (UID: \"87b8a39f-27f0-4763-bb92-f1066b7b8927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:32.066655 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.066561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:32.197296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.197272    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:32.955162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.955126    2567 generic.go:356] "Generic (PLEG): container finished" podID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerID="c9cbe29fa7d39ded2c6f654d57c5db77a0d30445177c883959312fa0a6eeac50" exitCode=6
Jul 17 06:04:32.955540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.955213    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" event={"ID":"87b8a39f-27f0-4763-bb92-f1066b7b8927","Type":"ContainerDied","Data":"c9cbe29fa7d39ded2c6f654d57c5db77a0d30445177c883959312fa0a6eeac50"}
Jul 17 06:04:32.955540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.955264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" event={"ID":"87b8a39f-27f0-4763-bb92-f1066b7b8927","Type":"ContainerStarted","Data":"70d42c27da992c94a9fc7c613645266ef4168d22dd5ae2319347ca9d79951ce6"}
Jul 17 06:04:32.955540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:32.955404    2567 scope.go:117] "RemoveContainer" containerID="c9cbe29fa7d39ded2c6f654d57c5db77a0d30445177c883959312fa0a6eeac50"
Jul 17 06:04:33.962486 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:33.962456    2567 generic.go:356] "Generic (PLEG): container finished" podID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerID="b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082" exitCode=6
Jul 17 06:04:33.962988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:33.962527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" event={"ID":"87b8a39f-27f0-4763-bb92-f1066b7b8927","Type":"ContainerDied","Data":"b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082"}
Jul 17 06:04:33.962988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:33.962569    2567 scope.go:117] "RemoveContainer" containerID="c9cbe29fa7d39ded2c6f654d57c5db77a0d30445177c883959312fa0a6eeac50"
Jul 17 06:04:33.962988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:33.962810    2567 scope.go:117] "RemoveContainer" containerID="b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082"
Jul 17 06:04:33.963146 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:33.963059    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf_odh-ai-gateway-infra(87b8a39f-27f0-4763-bb92-f1066b7b8927)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927"
Jul 17 06:04:34.969621 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:34.969592    2567 scope.go:117] "RemoveContainer" containerID="b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082"
Jul 17 06:04:34.970050 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:34.969808    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf_odh-ai-gateway-infra(87b8a39f-27f0-4763-bb92-f1066b7b8927)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927"
Jul 17 06:04:43.429636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.429599    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:04:43.434133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.434116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:04:43.440084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.440058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:04:43.491967 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.491927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd\" (UID: \"eb0b25bf-2751-4719-a237-522f013dc9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:04:43.593164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.593122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd\" (UID: \"eb0b25bf-2751-4719-a237-522f013dc9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:04:43.593798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.593779    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd\" (UID: \"eb0b25bf-2751-4719-a237-522f013dc9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:04:43.746466 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.746410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:04:43.877425 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:43.877396    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:04:43.879026 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:04:43.879000    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0b25bf_2751_4719_a237_522f013dc9f2.slice/crio-3b745038d13531d54b45206e6e2ad3fb5512920d61ce5c7f8099d7ccd0efbb91 WatchSource:0}: Error finding container 3b745038d13531d54b45206e6e2ad3fb5512920d61ce5c7f8099d7ccd0efbb91: Status 404 returned error can't find the container with id 3b745038d13531d54b45206e6e2ad3fb5512920d61ce5c7f8099d7ccd0efbb91
Jul 17 06:04:44.020983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:44.020902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" event={"ID":"eb0b25bf-2751-4719-a237-522f013dc9f2","Type":"ContainerStarted","Data":"3b745038d13531d54b45206e6e2ad3fb5512920d61ce5c7f8099d7ccd0efbb91"}
Jul 17 06:04:45.024674 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:45.024641    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerID="cee641c89e8c6e1f94063b2aff054431ba00a089cc39876230fab70f6f72721b" exitCode=6
Jul 17 06:04:45.025126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:45.024727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" event={"ID":"eb0b25bf-2751-4719-a237-522f013dc9f2","Type":"ContainerDied","Data":"cee641c89e8c6e1f94063b2aff054431ba00a089cc39876230fab70f6f72721b"}
Jul 17 06:04:45.025126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:45.024952    2567 scope.go:117] "RemoveContainer" containerID="cee641c89e8c6e1f94063b2aff054431ba00a089cc39876230fab70f6f72721b"
Jul 17 06:04:46.031462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:46.031428    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerID="9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04" exitCode=6
Jul 17 06:04:46.031939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:46.031474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" event={"ID":"eb0b25bf-2751-4719-a237-522f013dc9f2","Type":"ContainerDied","Data":"9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04"}
Jul 17 06:04:46.031939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:46.031537    2567 scope.go:117] "RemoveContainer" containerID="cee641c89e8c6e1f94063b2aff054431ba00a089cc39876230fab70f6f72721b"
Jul 17 06:04:46.031939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:46.031758    2567 scope.go:117] "RemoveContainer" containerID="9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04"
Jul 17 06:04:46.032129 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:46.032023    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd_odh-ai-gateway-infra(eb0b25bf-2751-4719-a237-522f013dc9f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2"
Jul 17 06:04:47.038318 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:47.038287    2567 scope.go:117] "RemoveContainer" containerID="9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04"
Jul 17 06:04:47.038761 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:47.038487    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd_odh-ai-gateway-infra(eb0b25bf-2751-4719-a237-522f013dc9f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2"
Jul 17 06:04:50.015559 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:50.015523    2567 scope.go:117] "RemoveContainer" containerID="b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082"
Jul 17 06:04:51.060972 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:51.060936    2567 generic.go:356] "Generic (PLEG): container finished" podID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerID="3c413a80d85262c7e236ef479d036d039b4b1ff9caa816d756957b91e664f0c9" exitCode=6
Jul 17 06:04:51.061386 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:51.061014    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" event={"ID":"87b8a39f-27f0-4763-bb92-f1066b7b8927","Type":"ContainerDied","Data":"3c413a80d85262c7e236ef479d036d039b4b1ff9caa816d756957b91e664f0c9"}
Jul 17 06:04:51.061386 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:51.061075    2567 scope.go:117] "RemoveContainer" containerID="b3844c45fc3477076b3eedb7ac8640157dc7c15e9a9524e749b3b8c5608f7082"
Jul 17 06:04:51.061522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:51.061410    2567 scope.go:117] "RemoveContainer" containerID="3c413a80d85262c7e236ef479d036d039b4b1ff9caa816d756957b91e664f0c9"
Jul 17 06:04:51.061622 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:04:51.061600    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf_odh-ai-gateway-infra(87b8a39f-27f0-4763-bb92-f1066b7b8927)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927"
Jul 17 06:04:52.086030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:52.086001    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:52.230743 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:52.230717    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:52.272289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:52.272261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca\") pod \"87b8a39f-27f0-4763-bb92-f1066b7b8927\" (UID: \"87b8a39f-27f0-4763-bb92-f1066b7b8927\") "
Jul 17 06:04:52.272602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:52.272580    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87b8a39f-27f0-4763-bb92-f1066b7b8927" (UID: "87b8a39f-27f0-4763-bb92-f1066b7b8927"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:04:52.373797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:52.373709    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b8a39f-27f0-4763-bb92-f1066b7b8927-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:04:53.076693 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:53.076635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf" event={"ID":"87b8a39f-27f0-4763-bb92-f1066b7b8927","Type":"ContainerDied","Data":"70d42c27da992c94a9fc7c613645266ef4168d22dd5ae2319347ca9d79951ce6"}
Jul 17 06:04:53.076693 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:53.076669    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"
Jul 17 06:04:53.076930 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:53.076730    2567 scope.go:117] "RemoveContainer" containerID="3c413a80d85262c7e236ef479d036d039b4b1ff9caa816d756957b91e664f0c9"
Jul 17 06:04:53.099052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:53.099024    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:53.106542 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:53.106513    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-dv2xf"]
Jul 17 06:04:54.020663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:04:54.020630    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" path="/var/lib/kubelet/pods/87b8a39f-27f0-4763-bb92-f1066b7b8927/volumes"
Jul 17 06:05:00.155798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.155765    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156127    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156138    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156145    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156150    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156216    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156223    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.156244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.156232    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:00.160726 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.160706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:00.166654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.166623    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:00.247645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.247610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c8jvc\" (UID: \"8adaa900-aef9-4053-8682-acad83403f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:00.348443 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.348407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c8jvc\" (UID: \"8adaa900-aef9-4053-8682-acad83403f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:00.349068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.349046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c8jvc\" (UID: \"8adaa900-aef9-4053-8682-acad83403f52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:00.474032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.473986    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:00.607231 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:00.607201    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:00.608917 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:05:00.608886    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adaa900_aef9_4053_8682_acad83403f52.slice/crio-3637ac39e3e4483e63d96e35334e365a88d63ea47d9a41650fc0e607a5fd9773 WatchSource:0}: Error finding container 3637ac39e3e4483e63d96e35334e365a88d63ea47d9a41650fc0e607a5fd9773: Status 404 returned error can't find the container with id 3637ac39e3e4483e63d96e35334e365a88d63ea47d9a41650fc0e607a5fd9773
Jul 17 06:05:01.122969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:01.122874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerStarted","Data":"0ce1a3d5eea183b3c46f763f356561a6198cd4b611925d14d6e8de096942c0e7"}
Jul 17 06:05:01.122969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:01.122940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerStarted","Data":"3637ac39e3e4483e63d96e35334e365a88d63ea47d9a41650fc0e607a5fd9773"}
Jul 17 06:05:01.139455 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:01.139409    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" podStartSLOduration=1.13939415 podStartE2EDuration="1.13939415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:05:01.137388914 +0000 UTC m=+1919.600573019" watchObservedRunningTime="2026-07-17 06:05:01.13939415 +0000 UTC m=+1919.602578254"
Jul 17 06:05:02.018053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:02.018023    2567 scope.go:117] "RemoveContainer" containerID="9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04"
Jul 17 06:05:02.130247 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:02.130207    2567 generic.go:356] "Generic (PLEG): container finished" podID="8adaa900-aef9-4053-8682-acad83403f52" containerID="0ce1a3d5eea183b3c46f763f356561a6198cd4b611925d14d6e8de096942c0e7" exitCode=7
Jul 17 06:05:02.130461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:02.130252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerDied","Data":"0ce1a3d5eea183b3c46f763f356561a6198cd4b611925d14d6e8de096942c0e7"}
Jul 17 06:05:02.130567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:02.130551    2567 scope.go:117] "RemoveContainer" containerID="0ce1a3d5eea183b3c46f763f356561a6198cd4b611925d14d6e8de096942c0e7"
Jul 17 06:05:03.137517 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.137482    2567 generic.go:356] "Generic (PLEG): container finished" podID="8adaa900-aef9-4053-8682-acad83403f52" containerID="b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031" exitCode=7
Jul 17 06:05:03.138010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.137566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerDied","Data":"b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031"}
Jul 17 06:05:03.138010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.137626    2567 scope.go:117] "RemoveContainer" containerID="0ce1a3d5eea183b3c46f763f356561a6198cd4b611925d14d6e8de096942c0e7"
Jul 17 06:05:03.138010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.137779    2567 scope.go:117] "RemoveContainer" containerID="b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031"
Jul 17 06:05:03.138010 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:03.137992    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c8jvc_odh-ai-gateway-infra(8adaa900-aef9-4053-8682-acad83403f52)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" podUID="8adaa900-aef9-4053-8682-acad83403f52"
Jul 17 06:05:03.139476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.139455    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerID="4ab761faf0ba2a69640f812f615819e0afe33cbd470537004a9dcbfc764df5cf" exitCode=6
Jul 17 06:05:03.139579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.139504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" event={"ID":"eb0b25bf-2751-4719-a237-522f013dc9f2","Type":"ContainerDied","Data":"4ab761faf0ba2a69640f812f615819e0afe33cbd470537004a9dcbfc764df5cf"}
Jul 17 06:05:03.139809 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.139794    2567 scope.go:117] "RemoveContainer" containerID="4ab761faf0ba2a69640f812f615819e0afe33cbd470537004a9dcbfc764df5cf"
Jul 17 06:05:03.140002 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:03.139982    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd_odh-ai-gateway-infra(eb0b25bf-2751-4719-a237-522f013dc9f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2"
Jul 17 06:05:03.148981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:03.148964    2567 scope.go:117] "RemoveContainer" containerID="9e71720c172c0b71b2928cedae5159656c7175d305e0390bd9e7f1fa9c77ea04"
Jul 17 06:05:04.146820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.146792    2567 scope.go:117] "RemoveContainer" containerID="b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031"
Jul 17 06:05:04.147279 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:04.147057    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c8jvc_odh-ai-gateway-infra(8adaa900-aef9-4053-8682-acad83403f52)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" podUID="8adaa900-aef9-4053-8682-acad83403f52"
Jul 17 06:05:04.174815 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.174779    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:05:04.311132 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.311108    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:05:04.387057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.387021    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca\") pod \"eb0b25bf-2751-4719-a237-522f013dc9f2\" (UID: \"eb0b25bf-2751-4719-a237-522f013dc9f2\") "
Jul 17 06:05:04.387356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.387330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb0b25bf-2751-4719-a237-522f013dc9f2" (UID: "eb0b25bf-2751-4719-a237-522f013dc9f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:05:04.488395 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:04.488361    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0b25bf-2751-4719-a237-522f013dc9f2-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:05:05.153876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:05.153845    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"
Jul 17 06:05:05.153876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:05.153872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd" event={"ID":"eb0b25bf-2751-4719-a237-522f013dc9f2","Type":"ContainerDied","Data":"3b745038d13531d54b45206e6e2ad3fb5512920d61ce5c7f8099d7ccd0efbb91"}
Jul 17 06:05:05.154360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:05.153931    2567 scope.go:117] "RemoveContainer" containerID="4ab761faf0ba2a69640f812f615819e0afe33cbd470537004a9dcbfc764df5cf"
Jul 17 06:05:05.181453 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:05.181425    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:05:05.187790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:05.187765    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-6s5wd"]
Jul 17 06:05:06.020604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:06.020569    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" path="/var/lib/kubelet/pods/eb0b25bf-2751-4719-a237-522f013dc9f2/volumes"
Jul 17 06:05:18.015661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:18.015630    2567 scope.go:117] "RemoveContainer" containerID="b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031"
Jul 17 06:05:18.226984 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:18.226943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerStarted","Data":"170e7c664a46d91c352ec30f0868ca8e5a48a857ca2ccba726f58959ee0cd800"}
Jul 17 06:05:19.234579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:19.234546    2567 generic.go:356] "Generic (PLEG): container finished" podID="8adaa900-aef9-4053-8682-acad83403f52" containerID="170e7c664a46d91c352ec30f0868ca8e5a48a857ca2ccba726f58959ee0cd800" exitCode=7
Jul 17 06:05:19.234579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:19.234582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerDied","Data":"170e7c664a46d91c352ec30f0868ca8e5a48a857ca2ccba726f58959ee0cd800"}
Jul 17 06:05:19.235108 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:19.234633    2567 scope.go:117] "RemoveContainer" containerID="b4d0bda75ae6d6e16db29628e9771b3c3425dd1a9510dd81f63461c4e619f031"
Jul 17 06:05:19.235108 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:19.234918    2567 scope.go:117] "RemoveContainer" containerID="170e7c664a46d91c352ec30f0868ca8e5a48a857ca2ccba726f58959ee0cd800"
Jul 17 06:05:19.235213 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:19.235119    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c8jvc_odh-ai-gateway-infra(8adaa900-aef9-4053-8682-acad83403f52)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" podUID="8adaa900-aef9-4053-8682-acad83403f52"
Jul 17 06:05:19.279519 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:19.279473    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:20.379211 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:20.379185    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:20.431480 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:20.431434    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca\") pod \"8adaa900-aef9-4053-8682-acad83403f52\" (UID: \"8adaa900-aef9-4053-8682-acad83403f52\") "
Jul 17 06:05:20.431843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:20.431822    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8adaa900-aef9-4053-8682-acad83403f52" (UID: "8adaa900-aef9-4053-8682-acad83403f52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:05:20.532987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:20.532888    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adaa900-aef9-4053-8682-acad83403f52-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:05:21.247710 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:21.247652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc" event={"ID":"8adaa900-aef9-4053-8682-acad83403f52","Type":"ContainerDied","Data":"3637ac39e3e4483e63d96e35334e365a88d63ea47d9a41650fc0e607a5fd9773"}
Jul 17 06:05:21.247886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:21.247726    2567 scope.go:117] "RemoveContainer" containerID="170e7c664a46d91c352ec30f0868ca8e5a48a857ca2ccba726f58959ee0cd800"
Jul 17 06:05:21.247886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:21.247663    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"
Jul 17 06:05:21.269525 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:21.269496    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:21.273131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:21.273108    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c8jvc"]
Jul 17 06:05:22.020872 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:22.020836    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8adaa900-aef9-4053-8682-acad83403f52" path="/var/lib/kubelet/pods/8adaa900-aef9-4053-8682-acad83403f52/volumes"
Jul 17 06:05:31.791869 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.791836    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792182    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792192    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792203    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792209    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792220    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792226    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b8a39f-27f0-4763-bb92-f1066b7b8927" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792242    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792247    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792256    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792261    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792326    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792336    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:31.792662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792342    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792349    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.792662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.792354    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:31.796886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.796868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:31.800105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.800082    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:05:31.800247 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.800087    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:05:31.802366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.802346    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:31.834795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.834761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-78v5l\" (UID: \"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:31.935590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.935546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-78v5l\" (UID: \"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:31.936195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:31.936172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-78v5l\" (UID: \"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:32.110280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:32.110181    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:32.242942 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:32.242913    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:32.244445 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:05:32.244416    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cdfbe2_afcf_4f3a_84d4_496dd23f0fe0.slice/crio-c5fbd972755900fbdab735f301b7cfcfa7eaf467d168018f8e4fd6ae312dadc2 WatchSource:0}: Error finding container c5fbd972755900fbdab735f301b7cfcfa7eaf467d168018f8e4fd6ae312dadc2: Status 404 returned error can't find the container with id c5fbd972755900fbdab735f301b7cfcfa7eaf467d168018f8e4fd6ae312dadc2
Jul 17 06:05:32.314851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:32.314819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerStarted","Data":"c5fbd972755900fbdab735f301b7cfcfa7eaf467d168018f8e4fd6ae312dadc2"}
Jul 17 06:05:33.321278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:33.321191    2567 generic.go:356] "Generic (PLEG): container finished" podID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerID="65a058d47ce02a865bd4ce53b50097cdbe491d1552985864afa837f9e0d9c915" exitCode=6
Jul 17 06:05:33.321630 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:33.321271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerDied","Data":"65a058d47ce02a865bd4ce53b50097cdbe491d1552985864afa837f9e0d9c915"}
Jul 17 06:05:33.321630 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:33.321430    2567 scope.go:117] "RemoveContainer" containerID="65a058d47ce02a865bd4ce53b50097cdbe491d1552985864afa837f9e0d9c915"
Jul 17 06:05:34.328464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:34.328431    2567 generic.go:356] "Generic (PLEG): container finished" podID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerID="23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006" exitCode=6
Jul 17 06:05:34.328915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:34.328484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerDied","Data":"23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006"}
Jul 17 06:05:34.328915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:34.328533    2567 scope.go:117] "RemoveContainer" containerID="65a058d47ce02a865bd4ce53b50097cdbe491d1552985864afa837f9e0d9c915"
Jul 17 06:05:34.328915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:34.328669    2567 scope.go:117] "RemoveContainer" containerID="23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006"
Jul 17 06:05:34.329082 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:34.328963    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-78v5l_odh-ai-gateway-infra(70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0"
Jul 17 06:05:35.336012 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:35.335987    2567 scope.go:117] "RemoveContainer" containerID="23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006"
Jul 17 06:05:35.336405 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:35.336176    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-78v5l_odh-ai-gateway-infra(70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0"
Jul 17 06:05:43.479784 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.479751    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:05:43.480193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.480131    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:43.480193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.480147    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0b25bf-2751-4719-a237-522f013dc9f2" containerName="revoke-keys"
Jul 17 06:05:43.480193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.480161    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:43.480193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.480167    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:43.480326 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.480228    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adaa900-aef9-4053-8682-acad83403f52" containerName="revoke-keys"
Jul 17 06:05:43.484573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.484557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:05:43.490746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.490716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:05:43.542584 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.542545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4\" (UID: \"20aa0a05-6bcd-4a11-9e6d-355f407724f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:05:43.643629 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.643587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4\" (UID: \"20aa0a05-6bcd-4a11-9e6d-355f407724f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:05:43.644224 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.644203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4\" (UID: \"20aa0a05-6bcd-4a11-9e6d-355f407724f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:05:43.796767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.796659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:05:43.931954 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:43.931921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:05:43.933443 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:05:43.933407    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20aa0a05_6bcd_4a11_9e6d_355f407724f4.slice/crio-81ccb047f350167375db9d640ec7e5fcc717beb03437b9424d89add111f9c9f0 WatchSource:0}: Error finding container 81ccb047f350167375db9d640ec7e5fcc717beb03437b9424d89add111f9c9f0: Status 404 returned error can't find the container with id 81ccb047f350167375db9d640ec7e5fcc717beb03437b9424d89add111f9c9f0
Jul 17 06:05:44.386758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:44.386718    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerStarted","Data":"99187378f18af9a14e0b04c28121de430bbeb082eb5bb1e5c229f8ed813120f2"}
Jul 17 06:05:44.386932 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:44.386782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerStarted","Data":"81ccb047f350167375db9d640ec7e5fcc717beb03437b9424d89add111f9c9f0"}
Jul 17 06:05:44.402974 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:44.402927    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" podStartSLOduration=1.4029130570000001 podStartE2EDuration="1.402913057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:05:44.401068258 +0000 UTC m=+1962.864252359" watchObservedRunningTime="2026-07-17 06:05:44.402913057 +0000 UTC m=+1962.866097161"
Jul 17 06:05:45.393661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:45.393626    2567 generic.go:356] "Generic (PLEG): container finished" podID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerID="99187378f18af9a14e0b04c28121de430bbeb082eb5bb1e5c229f8ed813120f2" exitCode=6
Jul 17 06:05:45.394083 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:45.393716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerDied","Data":"99187378f18af9a14e0b04c28121de430bbeb082eb5bb1e5c229f8ed813120f2"}
Jul 17 06:05:45.394083 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:45.393894    2567 scope.go:117] "RemoveContainer" containerID="99187378f18af9a14e0b04c28121de430bbeb082eb5bb1e5c229f8ed813120f2"
Jul 17 06:05:46.400979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:46.400894    2567 generic.go:356] "Generic (PLEG): container finished" podID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerID="ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91" exitCode=6
Jul 17 06:05:46.400979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:46.400942    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerDied","Data":"ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91"}
Jul 17 06:05:46.401409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:46.400990    2567 scope.go:117] "RemoveContainer" containerID="99187378f18af9a14e0b04c28121de430bbeb082eb5bb1e5c229f8ed813120f2"
Jul 17 06:05:46.401409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:46.401183    2567 scope.go:117] "RemoveContainer" containerID="ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91"
Jul 17 06:05:46.401512 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:46.401411    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4_odh-ai-gateway-infra(20aa0a05-6bcd-4a11-9e6d-355f407724f4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4"
Jul 17 06:05:47.015210 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:47.015177    2567 scope.go:117] "RemoveContainer" containerID="23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006"
Jul 17 06:05:47.408493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:47.408459    2567 scope.go:117] "RemoveContainer" containerID="ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91"
Jul 17 06:05:47.408952 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:47.408713    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4_odh-ai-gateway-infra(20aa0a05-6bcd-4a11-9e6d-355f407724f4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4"
Jul 17 06:05:47.410181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:47.410156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerStarted","Data":"ddc2204603e3356d4c1ee501ec5271894653f0977e2e7d1f79ae5724fd142ec1"}
Jul 17 06:05:47.437813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:47.437757    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" podStartSLOduration=16.437738855 podStartE2EDuration="16.437738855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:05:47.437003378 +0000 UTC m=+1965.900187481" watchObservedRunningTime="2026-07-17 06:05:47.437738855 +0000 UTC m=+1965.900922962"
Jul 17 06:05:48.417846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:48.417813    2567 generic.go:356] "Generic (PLEG): container finished" podID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerID="ddc2204603e3356d4c1ee501ec5271894653f0977e2e7d1f79ae5724fd142ec1" exitCode=6
Jul 17 06:05:48.418245 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:48.417882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerDied","Data":"ddc2204603e3356d4c1ee501ec5271894653f0977e2e7d1f79ae5724fd142ec1"}
Jul 17 06:05:48.418245 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:48.417942    2567 scope.go:117] "RemoveContainer" containerID="23bfe21435d83ee2ee44cecb4c69eb027abd7e2b4e48a78338bf5eb203357006"
Jul 17 06:05:48.418245 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:48.418193    2567 scope.go:117] "RemoveContainer" containerID="ddc2204603e3356d4c1ee501ec5271894653f0977e2e7d1f79ae5724fd142ec1"
Jul 17 06:05:48.418439 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:48.418415    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-78v5l_odh-ai-gateway-infra(70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0"
Jul 17 06:05:48.447812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:48.447785    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:49.561843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:49.561819    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:49.705485 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:49.705453    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca\") pod \"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0\" (UID: \"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0\") "
Jul 17 06:05:49.705846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:49.705824    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" (UID: "70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:05:49.806970 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:49.806936    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:05:50.430843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:50.430756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l" event={"ID":"70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0","Type":"ContainerDied","Data":"c5fbd972755900fbdab735f301b7cfcfa7eaf467d168018f8e4fd6ae312dadc2"}
Jul 17 06:05:50.430843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:50.430791    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"
Jul 17 06:05:50.430843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:50.430815    2567 scope.go:117] "RemoveContainer" containerID="ddc2204603e3356d4c1ee501ec5271894653f0977e2e7d1f79ae5724fd142ec1"
Jul 17 06:05:50.447238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:50.447205    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:50.449239 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:50.449220    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-78v5l"]
Jul 17 06:05:52.021003 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:52.020972    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" path="/var/lib/kubelet/pods/70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0/volumes"
Jul 17 06:05:58.021251 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:58.021178    2567 scope.go:117] "RemoveContainer" containerID="ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91"
Jul 17 06:05:58.476057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:58.476017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerStarted","Data":"fb9e05523039cdb8e4f08a75da38243d6e1848976c3a7eb3a4bcc37ba971a6b6"}
Jul 17 06:05:59.483619 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:59.483588    2567 generic.go:356] "Generic (PLEG): container finished" podID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerID="fb9e05523039cdb8e4f08a75da38243d6e1848976c3a7eb3a4bcc37ba971a6b6" exitCode=6
Jul 17 06:05:59.484128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:59.483665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerDied","Data":"fb9e05523039cdb8e4f08a75da38243d6e1848976c3a7eb3a4bcc37ba971a6b6"}
Jul 17 06:05:59.484128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:59.483764    2567 scope.go:117] "RemoveContainer" containerID="ea8b31fe1773888a357a3384999f1c52c529a4fd12fe0356a2d810c055a01c91"
Jul 17 06:05:59.484128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:59.484083    2567 scope.go:117] "RemoveContainer" containerID="fb9e05523039cdb8e4f08a75da38243d6e1848976c3a7eb3a4bcc37ba971a6b6"
Jul 17 06:05:59.484296 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:05:59.484278    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4_odh-ai-gateway-infra(20aa0a05-6bcd-4a11-9e6d-355f407724f4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4"
Jul 17 06:05:59.526590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:05:59.526546    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:06:00.208641 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.208595    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:00.209883 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.209857    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210042 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210031    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210125    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210229    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210340 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210330    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210420    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210893    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.210918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.210919    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:00.215367 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.215343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:00.216041 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.216016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:00.293990 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.293954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-z8hh7\" (UID: \"d2d3b73f-25da-455a-a43a-26fa15802fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:00.394770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.394738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-z8hh7\" (UID: \"d2d3b73f-25da-455a-a43a-26fa15802fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:00.395382 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.395359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-z8hh7\" (UID: \"d2d3b73f-25da-455a-a43a-26fa15802fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:00.526326 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.526291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:00.644204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.644173    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:06:00.676743 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.676718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:00.678831 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:06:00.678805    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d3b73f_25da_455a_a43a_26fa15802fe7.slice/crio-aa1ac1f41602800ab1fb872db2a49f65d1dc63dda8f3bf8a61849a6f20a7d9db WatchSource:0}: Error finding container aa1ac1f41602800ab1fb872db2a49f65d1dc63dda8f3bf8a61849a6f20a7d9db: Status 404 returned error can't find the container with id aa1ac1f41602800ab1fb872db2a49f65d1dc63dda8f3bf8a61849a6f20a7d9db
Jul 17 06:06:00.697580 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.697558    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca\") pod \"20aa0a05-6bcd-4a11-9e6d-355f407724f4\" (UID: \"20aa0a05-6bcd-4a11-9e6d-355f407724f4\") "
Jul 17 06:06:00.697928 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.697906    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20aa0a05-6bcd-4a11-9e6d-355f407724f4" (UID: "20aa0a05-6bcd-4a11-9e6d-355f407724f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:06:00.798621 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:00.798534    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20aa0a05-6bcd-4a11-9e6d-355f407724f4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:06:01.498418 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.498388    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"
Jul 17 06:06:01.498623 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.498435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4" event={"ID":"20aa0a05-6bcd-4a11-9e6d-355f407724f4","Type":"ContainerDied","Data":"81ccb047f350167375db9d640ec7e5fcc717beb03437b9424d89add111f9c9f0"}
Jul 17 06:06:01.498623 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.498512    2567 scope.go:117] "RemoveContainer" containerID="fb9e05523039cdb8e4f08a75da38243d6e1848976c3a7eb3a4bcc37ba971a6b6"
Jul 17 06:06:01.500735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.500705    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerID="60f59da12fc51cb120fac3bd6710204899620552bd2500cb0153a0f2c8cdc13a" exitCode=7
Jul 17 06:06:01.500845 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.500803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" event={"ID":"d2d3b73f-25da-455a-a43a-26fa15802fe7","Type":"ContainerDied","Data":"60f59da12fc51cb120fac3bd6710204899620552bd2500cb0153a0f2c8cdc13a"}
Jul 17 06:06:01.500915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.500860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" event={"ID":"d2d3b73f-25da-455a-a43a-26fa15802fe7","Type":"ContainerStarted","Data":"aa1ac1f41602800ab1fb872db2a49f65d1dc63dda8f3bf8a61849a6f20a7d9db"}
Jul 17 06:06:01.500992 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.500977    2567 scope.go:117] "RemoveContainer" containerID="60f59da12fc51cb120fac3bd6710204899620552bd2500cb0153a0f2c8cdc13a"
Jul 17 06:06:01.530097 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.530076    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:06:01.533274 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:01.533253    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-n4hr4"]
Jul 17 06:06:02.022250 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:02.022218    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" path="/var/lib/kubelet/pods/20aa0a05-6bcd-4a11-9e6d-355f407724f4/volumes"
Jul 17 06:06:02.508572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:02.508534    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerID="75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727" exitCode=7
Jul 17 06:06:02.508788 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:02.508619    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" event={"ID":"d2d3b73f-25da-455a-a43a-26fa15802fe7","Type":"ContainerDied","Data":"75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727"}
Jul 17 06:06:02.508788 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:02.508700    2567 scope.go:117] "RemoveContainer" containerID="60f59da12fc51cb120fac3bd6710204899620552bd2500cb0153a0f2c8cdc13a"
Jul 17 06:06:02.508903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:02.508882    2567 scope.go:117] "RemoveContainer" containerID="75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727"
Jul 17 06:06:02.509145 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:02.509126    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-z8hh7_odh-ai-gateway-infra(d2d3b73f-25da-455a-a43a-26fa15802fe7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7"
Jul 17 06:06:03.516225 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:03.516195    2567 scope.go:117] "RemoveContainer" containerID="75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727"
Jul 17 06:06:03.516710 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:03.516392    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-z8hh7_odh-ai-gateway-infra(d2d3b73f-25da-455a-a43a-26fa15802fe7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7"
Jul 17 06:06:16.015417 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:16.015387    2567 scope.go:117] "RemoveContainer" containerID="75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727"
Jul 17 06:06:16.587576 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:16.587548    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerID="175e3fbd044d1cfa14f2728e860c888287b3381ae6e356bca4eca22a2cc35020" exitCode=7
Jul 17 06:06:16.587705 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:16.587616    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" event={"ID":"d2d3b73f-25da-455a-a43a-26fa15802fe7","Type":"ContainerDied","Data":"175e3fbd044d1cfa14f2728e860c888287b3381ae6e356bca4eca22a2cc35020"}
Jul 17 06:06:16.587705 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:16.587674    2567 scope.go:117] "RemoveContainer" containerID="75b3888189b5b3371aa6a752a29cf095eda6ebdbfeb901d169e44fc96c7bc727"
Jul 17 06:06:16.588003 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:16.587977    2567 scope.go:117] "RemoveContainer" containerID="175e3fbd044d1cfa14f2728e860c888287b3381ae6e356bca4eca22a2cc35020"
Jul 17 06:06:16.588212 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:16.588193    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-z8hh7_odh-ai-gateway-infra(d2d3b73f-25da-455a-a43a-26fa15802fe7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7"
Jul 17 06:06:17.614195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:17.614160    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:17.754043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:17.754016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:17.857364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:17.857327    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca\") pod \"d2d3b73f-25da-455a-a43a-26fa15802fe7\" (UID: \"d2d3b73f-25da-455a-a43a-26fa15802fe7\") "
Jul 17 06:06:17.857764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:17.857742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2d3b73f-25da-455a-a43a-26fa15802fe7" (UID: "d2d3b73f-25da-455a-a43a-26fa15802fe7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:06:17.958637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:17.958600    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d3b73f-25da-455a-a43a-26fa15802fe7-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:06:18.600826 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:18.600784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7" event={"ID":"d2d3b73f-25da-455a-a43a-26fa15802fe7","Type":"ContainerDied","Data":"aa1ac1f41602800ab1fb872db2a49f65d1dc63dda8f3bf8a61849a6f20a7d9db"}
Jul 17 06:06:18.601036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:18.600849    2567 scope.go:117] "RemoveContainer" containerID="175e3fbd044d1cfa14f2728e860c888287b3381ae6e356bca4eca22a2cc35020"
Jul 17 06:06:18.601036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:18.600804    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"
Jul 17 06:06:18.616093 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:18.616068    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:18.620273 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:18.620252    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-z8hh7"]
Jul 17 06:06:20.021237 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:20.021203    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" path="/var/lib/kubelet/pods/d2d3b73f-25da-455a-a43a-26fa15802fe7/volumes"
Jul 17 06:06:21.834649 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.834610    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:21.835190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835169    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835194    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835207    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835216    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835227    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835236    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835254    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835262    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835277    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835286    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835312    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835321    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835410    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835422    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835435    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d3b73f-25da-455a-a43a-26fa15802fe7" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835444    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835456    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cdfbe2-afcf-4f3a-84d4-496dd23f0fe0" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835466    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.835746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.835473    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20aa0a05-6bcd-4a11-9e6d-355f407724f4" containerName="revoke-keys"
Jul 17 06:06:21.840054 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.840032    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:21.842592 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.842566    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:06:21.842758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.842567    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:06:21.844880 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.844858    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:21.994971 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:21.994913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-42kgv\" (UID: \"83db7365-1d0e-4bd2-b933-a7b99bc33ac4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:22.096279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.096178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-42kgv\" (UID: \"83db7365-1d0e-4bd2-b933-a7b99bc33ac4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:22.096981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.096955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-42kgv\" (UID: \"83db7365-1d0e-4bd2-b933-a7b99bc33ac4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:22.151447 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.151412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:22.285111 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.285081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:22.286835 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:06:22.286810    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83db7365_1d0e_4bd2_b933_a7b99bc33ac4.slice/crio-5983a6755f56dcf52bfd51a8c4239203532f3e0400dd0f72bd74f2aac200e4e0 WatchSource:0}: Error finding container 5983a6755f56dcf52bfd51a8c4239203532f3e0400dd0f72bd74f2aac200e4e0: Status 404 returned error can't find the container with id 5983a6755f56dcf52bfd51a8c4239203532f3e0400dd0f72bd74f2aac200e4e0
Jul 17 06:06:22.623640 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.623605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerStarted","Data":"854b51caf0aec8c64e32db517b5fce8ec6a2cc6db848d71219a01a7db161c363"}
Jul 17 06:06:22.623811 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.623656    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerStarted","Data":"5983a6755f56dcf52bfd51a8c4239203532f3e0400dd0f72bd74f2aac200e4e0"}
Jul 17 06:06:22.639968 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:22.639901    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" podStartSLOduration=1.639885641 podStartE2EDuration="1.639885641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:06:22.6385853 +0000 UTC m=+2001.101769414" watchObservedRunningTime="2026-07-17 06:06:22.639885641 +0000 UTC m=+2001.103069745"
Jul 17 06:06:23.629778 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:23.629737    2567 generic.go:356] "Generic (PLEG): container finished" podID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerID="854b51caf0aec8c64e32db517b5fce8ec6a2cc6db848d71219a01a7db161c363" exitCode=6
Jul 17 06:06:23.630194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:23.629825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerDied","Data":"854b51caf0aec8c64e32db517b5fce8ec6a2cc6db848d71219a01a7db161c363"}
Jul 17 06:06:23.630194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:23.630038    2567 scope.go:117] "RemoveContainer" containerID="854b51caf0aec8c64e32db517b5fce8ec6a2cc6db848d71219a01a7db161c363"
Jul 17 06:06:24.637554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:24.637518    2567 generic.go:356] "Generic (PLEG): container finished" podID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerID="0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93" exitCode=6
Jul 17 06:06:24.638058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:24.637562    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerDied","Data":"0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93"}
Jul 17 06:06:24.638058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:24.637610    2567 scope.go:117] "RemoveContainer" containerID="854b51caf0aec8c64e32db517b5fce8ec6a2cc6db848d71219a01a7db161c363"
Jul 17 06:06:24.638058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:24.637876    2567 scope.go:117] "RemoveContainer" containerID="0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93"
Jul 17 06:06:24.638225 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:24.638122    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-42kgv_odh-ai-gateway-infra(83db7365-1d0e-4bd2-b933-a7b99bc33ac4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4"
Jul 17 06:06:25.644608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:25.644584    2567 scope.go:117] "RemoveContainer" containerID="0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93"
Jul 17 06:06:25.645009 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:25.644779    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-42kgv_odh-ai-gateway-infra(83db7365-1d0e-4bd2-b933-a7b99bc33ac4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4"
Jul 17 06:06:33.524201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.524170    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:33.528981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.528961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:33.535544 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.535517    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:33.700422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.700392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-s5srr\" (UID: \"f1f2dc67-7f47-47d8-9c28-40b90e026b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:33.801800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.801715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-s5srr\" (UID: \"f1f2dc67-7f47-47d8-9c28-40b90e026b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:33.802344 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.802323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-s5srr\" (UID: \"f1f2dc67-7f47-47d8-9c28-40b90e026b6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:33.840963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.840928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:33.974968 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:33.974941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:33.976974 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:06:33.976945    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f2dc67_7f47_47d8_9c28_40b90e026b6f.slice/crio-bcfd52ae4f5ac8b01eba9bf086ca061c56b455ea74b0959f6d3a458d584ae9a0 WatchSource:0}: Error finding container bcfd52ae4f5ac8b01eba9bf086ca061c56b455ea74b0959f6d3a458d584ae9a0: Status 404 returned error can't find the container with id bcfd52ae4f5ac8b01eba9bf086ca061c56b455ea74b0959f6d3a458d584ae9a0
Jul 17 06:06:34.700455 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:34.700422    2567 generic.go:356] "Generic (PLEG): container finished" podID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerID="fd160d9ce787e3f73974eb1f6a63b9ad94c4fd8eb3185166536f83daafa5e5f9" exitCode=6
Jul 17 06:06:34.700963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:34.700513    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" event={"ID":"f1f2dc67-7f47-47d8-9c28-40b90e026b6f","Type":"ContainerDied","Data":"fd160d9ce787e3f73974eb1f6a63b9ad94c4fd8eb3185166536f83daafa5e5f9"}
Jul 17 06:06:34.700963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:34.700580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" event={"ID":"f1f2dc67-7f47-47d8-9c28-40b90e026b6f","Type":"ContainerStarted","Data":"bcfd52ae4f5ac8b01eba9bf086ca061c56b455ea74b0959f6d3a458d584ae9a0"}
Jul 17 06:06:34.700963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:34.700711    2567 scope.go:117] "RemoveContainer" containerID="fd160d9ce787e3f73974eb1f6a63b9ad94c4fd8eb3185166536f83daafa5e5f9"
Jul 17 06:06:35.707921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:35.707890    2567 generic.go:356] "Generic (PLEG): container finished" podID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerID="f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550" exitCode=6
Jul 17 06:06:35.708348 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:35.707957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" event={"ID":"f1f2dc67-7f47-47d8-9c28-40b90e026b6f","Type":"ContainerDied","Data":"f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550"}
Jul 17 06:06:35.708348 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:35.708003    2567 scope.go:117] "RemoveContainer" containerID="fd160d9ce787e3f73974eb1f6a63b9ad94c4fd8eb3185166536f83daafa5e5f9"
Jul 17 06:06:35.708348 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:35.708163    2567 scope.go:117] "RemoveContainer" containerID="f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550"
Jul 17 06:06:35.708462 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:35.708390    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-s5srr_odh-ai-gateway-infra(f1f2dc67-7f47-47d8-9c28-40b90e026b6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f"
Jul 17 06:06:36.015829 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.015748    2567 scope.go:117] "RemoveContainer" containerID="0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93"
Jul 17 06:06:36.715585 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.715557    2567 scope.go:117] "RemoveContainer" containerID="f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550"
Jul 17 06:06:36.716126 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:36.715813    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-s5srr_odh-ai-gateway-infra(f1f2dc67-7f47-47d8-9c28-40b90e026b6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f"
Jul 17 06:06:36.717354 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.717326    2567 generic.go:356] "Generic (PLEG): container finished" podID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerID="58f1c301744722eb49344844911a93783ec202ed960548c25d2381cd5dfcf6f6" exitCode=6
Jul 17 06:06:36.717505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.717393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerDied","Data":"58f1c301744722eb49344844911a93783ec202ed960548c25d2381cd5dfcf6f6"}
Jul 17 06:06:36.717505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.717444    2567 scope.go:117] "RemoveContainer" containerID="0fa49c6246bca156722460fed06d409c486ceb1116f12aa21d73fc420d042a93"
Jul 17 06:06:36.717708 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:36.717673    2567 scope.go:117] "RemoveContainer" containerID="58f1c301744722eb49344844911a93783ec202ed960548c25d2381cd5dfcf6f6"
Jul 17 06:06:36.717908 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:36.717889    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-42kgv_odh-ai-gateway-infra(83db7365-1d0e-4bd2-b933-a7b99bc33ac4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4"
Jul 17 06:06:37.757502 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:37.757469    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:37.900563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:37.900533    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:38.039889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.039808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca\") pod \"83db7365-1d0e-4bd2-b933-a7b99bc33ac4\" (UID: \"83db7365-1d0e-4bd2-b933-a7b99bc33ac4\") "
Jul 17 06:06:38.040119 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.040095    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83db7365-1d0e-4bd2-b933-a7b99bc33ac4" (UID: "83db7365-1d0e-4bd2-b933-a7b99bc33ac4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:06:38.140921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.140890    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83db7365-1d0e-4bd2-b933-a7b99bc33ac4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:06:38.730369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.730338    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"
Jul 17 06:06:38.730561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.730345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv" event={"ID":"83db7365-1d0e-4bd2-b933-a7b99bc33ac4","Type":"ContainerDied","Data":"5983a6755f56dcf52bfd51a8c4239203532f3e0400dd0f72bd74f2aac200e4e0"}
Jul 17 06:06:38.730561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.730481    2567 scope.go:117] "RemoveContainer" containerID="58f1c301744722eb49344844911a93783ec202ed960548c25d2381cd5dfcf6f6"
Jul 17 06:06:38.751387 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.751362    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:38.753344 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:38.753324    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-42kgv"]
Jul 17 06:06:40.020608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:40.020573    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" path="/var/lib/kubelet/pods/83db7365-1d0e-4bd2-b933-a7b99bc33ac4/volumes"
Jul 17 06:06:48.015608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:48.015575    2567 scope.go:117] "RemoveContainer" containerID="f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550"
Jul 17 06:06:48.786052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:48.786019    2567 generic.go:356] "Generic (PLEG): container finished" podID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerID="64d8db4800fb6effeb3e30c0560cd4f9c726be45ddc8fafcec91e41be1f57a2c" exitCode=6
Jul 17 06:06:48.786255 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:48.786091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" event={"ID":"f1f2dc67-7f47-47d8-9c28-40b90e026b6f","Type":"ContainerDied","Data":"64d8db4800fb6effeb3e30c0560cd4f9c726be45ddc8fafcec91e41be1f57a2c"}
Jul 17 06:06:48.786255 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:48.786155    2567 scope.go:117] "RemoveContainer" containerID="f9ef431c977aa0a1f5e7fc883e356cc67dc4e9518485d15a64d7a69d2f117550"
Jul 17 06:06:48.786441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:48.786416    2567 scope.go:117] "RemoveContainer" containerID="64d8db4800fb6effeb3e30c0560cd4f9c726be45ddc8fafcec91e41be1f57a2c"
Jul 17 06:06:48.786673 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:48.786652    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-s5srr_odh-ai-gateway-infra(f1f2dc67-7f47-47d8-9c28-40b90e026b6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f"
Jul 17 06:06:49.812422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:49.812384    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:49.955515 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:49.955491    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:50.041859 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.041834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca\") pod \"f1f2dc67-7f47-47d8-9c28-40b90e026b6f\" (UID: \"f1f2dc67-7f47-47d8-9c28-40b90e026b6f\") "
Jul 17 06:06:50.042175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.042153    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1f2dc67-7f47-47d8-9c28-40b90e026b6f" (UID: "f1f2dc67-7f47-47d8-9c28-40b90e026b6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:06:50.142823 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.142741    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f2dc67-7f47-47d8-9c28-40b90e026b6f-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:06:50.251409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251374    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:06:50.251750 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251750 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251750    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251759    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251765    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251775    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251788    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251793    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251799    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251804    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251809    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.251850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251814    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251866    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251872    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251878    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251884    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251890    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db7365-1d0e-4bd2-b933-a7b99bc33ac4" containerName="revoke-keys"
Jul 17 06:06:50.252129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.251895    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" containerName="revoke-keys"
Jul 17 06:06:50.254930 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.254914    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:06:50.261469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.261439    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:06:50.345106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.345068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5zbkp\" (UID: \"049fb656-fb6f-4904-bb3e-5475fc7b1880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:06:50.445938 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.445904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5zbkp\" (UID: \"049fb656-fb6f-4904-bb3e-5475fc7b1880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:06:50.446550 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.446531    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5zbkp\" (UID: \"049fb656-fb6f-4904-bb3e-5475fc7b1880\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:06:50.566113 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.566073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:06:50.698153 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.698125    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:06:50.700626 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:06:50.700601    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049fb656_fb6f_4904_bb3e_5475fc7b1880.slice/crio-08b5f49e3f7c6805af9129796d7a5b9999cf04a2b55b12c5c9c70f722aab9a45 WatchSource:0}: Error finding container 08b5f49e3f7c6805af9129796d7a5b9999cf04a2b55b12c5c9c70f722aab9a45: Status 404 returned error can't find the container with id 08b5f49e3f7c6805af9129796d7a5b9999cf04a2b55b12c5c9c70f722aab9a45
Jul 17 06:06:50.799720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.799664    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"
Jul 17 06:06:50.799910 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.799664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr" event={"ID":"f1f2dc67-7f47-47d8-9c28-40b90e026b6f","Type":"ContainerDied","Data":"bcfd52ae4f5ac8b01eba9bf086ca061c56b455ea74b0959f6d3a458d584ae9a0"}
Jul 17 06:06:50.799910 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.799836    2567 scope.go:117] "RemoveContainer" containerID="64d8db4800fb6effeb3e30c0560cd4f9c726be45ddc8fafcec91e41be1f57a2c"
Jul 17 06:06:50.801026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.801003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" event={"ID":"049fb656-fb6f-4904-bb3e-5475fc7b1880","Type":"ContainerStarted","Data":"08b5f49e3f7c6805af9129796d7a5b9999cf04a2b55b12c5c9c70f722aab9a45"}
Jul 17 06:06:50.820321 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.820297    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:50.825923 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:50.825902    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-s5srr"]
Jul 17 06:06:51.812491 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:51.812459    2567 generic.go:356] "Generic (PLEG): container finished" podID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerID="e7c40384f0f1091ea9de4f52af428901f04409cb4bf72698ceb6f1f06d745057" exitCode=7
Jul 17 06:06:51.812661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:51.812523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" event={"ID":"049fb656-fb6f-4904-bb3e-5475fc7b1880","Type":"ContainerDied","Data":"e7c40384f0f1091ea9de4f52af428901f04409cb4bf72698ceb6f1f06d745057"}
Jul 17 06:06:51.812780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:51.812767    2567 scope.go:117] "RemoveContainer" containerID="e7c40384f0f1091ea9de4f52af428901f04409cb4bf72698ceb6f1f06d745057"
Jul 17 06:06:52.022156 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:52.022125    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f2dc67-7f47-47d8-9c28-40b90e026b6f" path="/var/lib/kubelet/pods/f1f2dc67-7f47-47d8-9c28-40b90e026b6f/volumes"
Jul 17 06:06:52.819366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:52.819333    2567 generic.go:356] "Generic (PLEG): container finished" podID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerID="8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b" exitCode=7
Jul 17 06:06:52.819572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:52.819409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" event={"ID":"049fb656-fb6f-4904-bb3e-5475fc7b1880","Type":"ContainerDied","Data":"8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b"}
Jul 17 06:06:52.819572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:52.819476    2567 scope.go:117] "RemoveContainer" containerID="e7c40384f0f1091ea9de4f52af428901f04409cb4bf72698ceb6f1f06d745057"
Jul 17 06:06:52.819733 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:52.819717    2567 scope.go:117] "RemoveContainer" containerID="8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b"
Jul 17 06:06:52.819971 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:52.819948    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5zbkp_odh-ai-gateway-infra(049fb656-fb6f-4904-bb3e-5475fc7b1880)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880"
Jul 17 06:06:53.826822 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:06:53.826796    2567 scope.go:117] "RemoveContainer" containerID="8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b"
Jul 17 06:06:53.827215 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:06:53.827000    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5zbkp_odh-ai-gateway-infra(049fb656-fb6f-4904-bb3e-5475fc7b1880)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880"
Jul 17 06:07:04.015002 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:04.014968    2567 scope.go:117] "RemoveContainer" containerID="8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b"
Jul 17 06:07:04.886511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:04.886421    2567 generic.go:356] "Generic (PLEG): container finished" podID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerID="0e11118c13921e58428bf49a0fa16866738395ad00159e46b8f3fb459dedecac" exitCode=7
Jul 17 06:07:04.886511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:04.886495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" event={"ID":"049fb656-fb6f-4904-bb3e-5475fc7b1880","Type":"ContainerDied","Data":"0e11118c13921e58428bf49a0fa16866738395ad00159e46b8f3fb459dedecac"}
Jul 17 06:07:04.886731 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:04.886556    2567 scope.go:117] "RemoveContainer" containerID="8292940c31473c37c9432ad0cd06591f842b298094097fccc81b890359df6c8b"
Jul 17 06:07:04.886851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:04.886830    2567 scope.go:117] "RemoveContainer" containerID="0e11118c13921e58428bf49a0fa16866738395ad00159e46b8f3fb459dedecac"
Jul 17 06:07:04.887045 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:04.887026    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5zbkp_odh-ai-gateway-infra(049fb656-fb6f-4904-bb3e-5475fc7b1880)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880"
Jul 17 06:07:05.914360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:05.914321    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:07:06.048691 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.048651    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:07:06.191437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.191335    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca\") pod \"049fb656-fb6f-4904-bb3e-5475fc7b1880\" (UID: \"049fb656-fb6f-4904-bb3e-5475fc7b1880\") "
Jul 17 06:07:06.191724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.191675    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "049fb656-fb6f-4904-bb3e-5475fc7b1880" (UID: "049fb656-fb6f-4904-bb3e-5475fc7b1880"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:07:06.292056 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.292019    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/049fb656-fb6f-4904-bb3e-5475fc7b1880-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:07:06.900368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.900335    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"
Jul 17 06:07:06.900547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.900391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp" event={"ID":"049fb656-fb6f-4904-bb3e-5475fc7b1880","Type":"ContainerDied","Data":"08b5f49e3f7c6805af9129796d7a5b9999cf04a2b55b12c5c9c70f722aab9a45"}
Jul 17 06:07:06.900547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.900490    2567 scope.go:117] "RemoveContainer" containerID="0e11118c13921e58428bf49a0fa16866738395ad00159e46b8f3fb459dedecac"
Jul 17 06:07:06.930439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.930407    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:07:06.936233 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:06.936209    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5zbkp"]
Jul 17 06:07:08.020876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:08.020838    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" path="/var/lib/kubelet/pods/049fb656-fb6f-4904-bb3e-5475fc7b1880/volumes"
Jul 17 06:07:11.879115 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879082    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879433    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879443    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879452    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879458    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879467    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879472    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879531    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.879716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.879538    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:11.883918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.883901    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:11.886421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.886397    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:07:11.887384 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.887365    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:07:11.888993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:11.888940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:12.045791 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.045757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fljnr\" (UID: \"8815801d-3f6c-40fc-90fd-3106878146cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:12.147002 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.146927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fljnr\" (UID: \"8815801d-3f6c-40fc-90fd-3106878146cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:12.147558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.147536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fljnr\" (UID: \"8815801d-3f6c-40fc-90fd-3106878146cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:12.195614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.195585    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:12.540176 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.540150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:12.542291 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:07:12.542263    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8815801d_3f6c_40fc_90fd_3106878146cd.slice/crio-0b82efabd2709dcc73b14cdafe292447d37dc5f186022204c619b8d3718310cf WatchSource:0}: Error finding container 0b82efabd2709dcc73b14cdafe292447d37dc5f186022204c619b8d3718310cf: Status 404 returned error can't find the container with id 0b82efabd2709dcc73b14cdafe292447d37dc5f186022204c619b8d3718310cf
Jul 17 06:07:12.936066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.935970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerStarted","Data":"3bdf16641db1edd96d2a88532bd5d6908118a9505a2d91b431e1ffc4b176b134"}
Jul 17 06:07:12.936066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.936031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerStarted","Data":"0b82efabd2709dcc73b14cdafe292447d37dc5f186022204c619b8d3718310cf"}
Jul 17 06:07:12.951973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:12.951920    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" podStartSLOduration=1.951905451 podStartE2EDuration="1.951905451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:07:12.950735681 +0000 UTC m=+2051.413919787" watchObservedRunningTime="2026-07-17 06:07:12.951905451 +0000 UTC m=+2051.415089587"
Jul 17 06:07:13.942504 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:13.942472    2567 generic.go:356] "Generic (PLEG): container finished" podID="8815801d-3f6c-40fc-90fd-3106878146cd" containerID="3bdf16641db1edd96d2a88532bd5d6908118a9505a2d91b431e1ffc4b176b134" exitCode=6
Jul 17 06:07:13.942990 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:13.942564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerDied","Data":"3bdf16641db1edd96d2a88532bd5d6908118a9505a2d91b431e1ffc4b176b134"}
Jul 17 06:07:13.942990 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:13.942744    2567 scope.go:117] "RemoveContainer" containerID="3bdf16641db1edd96d2a88532bd5d6908118a9505a2d91b431e1ffc4b176b134"
Jul 17 06:07:14.950665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:14.950635    2567 generic.go:356] "Generic (PLEG): container finished" podID="8815801d-3f6c-40fc-90fd-3106878146cd" containerID="fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91" exitCode=6
Jul 17 06:07:14.951102 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:14.950727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerDied","Data":"fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91"}
Jul 17 06:07:14.951102 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:14.950789    2567 scope.go:117] "RemoveContainer" containerID="3bdf16641db1edd96d2a88532bd5d6908118a9505a2d91b431e1ffc4b176b134"
Jul 17 06:07:14.951102 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:14.951016    2567 scope.go:117] "RemoveContainer" containerID="fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91"
Jul 17 06:07:14.951257 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:14.951238    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fljnr_odh-ai-gateway-infra(8815801d-3f6c-40fc-90fd-3106878146cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" podUID="8815801d-3f6c-40fc-90fd-3106878146cd"
Jul 17 06:07:15.957441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:15.957416    2567 scope.go:117] "RemoveContainer" containerID="fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91"
Jul 17 06:07:15.957856 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:15.957617    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fljnr_odh-ai-gateway-infra(8815801d-3f6c-40fc-90fd-3106878146cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" podUID="8815801d-3f6c-40fc-90fd-3106878146cd"
Jul 17 06:07:23.573514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.573427    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:23.573957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.573940    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="049fb656-fb6f-4904-bb3e-5475fc7b1880" containerName="revoke-keys"
Jul 17 06:07:23.578145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.578130    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:23.584268 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.584237    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:23.645393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.645347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-gml7f\" (UID: \"45613bb7-77f0-4666-92c0-82a3fbbefb32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:23.746518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.746484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-gml7f\" (UID: \"45613bb7-77f0-4666-92c0-82a3fbbefb32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:23.747137 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.747117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-gml7f\" (UID: \"45613bb7-77f0-4666-92c0-82a3fbbefb32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:23.890885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:23.890794    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:24.031445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:24.031413    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:24.031573 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:07:24.031552    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45613bb7_77f0_4666_92c0_82a3fbbefb32.slice/crio-98f7487a45fe9d68e4d24dfc92455f4a0322f85fe49af9b38715822888c6a832 WatchSource:0}: Error finding container 98f7487a45fe9d68e4d24dfc92455f4a0322f85fe49af9b38715822888c6a832: Status 404 returned error can't find the container with id 98f7487a45fe9d68e4d24dfc92455f4a0322f85fe49af9b38715822888c6a832
Jul 17 06:07:25.006757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:25.006723    2567 generic.go:356] "Generic (PLEG): container finished" podID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerID="cf2a01fce94128e2f2c15e810eaa61630e8473110966d41796de545036438616" exitCode=6
Jul 17 06:07:25.007121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:25.006815    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" event={"ID":"45613bb7-77f0-4666-92c0-82a3fbbefb32","Type":"ContainerDied","Data":"cf2a01fce94128e2f2c15e810eaa61630e8473110966d41796de545036438616"}
Jul 17 06:07:25.007121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:25.006867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" event={"ID":"45613bb7-77f0-4666-92c0-82a3fbbefb32","Type":"ContainerStarted","Data":"98f7487a45fe9d68e4d24dfc92455f4a0322f85fe49af9b38715822888c6a832"}
Jul 17 06:07:25.007121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:25.007018    2567 scope.go:117] "RemoveContainer" containerID="cf2a01fce94128e2f2c15e810eaa61630e8473110966d41796de545036438616"
Jul 17 06:07:26.014302 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:26.014265    2567 generic.go:356] "Generic (PLEG): container finished" podID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerID="440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad" exitCode=6
Jul 17 06:07:26.014831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:26.014337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" event={"ID":"45613bb7-77f0-4666-92c0-82a3fbbefb32","Type":"ContainerDied","Data":"440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad"}
Jul 17 06:07:26.014831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:26.014541    2567 scope.go:117] "RemoveContainer" containerID="cf2a01fce94128e2f2c15e810eaa61630e8473110966d41796de545036438616"
Jul 17 06:07:26.014831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:26.014659    2567 scope.go:117] "RemoveContainer" containerID="440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad"
Jul 17 06:07:26.015018 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:26.014905    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-gml7f_odh-ai-gateway-infra(45613bb7-77f0-4666-92c0-82a3fbbefb32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32"
Jul 17 06:07:27.022530 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:27.022504    2567 scope.go:117] "RemoveContainer" containerID="440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad"
Jul 17 06:07:27.022940 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:27.022714    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-gml7f_odh-ai-gateway-infra(45613bb7-77f0-4666-92c0-82a3fbbefb32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32"
Jul 17 06:07:30.015048 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:30.015020    2567 scope.go:117] "RemoveContainer" containerID="fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91"
Jul 17 06:07:31.044653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:31.044622    2567 generic.go:356] "Generic (PLEG): container finished" podID="8815801d-3f6c-40fc-90fd-3106878146cd" containerID="a5b276232a45490a4924a958e265d6418949720b9c230eb00ef4193b20b7f6c7" exitCode=6
Jul 17 06:07:31.045143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:31.044705    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerDied","Data":"a5b276232a45490a4924a958e265d6418949720b9c230eb00ef4193b20b7f6c7"}
Jul 17 06:07:31.045143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:31.044766    2567 scope.go:117] "RemoveContainer" containerID="fdd7eb3fd8aa4d32a7db6590cc36bf3cadf0f5ab6c3d0df35ee84c24c961dc91"
Jul 17 06:07:31.045143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:31.045114    2567 scope.go:117] "RemoveContainer" containerID="a5b276232a45490a4924a958e265d6418949720b9c230eb00ef4193b20b7f6c7"
Jul 17 06:07:31.045354 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:31.045321    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fljnr_odh-ai-gateway-infra(8815801d-3f6c-40fc-90fd-3106878146cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" podUID="8815801d-3f6c-40fc-90fd-3106878146cd"
Jul 17 06:07:32.070030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:32.069998    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:32.212494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:32.212470    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:32.318351 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:32.318319    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca\") pod \"8815801d-3f6c-40fc-90fd-3106878146cd\" (UID: \"8815801d-3f6c-40fc-90fd-3106878146cd\") "
Jul 17 06:07:32.318726 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:32.318701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8815801d-3f6c-40fc-90fd-3106878146cd" (UID: "8815801d-3f6c-40fc-90fd-3106878146cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:07:32.419302 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:32.419221    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8815801d-3f6c-40fc-90fd-3106878146cd-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:07:33.057709 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:33.057655    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"
Jul 17 06:07:33.057918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:33.057644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr" event={"ID":"8815801d-3f6c-40fc-90fd-3106878146cd","Type":"ContainerDied","Data":"0b82efabd2709dcc73b14cdafe292447d37dc5f186022204c619b8d3718310cf"}
Jul 17 06:07:33.057918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:33.057793    2567 scope.go:117] "RemoveContainer" containerID="a5b276232a45490a4924a958e265d6418949720b9c230eb00ef4193b20b7f6c7"
Jul 17 06:07:33.077848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:33.077821    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:33.082860 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:33.082838    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fljnr"]
Jul 17 06:07:34.021442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:34.021406    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" path="/var/lib/kubelet/pods/8815801d-3f6c-40fc-90fd-3106878146cd/volumes"
Jul 17 06:07:40.293489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293452    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293824    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293836    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293856    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293862    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293926    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293933    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.293983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.293941    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:07:40.297015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.296998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:40.303573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.303545    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:07:40.390929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.390897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-8tj77\" (UID: \"b51d165b-94c0-42fa-9709-a7ac133b2487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:40.492423 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.492383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-8tj77\" (UID: \"b51d165b-94c0-42fa-9709-a7ac133b2487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:40.493120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.493090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-8tj77\" (UID: \"b51d165b-94c0-42fa-9709-a7ac133b2487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:40.609121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.609022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:40.743546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:40.743520    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:07:40.745359 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:07:40.745329    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51d165b_94c0_42fa_9709_a7ac133b2487.slice/crio-8058f93a5c8ccabcd534c80f77ca2afc159b849ee359f04266882a5b832a5fac WatchSource:0}: Error finding container 8058f93a5c8ccabcd534c80f77ca2afc159b849ee359f04266882a5b832a5fac: Status 404 returned error can't find the container with id 8058f93a5c8ccabcd534c80f77ca2afc159b849ee359f04266882a5b832a5fac
Jul 17 06:07:41.103202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:41.103154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerStarted","Data":"f2f7220418891360cd2ef3f83654a092a8fb6adb1a3fca8c13993ea274ebb1a3"}
Jul 17 06:07:41.103398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:41.103214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerStarted","Data":"8058f93a5c8ccabcd534c80f77ca2afc159b849ee359f04266882a5b832a5fac"}
Jul 17 06:07:41.118128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:41.118080    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" podStartSLOduration=1.118063111 podStartE2EDuration="1.118063111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:07:41.116865041 +0000 UTC m=+2079.580049144" watchObservedRunningTime="2026-07-17 06:07:41.118063111 +0000 UTC m=+2079.581247215"
Jul 17 06:07:42.018071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:42.018041    2567 scope.go:117] "RemoveContainer" containerID="440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad"
Jul 17 06:07:42.109631 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:42.109598    2567 generic.go:356] "Generic (PLEG): container finished" podID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerID="f2f7220418891360cd2ef3f83654a092a8fb6adb1a3fca8c13993ea274ebb1a3" exitCode=7
Jul 17 06:07:42.109813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:42.109716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerDied","Data":"f2f7220418891360cd2ef3f83654a092a8fb6adb1a3fca8c13993ea274ebb1a3"}
Jul 17 06:07:42.109877 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:42.109862    2567 scope.go:117] "RemoveContainer" containerID="f2f7220418891360cd2ef3f83654a092a8fb6adb1a3fca8c13993ea274ebb1a3"
Jul 17 06:07:43.116637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.116604    2567 generic.go:356] "Generic (PLEG): container finished" podID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerID="42bd635f6711972fc84f3e26d0419b03a8e0864b6f5dd0e2b9b038d711a2fb58" exitCode=6
Jul 17 06:07:43.117134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.116697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" event={"ID":"45613bb7-77f0-4666-92c0-82a3fbbefb32","Type":"ContainerDied","Data":"42bd635f6711972fc84f3e26d0419b03a8e0864b6f5dd0e2b9b038d711a2fb58"}
Jul 17 06:07:43.117134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.116751    2567 scope.go:117] "RemoveContainer" containerID="440d8c4c3c85b317d30bb2b14ec07cb2d1e1924607141679760d6d468f4b82ad"
Jul 17 06:07:43.117134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.117107    2567 scope.go:117] "RemoveContainer" containerID="42bd635f6711972fc84f3e26d0419b03a8e0864b6f5dd0e2b9b038d711a2fb58"
Jul 17 06:07:43.117361 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:43.117337    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-gml7f_odh-ai-gateway-infra(45613bb7-77f0-4666-92c0-82a3fbbefb32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32"
Jul 17 06:07:43.118625 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.118597    2567 generic.go:356] "Generic (PLEG): container finished" podID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerID="61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78" exitCode=7
Jul 17 06:07:43.118742 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.118630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerDied","Data":"61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78"}
Jul 17 06:07:43.118844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.118831    2567 scope.go:117] "RemoveContainer" containerID="61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78"
Jul 17 06:07:43.118997 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:43.118981    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-8tj77_odh-ai-gateway-infra(b51d165b-94c0-42fa-9709-a7ac133b2487)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487"
Jul 17 06:07:43.128357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:43.128337    2567 scope.go:117] "RemoveContainer" containerID="f2f7220418891360cd2ef3f83654a092a8fb6adb1a3fca8c13993ea274ebb1a3"
Jul 17 06:07:44.127394 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.127369    2567 scope.go:117] "RemoveContainer" containerID="61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78"
Jul 17 06:07:44.127799 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:44.127556    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-8tj77_odh-ai-gateway-infra(b51d165b-94c0-42fa-9709-a7ac133b2487)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487"
Jul 17 06:07:44.160736 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.160704    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:44.299488 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.299465    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:44.424534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.424437    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca\") pod \"45613bb7-77f0-4666-92c0-82a3fbbefb32\" (UID: \"45613bb7-77f0-4666-92c0-82a3fbbefb32\") "
Jul 17 06:07:44.424843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.424821    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45613bb7-77f0-4666-92c0-82a3fbbefb32" (UID: "45613bb7-77f0-4666-92c0-82a3fbbefb32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:07:44.526180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:44.526140    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45613bb7-77f0-4666-92c0-82a3fbbefb32-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:07:45.133493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:45.133460    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"
Jul 17 06:07:45.133973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:45.133504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f" event={"ID":"45613bb7-77f0-4666-92c0-82a3fbbefb32","Type":"ContainerDied","Data":"98f7487a45fe9d68e4d24dfc92455f4a0322f85fe49af9b38715822888c6a832"}
Jul 17 06:07:45.133973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:45.133571    2567 scope.go:117] "RemoveContainer" containerID="42bd635f6711972fc84f3e26d0419b03a8e0864b6f5dd0e2b9b038d711a2fb58"
Jul 17 06:07:45.153606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:45.153579    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:45.156920 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:45.156898    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-gml7f"]
Jul 17 06:07:46.021245 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:46.021210    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" path="/var/lib/kubelet/pods/45613bb7-77f0-4666-92c0-82a3fbbefb32/volumes"
Jul 17 06:07:55.015669 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:55.015633    2567 scope.go:117] "RemoveContainer" containerID="61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78"
Jul 17 06:07:56.198494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:56.198452    2567 generic.go:356] "Generic (PLEG): container finished" podID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerID="515522db87bcf4e385bfe08034c38e53d35aabc5b7e955011528f7248b4240e2" exitCode=7
Jul 17 06:07:56.198908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:56.198520    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerDied","Data":"515522db87bcf4e385bfe08034c38e53d35aabc5b7e955011528f7248b4240e2"}
Jul 17 06:07:56.198908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:56.198599    2567 scope.go:117] "RemoveContainer" containerID="61074782e9f64c7198b70eeacc7c5a6143cee500b4072a1b3f375783390c0c78"
Jul 17 06:07:56.199012 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:56.198989    2567 scope.go:117] "RemoveContainer" containerID="515522db87bcf4e385bfe08034c38e53d35aabc5b7e955011528f7248b4240e2"
Jul 17 06:07:56.199201 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:07:56.199181    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-8tj77_odh-ai-gateway-infra(b51d165b-94c0-42fa-9709-a7ac133b2487)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487"
Jul 17 06:07:57.224602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:57.224565    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:07:57.356817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:57.356793    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:57.443356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:57.443321    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca\") pod \"b51d165b-94c0-42fa-9709-a7ac133b2487\" (UID: \"b51d165b-94c0-42fa-9709-a7ac133b2487\") "
Jul 17 06:07:57.443666 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:57.443642    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b51d165b-94c0-42fa-9709-a7ac133b2487" (UID: "b51d165b-94c0-42fa-9709-a7ac133b2487"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:07:57.544403 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:57.544315    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51d165b-94c0-42fa-9709-a7ac133b2487-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:07:58.212459 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:58.212432    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"
Jul 17 06:07:58.212662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:58.212479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77" event={"ID":"b51d165b-94c0-42fa-9709-a7ac133b2487","Type":"ContainerDied","Data":"8058f93a5c8ccabcd534c80f77ca2afc159b849ee359f04266882a5b832a5fac"}
Jul 17 06:07:58.212662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:58.212538    2567 scope.go:117] "RemoveContainer" containerID="515522db87bcf4e385bfe08034c38e53d35aabc5b7e955011528f7248b4240e2"
Jul 17 06:07:58.228315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:58.228279    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:07:58.233877 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:07:58.233851    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-8tj77"]
Jul 17 06:08:00.021050 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:00.021012    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" path="/var/lib/kubelet/pods/b51d165b-94c0-42fa-9709-a7ac133b2487/volumes"
Jul 17 06:08:02.197386 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:02.197359    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:08:02.205573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:02.205555    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:08:11.931178 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931139    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931488    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931499    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8815801d-3f6c-40fc-90fd-3106878146cd" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931509    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931515    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931528    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931533    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931540    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931545    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931553    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931558    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931572    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931577    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.931637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931638    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.932066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931645    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.932066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931653    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:11.932066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.931661    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:11.934816 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.934798    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:11.937216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.937195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:08:11.937331 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.937195    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:08:11.942528 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.942499    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:11.974526 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:11.974494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-krnxw\" (UID: \"b61299d4-1b60-4f7f-87ad-1b02d0a9f079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:12.075618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:12.075585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-krnxw\" (UID: \"b61299d4-1b60-4f7f-87ad-1b02d0a9f079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:12.076220 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:12.076200    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-krnxw\" (UID: \"b61299d4-1b60-4f7f-87ad-1b02d0a9f079\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:12.246377 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:12.246327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:12.379161 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:12.379138    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:12.381229 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:08:12.381192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61299d4_1b60_4f7f_87ad_1b02d0a9f079.slice/crio-c43abdd1a79237e650665ab9e6cc2ce77f08ee9b23a100d55b0f458e32ddb009 WatchSource:0}: Error finding container c43abdd1a79237e650665ab9e6cc2ce77f08ee9b23a100d55b0f458e32ddb009: Status 404 returned error can't find the container with id c43abdd1a79237e650665ab9e6cc2ce77f08ee9b23a100d55b0f458e32ddb009
Jul 17 06:08:13.295835 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:13.295752    2567 generic.go:356] "Generic (PLEG): container finished" podID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerID="4c7a9286c78b46e66f26b60f49a90e67a3073a984d425639bc896b71e0c442bd" exitCode=6
Jul 17 06:08:13.296198 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:13.295838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerDied","Data":"4c7a9286c78b46e66f26b60f49a90e67a3073a984d425639bc896b71e0c442bd"}
Jul 17 06:08:13.296198 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:13.295891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerStarted","Data":"c43abdd1a79237e650665ab9e6cc2ce77f08ee9b23a100d55b0f458e32ddb009"}
Jul 17 06:08:13.296198 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:13.296023    2567 scope.go:117] "RemoveContainer" containerID="4c7a9286c78b46e66f26b60f49a90e67a3073a984d425639bc896b71e0c442bd"
Jul 17 06:08:14.302264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:14.302231    2567 generic.go:356] "Generic (PLEG): container finished" podID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerID="9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8" exitCode=6
Jul 17 06:08:14.302853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:14.302305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerDied","Data":"9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8"}
Jul 17 06:08:14.302853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:14.302369    2567 scope.go:117] "RemoveContainer" containerID="4c7a9286c78b46e66f26b60f49a90e67a3073a984d425639bc896b71e0c442bd"
Jul 17 06:08:14.302853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:14.302570    2567 scope.go:117] "RemoveContainer" containerID="9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8"
Jul 17 06:08:14.302853 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:14.302798    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-krnxw_odh-ai-gateway-infra(b61299d4-1b60-4f7f-87ad-1b02d0a9f079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079"
Jul 17 06:08:15.315238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:15.315205    2567 scope.go:117] "RemoveContainer" containerID="9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8"
Jul 17 06:08:15.315650 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:15.315376    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-krnxw_odh-ai-gateway-infra(b61299d4-1b60-4f7f-87ad-1b02d0a9f079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079"
Jul 17 06:08:23.624942 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.624903    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:23.625333 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.625247    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:23.625333 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.625258    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:23.625411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.625349    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51d165b-94c0-42fa-9709-a7ac133b2487" containerName="revoke-keys"
Jul 17 06:08:23.625411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.625360    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45613bb7-77f0-4666-92c0-82a3fbbefb32" containerName="revoke-keys"
Jul 17 06:08:23.629538 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.629521    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:23.635145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.635101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:23.672786 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.672753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf\" (UID: \"bbdaf14e-b1f2-425a-a283-14995b7728d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:23.774030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.773983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf\" (UID: \"bbdaf14e-b1f2-425a-a283-14995b7728d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:23.774609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.774587    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf\" (UID: \"bbdaf14e-b1f2-425a-a283-14995b7728d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:23.941957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:23.941925    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:24.076335 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:24.076296    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:24.078427 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:08:24.078399    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdaf14e_b1f2_425a_a283_14995b7728d3.slice/crio-dc8af6607b2e57d1fb60a4027e85286d4356ae93a6b720b0a28c23cff6215f6e WatchSource:0}: Error finding container dc8af6607b2e57d1fb60a4027e85286d4356ae93a6b720b0a28c23cff6215f6e: Status 404 returned error can't find the container with id dc8af6607b2e57d1fb60a4027e85286d4356ae93a6b720b0a28c23cff6215f6e
Jul 17 06:08:24.370640 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:24.370606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerStarted","Data":"dc8af6607b2e57d1fb60a4027e85286d4356ae93a6b720b0a28c23cff6215f6e"}
Jul 17 06:08:25.377136 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:25.377099    2567 generic.go:356] "Generic (PLEG): container finished" podID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerID="ae1bfdaec95f2525d7419c231b5afb452799592da6a259d95a78b0dcf3e6365b" exitCode=6
Jul 17 06:08:25.377577 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:25.377180    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerDied","Data":"ae1bfdaec95f2525d7419c231b5afb452799592da6a259d95a78b0dcf3e6365b"}
Jul 17 06:08:25.377577 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:25.377347    2567 scope.go:117] "RemoveContainer" containerID="ae1bfdaec95f2525d7419c231b5afb452799592da6a259d95a78b0dcf3e6365b"
Jul 17 06:08:26.383848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:26.383748    2567 generic.go:356] "Generic (PLEG): container finished" podID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerID="70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe" exitCode=6
Jul 17 06:08:26.383848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:26.383794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerDied","Data":"70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe"}
Jul 17 06:08:26.384328 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:26.383854    2567 scope.go:117] "RemoveContainer" containerID="ae1bfdaec95f2525d7419c231b5afb452799592da6a259d95a78b0dcf3e6365b"
Jul 17 06:08:26.384328 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:26.384071    2567 scope.go:117] "RemoveContainer" containerID="70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe"
Jul 17 06:08:26.384328 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:26.384294    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf_odh-ai-gateway-infra(bbdaf14e-b1f2-425a-a283-14995b7728d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3"
Jul 17 06:08:27.390111 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:27.390079    2567 scope.go:117] "RemoveContainer" containerID="70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe"
Jul 17 06:08:27.392446 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:27.390331    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf_odh-ai-gateway-infra(bbdaf14e-b1f2-425a-a283-14995b7728d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3"
Jul 17 06:08:30.015705 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.015647    2567 scope.go:117] "RemoveContainer" containerID="9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8"
Jul 17 06:08:30.333768 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.333731    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:30.337202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.337185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:30.346238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.346210    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:30.407072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.407037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerStarted","Data":"191faca2f0b5a1a01cbdca15ac79c56055eae83a5e01923705955f0322aed3ce"}
Jul 17 06:08:30.423902 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.423849    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" podStartSLOduration=19.42383302 podStartE2EDuration="19.42383302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:08:30.422361154 +0000 UTC m=+2128.885545258" watchObservedRunningTime="2026-07-17 06:08:30.42383302 +0000 UTC m=+2128.887017124"
Jul 17 06:08:30.433840 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.433812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-tfdzv\" (UID: \"77058824-748d-466a-8f0e-f05753a8d1c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:30.534934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.534825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-tfdzv\" (UID: \"77058824-748d-466a-8f0e-f05753a8d1c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:30.535435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.535414    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-tfdzv\" (UID: \"77058824-748d-466a-8f0e-f05753a8d1c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:30.649482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.649448    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:30.784149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:30.784113    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:30.785662 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:08:30.785597    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77058824_748d_466a_8f0e_f05753a8d1c4.slice/crio-425c2ac2dff291cec082e764a43c65f72b3e948bc380426785b1afbd8056a161 WatchSource:0}: Error finding container 425c2ac2dff291cec082e764a43c65f72b3e948bc380426785b1afbd8056a161: Status 404 returned error can't find the container with id 425c2ac2dff291cec082e764a43c65f72b3e948bc380426785b1afbd8056a161
Jul 17 06:08:31.413992 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.413962    2567 generic.go:356] "Generic (PLEG): container finished" podID="77058824-748d-466a-8f0e-f05753a8d1c4" containerID="91768d3ef39ecf57d576a71b81be9f6a27bafc5c94f299fe7c8e33794139cef4" exitCode=7
Jul 17 06:08:31.414409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.414047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerDied","Data":"91768d3ef39ecf57d576a71b81be9f6a27bafc5c94f299fe7c8e33794139cef4"}
Jul 17 06:08:31.414409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.414111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerStarted","Data":"425c2ac2dff291cec082e764a43c65f72b3e948bc380426785b1afbd8056a161"}
Jul 17 06:08:31.414409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.414248    2567 scope.go:117] "RemoveContainer" containerID="91768d3ef39ecf57d576a71b81be9f6a27bafc5c94f299fe7c8e33794139cef4"
Jul 17 06:08:31.415934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.415914    2567 generic.go:356] "Generic (PLEG): container finished" podID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerID="191faca2f0b5a1a01cbdca15ac79c56055eae83a5e01923705955f0322aed3ce" exitCode=6
Jul 17 06:08:31.416027 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.415973    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerDied","Data":"191faca2f0b5a1a01cbdca15ac79c56055eae83a5e01923705955f0322aed3ce"}
Jul 17 06:08:31.416027 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.416016    2567 scope.go:117] "RemoveContainer" containerID="9e2fd7ab243b75b33f3df18a5c99b9a79157c08c6c886cd956e6e680ed1973e8"
Jul 17 06:08:31.416281 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.416260    2567 scope.go:117] "RemoveContainer" containerID="191faca2f0b5a1a01cbdca15ac79c56055eae83a5e01923705955f0322aed3ce"
Jul 17 06:08:31.416475 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:31.416452    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-krnxw_odh-ai-gateway-infra(b61299d4-1b60-4f7f-87ad-1b02d0a9f079)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079"
Jul 17 06:08:31.436752 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:31.436729    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:32.428874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.428782    2567 generic.go:356] "Generic (PLEG): container finished" podID="77058824-748d-466a-8f0e-f05753a8d1c4" containerID="95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9" exitCode=7
Jul 17 06:08:32.429323 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.428871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerDied","Data":"95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9"}
Jul 17 06:08:32.429323 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.428951    2567 scope.go:117] "RemoveContainer" containerID="91768d3ef39ecf57d576a71b81be9f6a27bafc5c94f299fe7c8e33794139cef4"
Jul 17 06:08:32.429323 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.429082    2567 scope.go:117] "RemoveContainer" containerID="95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9"
Jul 17 06:08:32.429470 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:32.429320    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-tfdzv_odh-ai-gateway-infra(77058824-748d-466a-8f0e-f05753a8d1c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" podUID="77058824-748d-466a-8f0e-f05753a8d1c4"
Jul 17 06:08:32.563549 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.563524    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:32.655545 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.655514    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca\") pod \"b61299d4-1b60-4f7f-87ad-1b02d0a9f079\" (UID: \"b61299d4-1b60-4f7f-87ad-1b02d0a9f079\") "
Jul 17 06:08:32.655912 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.655892    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b61299d4-1b60-4f7f-87ad-1b02d0a9f079" (UID: "b61299d4-1b60-4f7f-87ad-1b02d0a9f079"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:08:32.757090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:32.757057    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b61299d4-1b60-4f7f-87ad-1b02d0a9f079-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:08:33.438248 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.438215    2567 scope.go:117] "RemoveContainer" containerID="95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9"
Jul 17 06:08:33.438724 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:33.438435    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-tfdzv_odh-ai-gateway-infra(77058824-748d-466a-8f0e-f05753a8d1c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" podUID="77058824-748d-466a-8f0e-f05753a8d1c4"
Jul 17 06:08:33.439318 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.439300    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"
Jul 17 06:08:33.439402 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.439317    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw" event={"ID":"b61299d4-1b60-4f7f-87ad-1b02d0a9f079","Type":"ContainerDied","Data":"c43abdd1a79237e650665ab9e6cc2ce77f08ee9b23a100d55b0f458e32ddb009"}
Jul 17 06:08:33.439402 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.439358    2567 scope.go:117] "RemoveContainer" containerID="191faca2f0b5a1a01cbdca15ac79c56055eae83a5e01923705955f0322aed3ce"
Jul 17 06:08:33.464889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.464861    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:33.470526 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:33.470500    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-krnxw"]
Jul 17 06:08:34.023406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:34.023371    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" path="/var/lib/kubelet/pods/b61299d4-1b60-4f7f-87ad-1b02d0a9f079/volumes"
Jul 17 06:08:40.015699 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:40.015659    2567 scope.go:117] "RemoveContainer" containerID="70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe"
Jul 17 06:08:40.479083 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:40.479051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerStarted","Data":"6b1b78fd781cc532e5056729d4234fd85aad3cde6991d03904ce160cef0dab98"}
Jul 17 06:08:40.495578 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:40.495523    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" podStartSLOduration=17.495508549 podStartE2EDuration="17.495508549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:08:40.493250366 +0000 UTC m=+2138.956434469" watchObservedRunningTime="2026-07-17 06:08:40.495508549 +0000 UTC m=+2138.958692696"
Jul 17 06:08:41.485830 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:41.485799    2567 generic.go:356] "Generic (PLEG): container finished" podID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerID="6b1b78fd781cc532e5056729d4234fd85aad3cde6991d03904ce160cef0dab98" exitCode=6
Jul 17 06:08:41.486284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:41.485877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerDied","Data":"6b1b78fd781cc532e5056729d4234fd85aad3cde6991d03904ce160cef0dab98"}
Jul 17 06:08:41.486284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:41.485938    2567 scope.go:117] "RemoveContainer" containerID="70532563110aeec98c7fc14973b8410fc3fd21f3d44994c6a531e55907e736fe"
Jul 17 06:08:41.486284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:41.486275    2567 scope.go:117] "RemoveContainer" containerID="6b1b78fd781cc532e5056729d4234fd85aad3cde6991d03904ce160cef0dab98"
Jul 17 06:08:41.486509 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:41.486490    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf_odh-ai-gateway-infra(bbdaf14e-b1f2-425a-a283-14995b7728d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3"
Jul 17 06:08:41.518553 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:41.518526    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:42.628289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:42.628265    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:42.746350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:42.746257    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca\") pod \"bbdaf14e-b1f2-425a-a283-14995b7728d3\" (UID: \"bbdaf14e-b1f2-425a-a283-14995b7728d3\") "
Jul 17 06:08:42.746617 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:42.746594    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bbdaf14e-b1f2-425a-a283-14995b7728d3" (UID: "bbdaf14e-b1f2-425a-a283-14995b7728d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:08:42.847430 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:42.847396    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbdaf14e-b1f2-425a-a283-14995b7728d3-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:08:43.500036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:43.499997    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf" event={"ID":"bbdaf14e-b1f2-425a-a283-14995b7728d3","Type":"ContainerDied","Data":"dc8af6607b2e57d1fb60a4027e85286d4356ae93a6b720b0a28c23cff6215f6e"}
Jul 17 06:08:43.500036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:43.500027    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"
Jul 17 06:08:43.500372 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:43.500071    2567 scope.go:117] "RemoveContainer" containerID="6b1b78fd781cc532e5056729d4234fd85aad3cde6991d03904ce160cef0dab98"
Jul 17 06:08:43.521061 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:43.521034    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:43.526705 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:43.526664    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dl6qf"]
Jul 17 06:08:44.020413 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:44.020381    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" path="/var/lib/kubelet/pods/bbdaf14e-b1f2-425a-a283-14995b7728d3/volumes"
Jul 17 06:08:48.015945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:48.015910    2567 scope.go:117] "RemoveContainer" containerID="95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9"
Jul 17 06:08:48.532884 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:48.532847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerStarted","Data":"3acdf78e878a79001ae254caaf3d4052c19f870243c7f81a5c1f8c370ee70d9e"}
Jul 17 06:08:48.549674 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:48.549620    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" podStartSLOduration=18.549604975 podStartE2EDuration="18.549604975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:08:48.548445717 +0000 UTC m=+2147.011629821" watchObservedRunningTime="2026-07-17 06:08:48.549604975 +0000 UTC m=+2147.012789080"
Jul 17 06:08:49.540851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:49.540820    2567 generic.go:356] "Generic (PLEG): container finished" podID="77058824-748d-466a-8f0e-f05753a8d1c4" containerID="3acdf78e878a79001ae254caaf3d4052c19f870243c7f81a5c1f8c370ee70d9e" exitCode=7
Jul 17 06:08:49.541260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:49.540904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerDied","Data":"3acdf78e878a79001ae254caaf3d4052c19f870243c7f81a5c1f8c370ee70d9e"}
Jul 17 06:08:49.541260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:49.540968    2567 scope.go:117] "RemoveContainer" containerID="95be9a229db0ad55f8e9ac2a7b9c85fc873bbfa6ebaa35a89e2e301003350aa9"
Jul 17 06:08:49.541260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:49.541233    2567 scope.go:117] "RemoveContainer" containerID="3acdf78e878a79001ae254caaf3d4052c19f870243c7f81a5c1f8c370ee70d9e"
Jul 17 06:08:49.541457 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:08:49.541437    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-tfdzv_odh-ai-gateway-infra(77058824-748d-466a-8f0e-f05753a8d1c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" podUID="77058824-748d-466a-8f0e-f05753a8d1c4"
Jul 17 06:08:49.560269 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:49.560233    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:50.684173 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:50.684148    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:50.822270 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:50.822164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca\") pod \"77058824-748d-466a-8f0e-f05753a8d1c4\" (UID: \"77058824-748d-466a-8f0e-f05753a8d1c4\") "
Jul 17 06:08:50.822538 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:50.822514    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77058824-748d-466a-8f0e-f05753a8d1c4" (UID: "77058824-748d-466a-8f0e-f05753a8d1c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:08:50.923309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:50.923253    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77058824-748d-466a-8f0e-f05753a8d1c4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:08:51.554730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:51.554702    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"
Jul 17 06:08:51.554916 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:51.554731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv" event={"ID":"77058824-748d-466a-8f0e-f05753a8d1c4","Type":"ContainerDied","Data":"425c2ac2dff291cec082e764a43c65f72b3e948bc380426785b1afbd8056a161"}
Jul 17 06:08:51.554916 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:51.554790    2567 scope.go:117] "RemoveContainer" containerID="3acdf78e878a79001ae254caaf3d4052c19f870243c7f81a5c1f8c370ee70d9e"
Jul 17 06:08:51.577033 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:51.577003    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:51.582398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:51.582378    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-tfdzv"]
Jul 17 06:08:52.020670 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:08:52.020641    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" path="/var/lib/kubelet/pods/77058824-748d-466a-8f0e-f05753a8d1c4/volumes"
Jul 17 06:09:11.976236 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976201    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976537    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976549    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976562    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976567    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976574    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976580    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976594    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976599    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976605    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976610    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976617    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.976614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976622    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976672    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976692    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976698    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976705    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976717    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976725    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.977037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.976730    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:11.979604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.979587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:11.981871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.981849    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:09:11.982004 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.981874    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:09:11.985875 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:11.985849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:12.117892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.117847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp\" (UID: \"1b74a031-4e24-4241-b8d0-ac02c2ae14e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:12.219264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.219221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp\" (UID: \"1b74a031-4e24-4241-b8d0-ac02c2ae14e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:12.219878 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.219859    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp\" (UID: \"1b74a031-4e24-4241-b8d0-ac02c2ae14e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:12.292088 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.292010    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:12.424497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.424464    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:12.426301 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:09:12.426269    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b74a031_4e24_4241_b8d0_ac02c2ae14e9.slice/crio-f48b45649bf05fa6813f5efd017e01eb57d872469fa39034c16e0886228df21b WatchSource:0}: Error finding container f48b45649bf05fa6813f5efd017e01eb57d872469fa39034c16e0886228df21b: Status 404 returned error can't find the container with id f48b45649bf05fa6813f5efd017e01eb57d872469fa39034c16e0886228df21b
Jul 17 06:09:12.666760 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:12.666724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" event={"ID":"1b74a031-4e24-4241-b8d0-ac02c2ae14e9","Type":"ContainerStarted","Data":"f48b45649bf05fa6813f5efd017e01eb57d872469fa39034c16e0886228df21b"}
Jul 17 06:09:13.321514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:13.321426    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:09:13.673349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:13.673260    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerID="b5080aaf63f97fdca35b92bce18d567c35e5a73f3a293270c5e55b6576bddfd9" exitCode=6
Jul 17 06:09:13.673505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:13.673346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" event={"ID":"1b74a031-4e24-4241-b8d0-ac02c2ae14e9","Type":"ContainerDied","Data":"b5080aaf63f97fdca35b92bce18d567c35e5a73f3a293270c5e55b6576bddfd9"}
Jul 17 06:09:13.673505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:13.673490    2567 scope.go:117] "RemoveContainer" containerID="b5080aaf63f97fdca35b92bce18d567c35e5a73f3a293270c5e55b6576bddfd9"
Jul 17 06:09:14.681071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:14.680986    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerID="349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e" exitCode=6
Jul 17 06:09:14.681071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:14.681029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" event={"ID":"1b74a031-4e24-4241-b8d0-ac02c2ae14e9","Type":"ContainerDied","Data":"349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e"}
Jul 17 06:09:14.681599 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:14.681075    2567 scope.go:117] "RemoveContainer" containerID="b5080aaf63f97fdca35b92bce18d567c35e5a73f3a293270c5e55b6576bddfd9"
Jul 17 06:09:14.681599 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:14.681240    2567 scope.go:117] "RemoveContainer" containerID="349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e"
Jul 17 06:09:14.681599 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:14.681500    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp_odh-ai-gateway-infra(1b74a031-4e24-4241-b8d0-ac02c2ae14e9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9"
Jul 17 06:09:15.687945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:15.687918    2567 scope.go:117] "RemoveContainer" containerID="349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e"
Jul 17 06:09:15.688312 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:15.688127    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp_odh-ai-gateway-infra(1b74a031-4e24-4241-b8d0-ac02c2ae14e9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9"
Jul 17 06:09:23.749547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749510    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:23.749960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749940    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:23.749960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749953    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:23.750035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749972    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:23.750035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749979    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbdaf14e-b1f2-425a-a283-14995b7728d3" containerName="revoke-keys"
Jul 17 06:09:23.750035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.749995    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:23.750035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.750001    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:23.750169 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.750080    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b61299d4-1b60-4f7f-87ad-1b02d0a9f079" containerName="revoke-keys"
Jul 17 06:09:23.750169 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.750088    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="77058824-748d-466a-8f0e-f05753a8d1c4" containerName="revoke-keys"
Jul 17 06:09:23.754484 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.754465    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:23.764443 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.764411    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:23.832257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.832220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jbq84\" (UID: \"97d6dc47-5606-4c60-ae32-10f9712adcc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:23.932858 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.932824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jbq84\" (UID: \"97d6dc47-5606-4c60-ae32-10f9712adcc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:23.933419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:23.933398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jbq84\" (UID: \"97d6dc47-5606-4c60-ae32-10f9712adcc6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:24.065812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:24.065724    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:24.204080 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:24.204055    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:24.206072 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:09:24.206042    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d6dc47_5606_4c60_ae32_10f9712adcc6.slice/crio-1794f4b1e9d89791c167c37968026738cb5350f53969610e9dc0b5f39e19cf45 WatchSource:0}: Error finding container 1794f4b1e9d89791c167c37968026738cb5350f53969610e9dc0b5f39e19cf45: Status 404 returned error can't find the container with id 1794f4b1e9d89791c167c37968026738cb5350f53969610e9dc0b5f39e19cf45
Jul 17 06:09:24.740469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:24.740433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerStarted","Data":"e1e18413b8a3f4f8f5c59061472b353e5323dc4b8aa121d95b4f3716261cb848"}
Jul 17 06:09:24.740654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:24.740486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerStarted","Data":"1794f4b1e9d89791c167c37968026738cb5350f53969610e9dc0b5f39e19cf45"}
Jul 17 06:09:24.766636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:24.766583    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" podStartSLOduration=1.76656773 podStartE2EDuration="1.76656773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:09:24.763556006 +0000 UTC m=+2183.226740110" watchObservedRunningTime="2026-07-17 06:09:24.76656773 +0000 UTC m=+2183.229751879"
Jul 17 06:09:25.747013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:25.746979    2567 generic.go:356] "Generic (PLEG): container finished" podID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerID="e1e18413b8a3f4f8f5c59061472b353e5323dc4b8aa121d95b4f3716261cb848" exitCode=6
Jul 17 06:09:25.747204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:25.747067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerDied","Data":"e1e18413b8a3f4f8f5c59061472b353e5323dc4b8aa121d95b4f3716261cb848"}
Jul 17 06:09:25.747261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:25.747248    2567 scope.go:117] "RemoveContainer" containerID="e1e18413b8a3f4f8f5c59061472b353e5323dc4b8aa121d95b4f3716261cb848"
Jul 17 06:09:26.216416 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:26.216378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:09:26.754444 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:26.754403    2567 generic.go:356] "Generic (PLEG): container finished" podID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerID="96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501" exitCode=6
Jul 17 06:09:26.754603 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:26.754468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerDied","Data":"96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501"}
Jul 17 06:09:26.754603 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:26.754522    2567 scope.go:117] "RemoveContainer" containerID="e1e18413b8a3f4f8f5c59061472b353e5323dc4b8aa121d95b4f3716261cb848"
Jul 17 06:09:26.754748 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:26.754730    2567 scope.go:117] "RemoveContainer" containerID="96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501"
Jul 17 06:09:26.754980 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:26.754959    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jbq84_odh-ai-gateway-infra(97d6dc47-5606-4c60-ae32-10f9712adcc6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6"
Jul 17 06:09:27.015215 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.015125    2567 scope.go:117] "RemoveContainer" containerID="349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e"
Jul 17 06:09:27.659724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.659673    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:27.662977 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.662961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:27.669865 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.669836    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:27.766057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.766016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6\" (UID: \"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:27.767964 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.767944    2567 scope.go:117] "RemoveContainer" containerID="96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501"
Jul 17 06:09:27.768155 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:27.768133    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jbq84_odh-ai-gateway-infra(97d6dc47-5606-4c60-ae32-10f9712adcc6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6"
Jul 17 06:09:27.769725 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.769704    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerID="21f337eb47e659325788f9d046260071fef14bfed2193f158a3f6a3988f5591f" exitCode=6
Jul 17 06:09:27.769814 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.769757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" event={"ID":"1b74a031-4e24-4241-b8d0-ac02c2ae14e9","Type":"ContainerDied","Data":"21f337eb47e659325788f9d046260071fef14bfed2193f158a3f6a3988f5591f"}
Jul 17 06:09:27.769863 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.769820    2567 scope.go:117] "RemoveContainer" containerID="349a04b2020a1d3354058eb5b750a59e65018c1c6beef4329055f62603578a1e"
Jul 17 06:09:27.770099 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.770079    2567 scope.go:117] "RemoveContainer" containerID="21f337eb47e659325788f9d046260071fef14bfed2193f158a3f6a3988f5591f"
Jul 17 06:09:27.770252 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:27.770233    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp_odh-ai-gateway-infra(1b74a031-4e24-4241-b8d0-ac02c2ae14e9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9"
Jul 17 06:09:27.867643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.867531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6\" (UID: \"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:27.868177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.868157    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6\" (UID: \"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:27.974922 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:27.974888    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:28.107968 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.107751    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:28.110157 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:09:28.110129    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0e89bf_420b_4f4e_a6c8_ad7eba6eb8a2.slice/crio-ae33377a430e6168a1954a0a4031ec4839aa4e711469002644aab7325d52ba6c WatchSource:0}: Error finding container ae33377a430e6168a1954a0a4031ec4839aa4e711469002644aab7325d52ba6c: Status 404 returned error can't find the container with id ae33377a430e6168a1954a0a4031ec4839aa4e711469002644aab7325d52ba6c
Jul 17 06:09:28.778800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.778764    2567 generic.go:356] "Generic (PLEG): container finished" podID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerID="2181b5f3d1fe58a5fc1ab6e9fa9c3fcc6fdf23f5eb5110daa6eccbb1d5aed374" exitCode=7
Jul 17 06:09:28.779284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.778853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" event={"ID":"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2","Type":"ContainerDied","Data":"2181b5f3d1fe58a5fc1ab6e9fa9c3fcc6fdf23f5eb5110daa6eccbb1d5aed374"}
Jul 17 06:09:28.779284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.778908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" event={"ID":"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2","Type":"ContainerStarted","Data":"ae33377a430e6168a1954a0a4031ec4839aa4e711469002644aab7325d52ba6c"}
Jul 17 06:09:28.779284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.779062    2567 scope.go:117] "RemoveContainer" containerID="2181b5f3d1fe58a5fc1ab6e9fa9c3fcc6fdf23f5eb5110daa6eccbb1d5aed374"
Jul 17 06:09:28.807408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.807379    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:28.938356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:28.938325    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:29.079177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.079148    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca\") pod \"1b74a031-4e24-4241-b8d0-ac02c2ae14e9\" (UID: \"1b74a031-4e24-4241-b8d0-ac02c2ae14e9\") "
Jul 17 06:09:29.079491 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.079469    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b74a031-4e24-4241-b8d0-ac02c2ae14e9" (UID: "1b74a031-4e24-4241-b8d0-ac02c2ae14e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:29.180595 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.180510    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b74a031-4e24-4241-b8d0-ac02c2ae14e9-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:09:29.786070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.786044    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"
Jul 17 06:09:29.786541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.786044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp" event={"ID":"1b74a031-4e24-4241-b8d0-ac02c2ae14e9","Type":"ContainerDied","Data":"f48b45649bf05fa6813f5efd017e01eb57d872469fa39034c16e0886228df21b"}
Jul 17 06:09:29.786541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.786185    2567 scope.go:117] "RemoveContainer" containerID="21f337eb47e659325788f9d046260071fef14bfed2193f158a3f6a3988f5591f"
Jul 17 06:09:29.788376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.788334    2567 generic.go:356] "Generic (PLEG): container finished" podID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerID="875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866" exitCode=7
Jul 17 06:09:29.788465 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.788401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" event={"ID":"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2","Type":"ContainerDied","Data":"875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866"}
Jul 17 06:09:29.788630 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.788615    2567 scope.go:117] "RemoveContainer" containerID="875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866"
Jul 17 06:09:29.788892 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:29.788869    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6_odh-ai-gateway-infra(8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2"
Jul 17 06:09:29.795920 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.795900    2567 scope.go:117] "RemoveContainer" containerID="2181b5f3d1fe58a5fc1ab6e9fa9c3fcc6fdf23f5eb5110daa6eccbb1d5aed374"
Jul 17 06:09:29.817461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.817438    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:29.824936 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:29.824911    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-sfxcp"]
Jul 17 06:09:30.020354 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.020322    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" path="/var/lib/kubelet/pods/1b74a031-4e24-4241-b8d0-ac02c2ae14e9/volumes"
Jul 17 06:09:30.380319 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380285    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:30.380661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380649    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380662    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380695    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380702    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380755    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380765    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.380846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.380773    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:09:30.385077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.385059    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:30.391510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.391487    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:30.493657 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.493625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-wcrjd\" (UID: \"3b443f89-668d-4b2b-b044-15302b9e3fda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:30.595024 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.594988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-wcrjd\" (UID: \"3b443f89-668d-4b2b-b044-15302b9e3fda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:30.595625 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.595603    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-wcrjd\" (UID: \"3b443f89-668d-4b2b-b044-15302b9e3fda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:30.697806 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.697757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:30.799463 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.799431    2567 scope.go:117] "RemoveContainer" containerID="875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866"
Jul 17 06:09:30.799954 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:30.799730    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6_odh-ai-gateway-infra(8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2"
Jul 17 06:09:30.831463 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:30.831438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:30.833183 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:09:30.833153    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b443f89_668d_4b2b_b044_15302b9e3fda.slice/crio-81678948a8d93c69e03b6899a06dbad38049cb5e3dd1e4fbdb99c736394cfc21 WatchSource:0}: Error finding container 81678948a8d93c69e03b6899a06dbad38049cb5e3dd1e4fbdb99c736394cfc21: Status 404 returned error can't find the container with id 81678948a8d93c69e03b6899a06dbad38049cb5e3dd1e4fbdb99c736394cfc21
Jul 17 06:09:31.806805 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:31.806716    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerID="529e2e7ce2adb8529c385d0799031189c42e6b53940f52c84fa5a885cdc6437f" exitCode=6
Jul 17 06:09:31.807163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:31.806811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" event={"ID":"3b443f89-668d-4b2b-b044-15302b9e3fda","Type":"ContainerDied","Data":"529e2e7ce2adb8529c385d0799031189c42e6b53940f52c84fa5a885cdc6437f"}
Jul 17 06:09:31.807163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:31.806906    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" event={"ID":"3b443f89-668d-4b2b-b044-15302b9e3fda","Type":"ContainerStarted","Data":"81678948a8d93c69e03b6899a06dbad38049cb5e3dd1e4fbdb99c736394cfc21"}
Jul 17 06:09:31.807163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:31.806985    2567 scope.go:117] "RemoveContainer" containerID="529e2e7ce2adb8529c385d0799031189c42e6b53940f52c84fa5a885cdc6437f"
Jul 17 06:09:32.814016 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:32.813978    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerID="0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8" exitCode=6
Jul 17 06:09:32.814444 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:32.814055    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" event={"ID":"3b443f89-668d-4b2b-b044-15302b9e3fda","Type":"ContainerDied","Data":"0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8"}
Jul 17 06:09:32.814444 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:32.814112    2567 scope.go:117] "RemoveContainer" containerID="529e2e7ce2adb8529c385d0799031189c42e6b53940f52c84fa5a885cdc6437f"
Jul 17 06:09:32.814444 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:32.814315    2567 scope.go:117] "RemoveContainer" containerID="0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8"
Jul 17 06:09:32.814591 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:32.814570    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-wcrjd_odh-ai-gateway-infra(3b443f89-668d-4b2b-b044-15302b9e3fda)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda"
Jul 17 06:09:33.820904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:33.820876    2567 scope.go:117] "RemoveContainer" containerID="0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8"
Jul 17 06:09:33.821375 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:33.821154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-wcrjd_odh-ai-gateway-infra(3b443f89-668d-4b2b-b044-15302b9e3fda)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda"
Jul 17 06:09:39.015801 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:39.015764    2567 scope.go:117] "RemoveContainer" containerID="96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501"
Jul 17 06:09:39.857295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:39.857206    2567 generic.go:356] "Generic (PLEG): container finished" podID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerID="389b721cc824016d0dba679fb95470a1504e7b87d6e56c8c8f66070a4bf36485" exitCode=6
Jul 17 06:09:39.857295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:39.857281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerDied","Data":"389b721cc824016d0dba679fb95470a1504e7b87d6e56c8c8f66070a4bf36485"}
Jul 17 06:09:39.857500 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:39.857353    2567 scope.go:117] "RemoveContainer" containerID="96e9a8d757f77ea8550246ca8e2ad7f27dc9ff2f5c871e7e71b6e81b4d49e501"
Jul 17 06:09:39.857711 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:39.857669    2567 scope.go:117] "RemoveContainer" containerID="389b721cc824016d0dba679fb95470a1504e7b87d6e56c8c8f66070a4bf36485"
Jul 17 06:09:39.857950 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:39.857927    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jbq84_odh-ai-gateway-infra(97d6dc47-5606-4c60-ae32-10f9712adcc6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6"
Jul 17 06:09:40.882021 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:40.881988    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:41.017301 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.017275    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:41.087646 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.087611    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca\") pod \"97d6dc47-5606-4c60-ae32-10f9712adcc6\" (UID: \"97d6dc47-5606-4c60-ae32-10f9712adcc6\") "
Jul 17 06:09:41.087995 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.087973    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97d6dc47-5606-4c60-ae32-10f9712adcc6" (UID: "97d6dc47-5606-4c60-ae32-10f9712adcc6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:41.188614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.188536    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d6dc47-5606-4c60-ae32-10f9712adcc6-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:09:41.870214 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.870185    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"
Jul 17 06:09:41.870214 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.870198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84" event={"ID":"97d6dc47-5606-4c60-ae32-10f9712adcc6","Type":"ContainerDied","Data":"1794f4b1e9d89791c167c37968026738cb5350f53969610e9dc0b5f39e19cf45"}
Jul 17 06:09:41.870463 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.870255    2567 scope.go:117] "RemoveContainer" containerID="389b721cc824016d0dba679fb95470a1504e7b87d6e56c8c8f66070a4bf36485"
Jul 17 06:09:41.893337 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.893308    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:41.899440 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:41.899410    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jbq84"]
Jul 17 06:09:42.020859 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:42.020827    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" path="/var/lib/kubelet/pods/97d6dc47-5606-4c60-ae32-10f9712adcc6/volumes"
Jul 17 06:09:43.014758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:43.014715    2567 scope.go:117] "RemoveContainer" containerID="875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866"
Jul 17 06:09:43.890918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:43.890888    2567 generic.go:356] "Generic (PLEG): container finished" podID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerID="cf0ef7bea131ac014cadc61aafdfec8f4ccf41a6f6b0240ecb9bf739f7dbe44a" exitCode=7
Jul 17 06:09:43.891084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:43.890957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" event={"ID":"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2","Type":"ContainerDied","Data":"cf0ef7bea131ac014cadc61aafdfec8f4ccf41a6f6b0240ecb9bf739f7dbe44a"}
Jul 17 06:09:43.891084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:43.891021    2567 scope.go:117] "RemoveContainer" containerID="875da493bdacfae9e7e57c3dcca2d6f36e2bd47acd5c3096bc0f971d7d79e866"
Jul 17 06:09:43.891388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:43.891371    2567 scope.go:117] "RemoveContainer" containerID="cf0ef7bea131ac014cadc61aafdfec8f4ccf41a6f6b0240ecb9bf739f7dbe44a"
Jul 17 06:09:43.891642 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:43.891621    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6_odh-ai-gateway-infra(8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2"
Jul 17 06:09:44.916317 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:44.916273    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:45.014871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.014840    2567 scope.go:117] "RemoveContainer" containerID="0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8"
Jul 17 06:09:45.071919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.071895    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:45.126466 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.126417    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca\") pod \"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2\" (UID: \"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2\") "
Jul 17 06:09:45.126800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.126778    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" (UID: "8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:45.228089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.228057    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:09:45.905654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.905574    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerID="9d08d3fef627dd77e4d27218e1f314320c624374a47cfccbdf367eddfed958da" exitCode=6
Jul 17 06:09:45.905888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.905650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" event={"ID":"3b443f89-668d-4b2b-b044-15302b9e3fda","Type":"ContainerDied","Data":"9d08d3fef627dd77e4d27218e1f314320c624374a47cfccbdf367eddfed958da"}
Jul 17 06:09:45.905888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.905738    2567 scope.go:117] "RemoveContainer" containerID="0b58675899ccb1037793a91cbce98dd3c700e8efae2e0ba7bc8d00118c0420e8"
Jul 17 06:09:45.906136 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.906115    2567 scope.go:117] "RemoveContainer" containerID="9d08d3fef627dd77e4d27218e1f314320c624374a47cfccbdf367eddfed958da"
Jul 17 06:09:45.906350 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:09:45.906333    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-wcrjd_odh-ai-gateway-infra(3b443f89-668d-4b2b-b044-15302b9e3fda)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda"
Jul 17 06:09:45.907295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.907272    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6" event={"ID":"8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2","Type":"ContainerDied","Data":"ae33377a430e6168a1954a0a4031ec4839aa4e711469002644aab7325d52ba6c"}
Jul 17 06:09:45.907395 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.907305    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"
Jul 17 06:09:45.921560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.921390    2567 scope.go:117] "RemoveContainer" containerID="cf0ef7bea131ac014cadc61aafdfec8f4ccf41a6f6b0240ecb9bf739f7dbe44a"
Jul 17 06:09:45.937813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.937789    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:45.939818 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:45.939798    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-kqgt6"]
Jul 17 06:09:46.022297 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:46.022263    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" path="/var/lib/kubelet/pods/8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2/volumes"
Jul 17 06:09:46.934787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:46.934756    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:47.073396 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.073372    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:47.144983 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.144946    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca\") pod \"3b443f89-668d-4b2b-b044-15302b9e3fda\" (UID: \"3b443f89-668d-4b2b-b044-15302b9e3fda\") "
Jul 17 06:09:47.145311 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.145286    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b443f89-668d-4b2b-b044-15302b9e3fda" (UID: "3b443f89-668d-4b2b-b044-15302b9e3fda"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:47.246464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.246415    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b443f89-668d-4b2b-b044-15302b9e3fda-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:09:47.921572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.921532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd" event={"ID":"3b443f89-668d-4b2b-b044-15302b9e3fda","Type":"ContainerDied","Data":"81678948a8d93c69e03b6899a06dbad38049cb5e3dd1e4fbdb99c736394cfc21"}
Jul 17 06:09:47.921781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.921545    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"
Jul 17 06:09:47.921781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.921625    2567 scope.go:117] "RemoveContainer" containerID="9d08d3fef627dd77e4d27218e1f314320c624374a47cfccbdf367eddfed958da"
Jul 17 06:09:47.941509 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.941482    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:47.947041 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:47.947017    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-wcrjd"]
Jul 17 06:09:48.021204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:09:48.021171    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" path="/var/lib/kubelet/pods/3b443f89-668d-4b2b-b044-15302b9e3fda/volumes"
Jul 17 06:10:02.022375 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022341    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022702    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022715    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022725    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022730    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022737    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022742    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022754    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022759    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022768    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.022767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022773    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022783    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022789    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b74a031-4e24-4241-b8d0-ac02c2ae14e9" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022801    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022806    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022813    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022818    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022867    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022876    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022883    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022889    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d6dc47-5606-4c60-ae32-10f9712adcc6" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022896    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022901    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022907    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.023089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.022912    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:02.027312 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.027287    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:02.028728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.028703    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:02.029702 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.029642    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:10:02.029702 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.029646    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:10:02.178862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.178818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4\" (UID: \"58121c93-90ff-4960-9bdf-c92c581c45ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:02.279730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.279620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4\" (UID: \"58121c93-90ff-4960-9bdf-c92c581c45ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:02.280256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.280237    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4\" (UID: \"58121c93-90ff-4960-9bdf-c92c581c45ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:02.338847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.338810    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:02.476541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:02.476515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:02.479178 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:10:02.479149    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58121c93_90ff_4960_9bdf_c92c581c45ac.slice/crio-ad649e8c4b16b901bb3964a002abcb607aa748562e0f1545bb0f4bff35230625 WatchSource:0}: Error finding container ad649e8c4b16b901bb3964a002abcb607aa748562e0f1545bb0f4bff35230625: Status 404 returned error can't find the container with id ad649e8c4b16b901bb3964a002abcb607aa748562e0f1545bb0f4bff35230625
Jul 17 06:10:03.006824 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:03.006786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerStarted","Data":"c9c5a76254d090f8186126ad30dc5834de51c2d3f01426fbe5e0a1acb8359b9e"}
Jul 17 06:10:03.007023 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:03.006840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerStarted","Data":"ad649e8c4b16b901bb3964a002abcb607aa748562e0f1545bb0f4bff35230625"}
Jul 17 06:10:03.024024 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:03.023966    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" podStartSLOduration=1.023949353 podStartE2EDuration="1.023949353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:10:03.021436345 +0000 UTC m=+2221.484620449" watchObservedRunningTime="2026-07-17 06:10:03.023949353 +0000 UTC m=+2221.487133456"
Jul 17 06:10:04.013482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:04.013448    2567 generic.go:356] "Generic (PLEG): container finished" podID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerID="c9c5a76254d090f8186126ad30dc5834de51c2d3f01426fbe5e0a1acb8359b9e" exitCode=6
Jul 17 06:10:04.013762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:04.013533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerDied","Data":"c9c5a76254d090f8186126ad30dc5834de51c2d3f01426fbe5e0a1acb8359b9e"}
Jul 17 06:10:04.013825 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:04.013764    2567 scope.go:117] "RemoveContainer" containerID="c9c5a76254d090f8186126ad30dc5834de51c2d3f01426fbe5e0a1acb8359b9e"
Jul 17 06:10:05.020573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:05.020533    2567 generic.go:356] "Generic (PLEG): container finished" podID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerID="5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62" exitCode=6
Jul 17 06:10:05.021053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:05.020610    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerDied","Data":"5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62"}
Jul 17 06:10:05.021053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:05.020662    2567 scope.go:117] "RemoveContainer" containerID="c9c5a76254d090f8186126ad30dc5834de51c2d3f01426fbe5e0a1acb8359b9e"
Jul 17 06:10:05.021053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:05.020864    2567 scope.go:117] "RemoveContainer" containerID="5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62"
Jul 17 06:10:05.021167 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:05.021106    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4_odh-ai-gateway-infra(58121c93-90ff-4960-9bdf-c92c581c45ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac"
Jul 17 06:10:06.027093 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:06.027068    2567 scope.go:117] "RemoveContainer" containerID="5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62"
Jul 17 06:10:06.027522 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:06.027264    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4_odh-ai-gateway-infra(58121c93-90ff-4960-9bdf-c92c581c45ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac"
Jul 17 06:10:13.740589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.740545    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:13.741111 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.741089    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:13.741203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.741114    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:13.741203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.741156    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:13.741203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.741166    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0e89bf-420b-4f4e-a6c8-ad7eba6eb8a2" containerName="revoke-keys"
Jul 17 06:10:13.741361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.741252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b443f89-668d-4b2b-b044-15302b9e3fda" containerName="revoke-keys"
Jul 17 06:10:13.744258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.744235    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:13.753418 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.753391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:13.882476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.882438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq\" (UID: \"92f3ee7b-3ccf-413a-94ba-53ae5924aa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:13.983052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.983015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq\" (UID: \"92f3ee7b-3ccf-413a-94ba-53ae5924aa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:13.983635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:13.983616    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq\" (UID: \"92f3ee7b-3ccf-413a-94ba-53ae5924aa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:14.056219 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:14.056137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:14.188059 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:14.188031    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:14.190109 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:10:14.190077    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f3ee7b_3ccf_413a_94ba_53ae5924aa21.slice/crio-37a03a5839f833c6d4601ca315303fecbef26ffbd3b6e7636c26eab5077e1751 WatchSource:0}: Error finding container 37a03a5839f833c6d4601ca315303fecbef26ffbd3b6e7636c26eab5077e1751: Status 404 returned error can't find the container with id 37a03a5839f833c6d4601ca315303fecbef26ffbd3b6e7636c26eab5077e1751
Jul 17 06:10:15.073373 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:15.073340    2567 generic.go:356] "Generic (PLEG): container finished" podID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerID="97b988d54f63da4f1a7f3852a6ae3155e7c3d149ed3c979871e2f86c050b8e8d" exitCode=6
Jul 17 06:10:15.073833 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:15.073380    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" event={"ID":"92f3ee7b-3ccf-413a-94ba-53ae5924aa21","Type":"ContainerDied","Data":"97b988d54f63da4f1a7f3852a6ae3155e7c3d149ed3c979871e2f86c050b8e8d"}
Jul 17 06:10:15.073833 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:15.073424    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" event={"ID":"92f3ee7b-3ccf-413a-94ba-53ae5924aa21","Type":"ContainerStarted","Data":"37a03a5839f833c6d4601ca315303fecbef26ffbd3b6e7636c26eab5077e1751"}
Jul 17 06:10:15.073833 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:15.073572    2567 scope.go:117] "RemoveContainer" containerID="97b988d54f63da4f1a7f3852a6ae3155e7c3d149ed3c979871e2f86c050b8e8d"
Jul 17 06:10:16.080826 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:16.080791    2567 generic.go:356] "Generic (PLEG): container finished" podID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerID="dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe" exitCode=6
Jul 17 06:10:16.081222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:16.080873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" event={"ID":"92f3ee7b-3ccf-413a-94ba-53ae5924aa21","Type":"ContainerDied","Data":"dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe"}
Jul 17 06:10:16.081222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:16.080929    2567 scope.go:117] "RemoveContainer" containerID="97b988d54f63da4f1a7f3852a6ae3155e7c3d149ed3c979871e2f86c050b8e8d"
Jul 17 06:10:16.081222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:16.081143    2567 scope.go:117] "RemoveContainer" containerID="dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe"
Jul 17 06:10:16.081404 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:16.081383    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq_odh-ai-gateway-infra(92f3ee7b-3ccf-413a-94ba-53ae5924aa21)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21"
Jul 17 06:10:17.087398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.087374    2567 scope.go:117] "RemoveContainer" containerID="dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe"
Jul 17 06:10:17.087877 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:17.087556    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq_odh-ai-gateway-infra(92f3ee7b-3ccf-413a-94ba-53ae5924aa21)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21"
Jul 17 06:10:17.704532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.704493    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:17.709368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.709346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:17.714288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.714260    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:17.817945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.817903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf\" (UID: \"f181a9c2-27d9-4726-990c-52722abc1a35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:17.918756 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.918717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf\" (UID: \"f181a9c2-27d9-4726-990c-52722abc1a35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:17.919364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:17.919345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf\" (UID: \"f181a9c2-27d9-4726-990c-52722abc1a35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:18.020189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:18.020092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:18.156730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:18.156669    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:18.158267 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:10:18.158235    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf181a9c2_27d9_4726_990c_52722abc1a35.slice/crio-5d64f5335e13290f5575fc30708998d3f87f14244b642d057265d494ef232a58 WatchSource:0}: Error finding container 5d64f5335e13290f5575fc30708998d3f87f14244b642d057265d494ef232a58: Status 404 returned error can't find the container with id 5d64f5335e13290f5575fc30708998d3f87f14244b642d057265d494ef232a58
Jul 17 06:10:19.100096 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:19.100002    2567 generic.go:356] "Generic (PLEG): container finished" podID="f181a9c2-27d9-4726-990c-52722abc1a35" containerID="ca6434f51ca805503903f1d88454050cde2fc07a4129f880a27489b047eca1bd" exitCode=7
Jul 17 06:10:19.100254 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:19.100095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" event={"ID":"f181a9c2-27d9-4726-990c-52722abc1a35","Type":"ContainerDied","Data":"ca6434f51ca805503903f1d88454050cde2fc07a4129f880a27489b047eca1bd"}
Jul 17 06:10:19.100254 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:19.100144    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" event={"ID":"f181a9c2-27d9-4726-990c-52722abc1a35","Type":"ContainerStarted","Data":"5d64f5335e13290f5575fc30708998d3f87f14244b642d057265d494ef232a58"}
Jul 17 06:10:19.100338 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:19.100297    2567 scope.go:117] "RemoveContainer" containerID="ca6434f51ca805503903f1d88454050cde2fc07a4129f880a27489b047eca1bd"
Jul 17 06:10:20.106925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.106889    2567 generic.go:356] "Generic (PLEG): container finished" podID="f181a9c2-27d9-4726-990c-52722abc1a35" containerID="48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641" exitCode=7
Jul 17 06:10:20.107341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.106976    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" event={"ID":"f181a9c2-27d9-4726-990c-52722abc1a35","Type":"ContainerDied","Data":"48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641"}
Jul 17 06:10:20.107341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.107043    2567 scope.go:117] "RemoveContainer" containerID="ca6434f51ca805503903f1d88454050cde2fc07a4129f880a27489b047eca1bd"
Jul 17 06:10:20.107341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.107302    2567 scope.go:117] "RemoveContainer" containerID="48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641"
Jul 17 06:10:20.107548 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:20.107527    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf_odh-ai-gateway-infra(f181a9c2-27d9-4726-990c-52722abc1a35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" podUID="f181a9c2-27d9-4726-990c-52722abc1a35"
Jul 17 06:10:20.424659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.424573    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:20.429032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.429015    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:20.437464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.437428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:20.541487 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.541442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-f76qb\" (UID: \"498f27d3-8324-44f9-8aa8-7d018c65c42f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:20.642400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.642355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-f76qb\" (UID: \"498f27d3-8324-44f9-8aa8-7d018c65c42f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:20.643023 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.643002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-f76qb\" (UID: \"498f27d3-8324-44f9-8aa8-7d018c65c42f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:20.749128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.749093    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:20.882779 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:20.882752    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:20.884877 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:10:20.884845    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498f27d3_8324_44f9_8aa8_7d018c65c42f.slice/crio-7b2b4ea47b72c359b744a482fcda709e8fa0de124371260cf8c2a508666be8f4 WatchSource:0}: Error finding container 7b2b4ea47b72c359b744a482fcda709e8fa0de124371260cf8c2a508666be8f4: Status 404 returned error can't find the container with id 7b2b4ea47b72c359b744a482fcda709e8fa0de124371260cf8c2a508666be8f4
Jul 17 06:10:21.014825 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:21.014740    2567 scope.go:117] "RemoveContainer" containerID="5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62"
Jul 17 06:10:21.114057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:21.114024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" event={"ID":"498f27d3-8324-44f9-8aa8-7d018c65c42f","Type":"ContainerStarted","Data":"7b2b4ea47b72c359b744a482fcda709e8fa0de124371260cf8c2a508666be8f4"}
Jul 17 06:10:21.115774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:21.115754    2567 scope.go:117] "RemoveContainer" containerID="48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641"
Jul 17 06:10:21.116011 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:21.115988    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf_odh-ai-gateway-infra(f181a9c2-27d9-4726-990c-52722abc1a35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" podUID="f181a9c2-27d9-4726-990c-52722abc1a35"
Jul 17 06:10:22.123048 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.123016    2567 generic.go:356] "Generic (PLEG): container finished" podID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerID="e74b395882630c897721ae0094c349a1efd9c73a2c8c757bf022c8737611476e" exitCode=6
Jul 17 06:10:22.123515 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.123112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" event={"ID":"498f27d3-8324-44f9-8aa8-7d018c65c42f","Type":"ContainerDied","Data":"e74b395882630c897721ae0094c349a1efd9c73a2c8c757bf022c8737611476e"}
Jul 17 06:10:22.123515 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.123290    2567 scope.go:117] "RemoveContainer" containerID="e74b395882630c897721ae0094c349a1efd9c73a2c8c757bf022c8737611476e"
Jul 17 06:10:22.124915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.124893    2567 generic.go:356] "Generic (PLEG): container finished" podID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerID="3d9536bb3a658703f7bc76cafaf83fe9813acd04d6538a8831cc13e7b5b4ea15" exitCode=6
Jul 17 06:10:22.125033 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.124960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerDied","Data":"3d9536bb3a658703f7bc76cafaf83fe9813acd04d6538a8831cc13e7b5b4ea15"}
Jul 17 06:10:22.125033 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.125006    2567 scope.go:117] "RemoveContainer" containerID="5422af4e464c0ec7c5b0c738f823e753cde4e692ddcdb817677c3c6a16901e62"
Jul 17 06:10:22.125302 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:22.125287    2567 scope.go:117] "RemoveContainer" containerID="3d9536bb3a658703f7bc76cafaf83fe9813acd04d6538a8831cc13e7b5b4ea15"
Jul 17 06:10:22.125528 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:22.125506    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4_odh-ai-gateway-infra(58121c93-90ff-4960-9bdf-c92c581c45ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac"
Jul 17 06:10:23.132638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.132520    2567 generic.go:356] "Generic (PLEG): container finished" podID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerID="63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937" exitCode=6
Jul 17 06:10:23.132638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.132612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" event={"ID":"498f27d3-8324-44f9-8aa8-7d018c65c42f","Type":"ContainerDied","Data":"63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937"}
Jul 17 06:10:23.133174 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.132707    2567 scope.go:117] "RemoveContainer" containerID="e74b395882630c897721ae0094c349a1efd9c73a2c8c757bf022c8737611476e"
Jul 17 06:10:23.133174 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.132797    2567 scope.go:117] "RemoveContainer" containerID="63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937"
Jul 17 06:10:23.133174 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:23.133052    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-f76qb_odh-ai-gateway-infra(498f27d3-8324-44f9-8aa8-7d018c65c42f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f"
Jul 17 06:10:23.160716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.160671    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:23.293490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.293468    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:23.368385 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.368350    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca\") pod \"58121c93-90ff-4960-9bdf-c92c581c45ac\" (UID: \"58121c93-90ff-4960-9bdf-c92c581c45ac\") "
Jul 17 06:10:23.368728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.368701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58121c93-90ff-4960-9bdf-c92c581c45ac" (UID: "58121c93-90ff-4960-9bdf-c92c581c45ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:10:23.469102 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:23.469071    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58121c93-90ff-4960-9bdf-c92c581c45ac-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:10:24.140962 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.140930    2567 scope.go:117] "RemoveContainer" containerID="63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937"
Jul 17 06:10:24.141383 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:24.141158    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-f76qb_odh-ai-gateway-infra(498f27d3-8324-44f9-8aa8-7d018c65c42f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f"
Jul 17 06:10:24.142003 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.141987    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"
Jul 17 06:10:24.142067 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.142042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4" event={"ID":"58121c93-90ff-4960-9bdf-c92c581c45ac","Type":"ContainerDied","Data":"ad649e8c4b16b901bb3964a002abcb607aa748562e0f1545bb0f4bff35230625"}
Jul 17 06:10:24.142108 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.142098    2567 scope.go:117] "RemoveContainer" containerID="3d9536bb3a658703f7bc76cafaf83fe9813acd04d6538a8831cc13e7b5b4ea15"
Jul 17 06:10:24.173621 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.168520    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:24.178531 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:24.178501    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zjpz4"]
Jul 17 06:10:26.022468 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:26.022426    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" path="/var/lib/kubelet/pods/58121c93-90ff-4960-9bdf-c92c581c45ac/volumes"
Jul 17 06:10:29.014888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:29.014854    2567 scope.go:117] "RemoveContainer" containerID="dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe"
Jul 17 06:10:30.179228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:30.179195    2567 generic.go:356] "Generic (PLEG): container finished" podID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerID="7f351c0c1e99f7a5351868ce020c224c1647d90abf75b15a602be70353e2bf63" exitCode=6
Jul 17 06:10:30.179228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:30.179229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" event={"ID":"92f3ee7b-3ccf-413a-94ba-53ae5924aa21","Type":"ContainerDied","Data":"7f351c0c1e99f7a5351868ce020c224c1647d90abf75b15a602be70353e2bf63"}
Jul 17 06:10:30.179797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:30.179288    2567 scope.go:117] "RemoveContainer" containerID="dff141b6800707aaa0acc23065851939f9d75eed6ebd65dafe2160ad2374b3fe"
Jul 17 06:10:30.179797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:30.179596    2567 scope.go:117] "RemoveContainer" containerID="7f351c0c1e99f7a5351868ce020c224c1647d90abf75b15a602be70353e2bf63"
Jul 17 06:10:30.179910 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:30.179865    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq_odh-ai-gateway-infra(92f3ee7b-3ccf-413a-94ba-53ae5924aa21)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21"
Jul 17 06:10:31.203211 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:31.203182    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:31.341995 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:31.341970    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:31.427642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:31.427610    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca\") pod \"92f3ee7b-3ccf-413a-94ba-53ae5924aa21\" (UID: \"92f3ee7b-3ccf-413a-94ba-53ae5924aa21\") "
Jul 17 06:10:31.428028 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:31.428007    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92f3ee7b-3ccf-413a-94ba-53ae5924aa21" (UID: "92f3ee7b-3ccf-413a-94ba-53ae5924aa21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:10:31.528928 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:31.528841    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f3ee7b-3ccf-413a-94ba-53ae5924aa21-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:10:32.192563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:32.192535    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"
Jul 17 06:10:32.192563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:32.192540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq" event={"ID":"92f3ee7b-3ccf-413a-94ba-53ae5924aa21","Type":"ContainerDied","Data":"37a03a5839f833c6d4601ca315303fecbef26ffbd3b6e7636c26eab5077e1751"}
Jul 17 06:10:32.192810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:32.192603    2567 scope.go:117] "RemoveContainer" containerID="7f351c0c1e99f7a5351868ce020c224c1647d90abf75b15a602be70353e2bf63"
Jul 17 06:10:32.208757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:32.208730    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:32.214151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:32.214115    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qnnhq"]
Jul 17 06:10:34.020857 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:34.020821    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" path="/var/lib/kubelet/pods/92f3ee7b-3ccf-413a-94ba-53ae5924aa21/volumes"
Jul 17 06:10:35.015017 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:35.014984    2567 scope.go:117] "RemoveContainer" containerID="48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641"
Jul 17 06:10:36.217067 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:36.217031    2567 generic.go:356] "Generic (PLEG): container finished" podID="f181a9c2-27d9-4726-990c-52722abc1a35" containerID="259009b663b401cb05877459e4a3214ab6d4c1440311b22ee3768641aa6436d2" exitCode=7
Jul 17 06:10:36.217435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:36.217105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" event={"ID":"f181a9c2-27d9-4726-990c-52722abc1a35","Type":"ContainerDied","Data":"259009b663b401cb05877459e4a3214ab6d4c1440311b22ee3768641aa6436d2"}
Jul 17 06:10:36.217435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:36.217164    2567 scope.go:117] "RemoveContainer" containerID="48648cc41be4325bb787d2bb235fc7a4f4c48abd30209dfca704dedf27a07641"
Jul 17 06:10:36.217536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:36.217457    2567 scope.go:117] "RemoveContainer" containerID="259009b663b401cb05877459e4a3214ab6d4c1440311b22ee3768641aa6436d2"
Jul 17 06:10:36.217738 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:36.217711    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf_odh-ai-gateway-infra(f181a9c2-27d9-4726-990c-52722abc1a35)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" podUID="f181a9c2-27d9-4726-990c-52722abc1a35"
Jul 17 06:10:37.243556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:37.243522    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:37.380533 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:37.380507    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:37.469069 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:37.469038    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca\") pod \"f181a9c2-27d9-4726-990c-52722abc1a35\" (UID: \"f181a9c2-27d9-4726-990c-52722abc1a35\") "
Jul 17 06:10:37.469407 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:37.469383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f181a9c2-27d9-4726-990c-52722abc1a35" (UID: "f181a9c2-27d9-4726-990c-52722abc1a35"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:10:37.569656 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:37.569581    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f181a9c2-27d9-4726-990c-52722abc1a35-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:10:38.230651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:38.230622    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"
Jul 17 06:10:38.230651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:38.230644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf" event={"ID":"f181a9c2-27d9-4726-990c-52722abc1a35","Type":"ContainerDied","Data":"5d64f5335e13290f5575fc30708998d3f87f14244b642d057265d494ef232a58"}
Jul 17 06:10:38.230860 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:38.230740    2567 scope.go:117] "RemoveContainer" containerID="259009b663b401cb05877459e4a3214ab6d4c1440311b22ee3768641aa6436d2"
Jul 17 06:10:38.246423 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:38.246386    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:38.252126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:38.252104    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lxcvf"]
Jul 17 06:10:40.015739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:40.015705    2567 scope.go:117] "RemoveContainer" containerID="63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937"
Jul 17 06:10:40.021532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:40.021509    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" path="/var/lib/kubelet/pods/f181a9c2-27d9-4726-990c-52722abc1a35/volumes"
Jul 17 06:10:41.249764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:41.249723    2567 generic.go:356] "Generic (PLEG): container finished" podID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerID="a08d9265f3d6b8b7ce82366ef6afe8c9f173a49ee623340919c55fea2123079f" exitCode=6
Jul 17 06:10:41.250246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:41.249804    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" event={"ID":"498f27d3-8324-44f9-8aa8-7d018c65c42f","Type":"ContainerDied","Data":"a08d9265f3d6b8b7ce82366ef6afe8c9f173a49ee623340919c55fea2123079f"}
Jul 17 06:10:41.250246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:41.249882    2567 scope.go:117] "RemoveContainer" containerID="63445558b88daae41ed29a08e5c67c9fba2f408b9d22c3db0f9304926c2c4937"
Jul 17 06:10:41.250246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:41.250214    2567 scope.go:117] "RemoveContainer" containerID="a08d9265f3d6b8b7ce82366ef6afe8c9f173a49ee623340919c55fea2123079f"
Jul 17 06:10:41.250486 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:10:41.250466    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-f76qb_odh-ai-gateway-infra(498f27d3-8324-44f9-8aa8-7d018c65c42f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f"
Jul 17 06:10:42.275345 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:42.275314    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:42.406481 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:42.406458    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:42.514398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:42.514360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca\") pod \"498f27d3-8324-44f9-8aa8-7d018c65c42f\" (UID: \"498f27d3-8324-44f9-8aa8-7d018c65c42f\") "
Jul 17 06:10:42.514790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:42.514766    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "498f27d3-8324-44f9-8aa8-7d018c65c42f" (UID: "498f27d3-8324-44f9-8aa8-7d018c65c42f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:10:42.615302 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:42.615229    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/498f27d3-8324-44f9-8aa8-7d018c65c42f-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:10:43.264940 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:43.264908    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"
Jul 17 06:10:43.265153 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:43.264909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb" event={"ID":"498f27d3-8324-44f9-8aa8-7d018c65c42f","Type":"ContainerDied","Data":"7b2b4ea47b72c359b744a482fcda709e8fa0de124371260cf8c2a508666be8f4"}
Jul 17 06:10:43.265153 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:43.265053    2567 scope.go:117] "RemoveContainer" containerID="a08d9265f3d6b8b7ce82366ef6afe8c9f173a49ee623340919c55fea2123079f"
Jul 17 06:10:43.288199 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:43.288164    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:43.292282 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:43.292257    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-f76qb"]
Jul 17 06:10:44.021038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:10:44.021008    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" path="/var/lib/kubelet/pods/498f27d3-8324-44f9-8aa8-7d018c65c42f/volumes"
Jul 17 06:11:02.060162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060123    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060492    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060503    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060516    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060521    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060529    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060534    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060540    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060545    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060558    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060563    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060568    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060573    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060584    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060589    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060594    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060599    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060605    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060611    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060616    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.060659 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060621    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060690    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060700    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060708    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060714    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060721    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060725    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060732    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060738    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060743    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060748    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f3ee7b-3ccf-413a-94ba-53ae5924aa21" containerName="revoke-keys"
Jul 17 06:11:02.061368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.060752    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f181a9c2-27d9-4726-990c-52722abc1a35" containerName="revoke-keys"
Jul 17 06:11:02.065256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.065229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:02.067737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.067715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:11:02.067966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.067714    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:11:02.069441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.069417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:02.188850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.188812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx\" (UID: \"46e254c7-364a-4482-b215-423d8c83aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:02.290163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.290106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx\" (UID: \"46e254c7-364a-4482-b215-423d8c83aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:02.290792 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.290771    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx\" (UID: \"46e254c7-364a-4482-b215-423d8c83aee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:02.377266 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.377177    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:02.518746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:02.518719    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:02.520787 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:11:02.520760    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e254c7_364a_4482_b215_423d8c83aee7.slice/crio-a203640b3a893615d250be16334f237ec0c4e146687b62c2f51996249bc1d962 WatchSource:0}: Error finding container a203640b3a893615d250be16334f237ec0c4e146687b62c2f51996249bc1d962: Status 404 returned error can't find the container with id a203640b3a893615d250be16334f237ec0c4e146687b62c2f51996249bc1d962
Jul 17 06:11:03.375982 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.375895    2567 generic.go:356] "Generic (PLEG): container finished" podID="46e254c7-364a-4482-b215-423d8c83aee7" containerID="9dde9fb126790762a2cfb484ee0c0699bd087f81c648e7d9818f5d041a066e8b" exitCode=6
Jul 17 06:11:03.376370 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.375977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerDied","Data":"9dde9fb126790762a2cfb484ee0c0699bd087f81c648e7d9818f5d041a066e8b"}
Jul 17 06:11:03.376370 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.376027    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerStarted","Data":"a203640b3a893615d250be16334f237ec0c4e146687b62c2f51996249bc1d962"}
Jul 17 06:11:03.376370 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.376173    2567 scope.go:117] "RemoveContainer" containerID="9dde9fb126790762a2cfb484ee0c0699bd087f81c648e7d9818f5d041a066e8b"
Jul 17 06:11:03.783466 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:03.783817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783804    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:03.783865 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783818    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="498f27d3-8324-44f9-8aa8-7d018c65c42f" containerName="revoke-keys"
Jul 17 06:11:03.783865 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783834    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:03.783865 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783842    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:03.783967 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.783901    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58121c93-90ff-4960-9bdf-c92c581c45ac" containerName="revoke-keys"
Jul 17 06:11:03.786888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.786870    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:03.794369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.794340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:03.904672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:03.904627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rllv7\" (UID: \"9f87b9ec-6460-4f51-a05e-b38d64f21152\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:04.006128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.006089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rllv7\" (UID: \"9f87b9ec-6460-4f51-a05e-b38d64f21152\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:04.006767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.006745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rllv7\" (UID: \"9f87b9ec-6460-4f51-a05e-b38d64f21152\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:04.100695 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.100653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:04.232061 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.232032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:04.234021 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:11:04.233994    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f87b9ec_6460_4f51_a05e_b38d64f21152.slice/crio-a3b3753d8835b02cf9086c9ffec493c1a092044e3cc7aaa969c4072972e7a5bb WatchSource:0}: Error finding container a3b3753d8835b02cf9086c9ffec493c1a092044e3cc7aaa969c4072972e7a5bb: Status 404 returned error can't find the container with id a3b3753d8835b02cf9086c9ffec493c1a092044e3cc7aaa969c4072972e7a5bb
Jul 17 06:11:04.383048 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.383013    2567 generic.go:356] "Generic (PLEG): container finished" podID="46e254c7-364a-4482-b215-423d8c83aee7" containerID="ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4" exitCode=6
Jul 17 06:11:04.383527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.383111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerDied","Data":"ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4"}
Jul 17 06:11:04.383527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.383167    2567 scope.go:117] "RemoveContainer" containerID="9dde9fb126790762a2cfb484ee0c0699bd087f81c648e7d9818f5d041a066e8b"
Jul 17 06:11:04.383527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.383296    2567 scope.go:117] "RemoveContainer" containerID="ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4"
Jul 17 06:11:04.383711 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:04.383563    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx_odh-ai-gateway-infra(46e254c7-364a-4482-b215-423d8c83aee7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" podUID="46e254c7-364a-4482-b215-423d8c83aee7"
Jul 17 06:11:04.384465 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:04.384445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerStarted","Data":"a3b3753d8835b02cf9086c9ffec493c1a092044e3cc7aaa969c4072972e7a5bb"}
Jul 17 06:11:05.397960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:05.397922    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerID="30b2ad683d5e934b676a8fc4e1bb43e631323ce8719841d413e9ab3b02eacc0e" exitCode=6
Jul 17 06:11:05.398421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:05.398006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerDied","Data":"30b2ad683d5e934b676a8fc4e1bb43e631323ce8719841d413e9ab3b02eacc0e"}
Jul 17 06:11:05.398421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:05.398228    2567 scope.go:117] "RemoveContainer" containerID="30b2ad683d5e934b676a8fc4e1bb43e631323ce8719841d413e9ab3b02eacc0e"
Jul 17 06:11:05.399857 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:05.399840    2567 scope.go:117] "RemoveContainer" containerID="ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4"
Jul 17 06:11:05.400037 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:05.400018    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx_odh-ai-gateway-infra(46e254c7-364a-4482-b215-423d8c83aee7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" podUID="46e254c7-364a-4482-b215-423d8c83aee7"
Jul 17 06:11:06.406624 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:06.406529    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerID="186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d" exitCode=6
Jul 17 06:11:06.407032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:06.406630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerDied","Data":"186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d"}
Jul 17 06:11:06.407032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:06.406708    2567 scope.go:117] "RemoveContainer" containerID="30b2ad683d5e934b676a8fc4e1bb43e631323ce8719841d413e9ab3b02eacc0e"
Jul 17 06:11:06.407032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:06.406845    2567 scope.go:117] "RemoveContainer" containerID="186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d"
Jul 17 06:11:06.407157 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:06.407090    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rllv7_odh-ai-gateway-infra(9f87b9ec-6460-4f51-a05e-b38d64f21152)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152"
Jul 17 06:11:07.413799 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:07.413774    2567 scope.go:117] "RemoveContainer" containerID="186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d"
Jul 17 06:11:07.414191 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:07.413981    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rllv7_odh-ai-gateway-infra(9f87b9ec-6460-4f51-a05e-b38d64f21152)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152"
Jul 17 06:11:16.015423 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:16.015390    2567 scope.go:117] "RemoveContainer" containerID="ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4"
Jul 17 06:11:16.465885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:16.465848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerStarted","Data":"807e64b3504f2ae4dac8bbf5ba27105271b1b44211eb5c694cd24e4e02a84b4e"}
Jul 17 06:11:16.482217 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:16.482161    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" podStartSLOduration=14.482143499 podStartE2EDuration="14.482143499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:11:16.480824405 +0000 UTC m=+2294.944008521" watchObservedRunningTime="2026-07-17 06:11:16.482143499 +0000 UTC m=+2294.945327603"
Jul 17 06:11:17.473298 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.473259    2567 generic.go:356] "Generic (PLEG): container finished" podID="46e254c7-364a-4482-b215-423d8c83aee7" containerID="807e64b3504f2ae4dac8bbf5ba27105271b1b44211eb5c694cd24e4e02a84b4e" exitCode=6
Jul 17 06:11:17.473704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.473333    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerDied","Data":"807e64b3504f2ae4dac8bbf5ba27105271b1b44211eb5c694cd24e4e02a84b4e"}
Jul 17 06:11:17.473704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.473421    2567 scope.go:117] "RemoveContainer" containerID="ad7cbd36129642e3d8148f889b08716c283bb8ab5b5e280c9bdb66c0a44abaa4"
Jul 17 06:11:17.473837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.473723    2567 scope.go:117] "RemoveContainer" containerID="807e64b3504f2ae4dac8bbf5ba27105271b1b44211eb5c694cd24e4e02a84b4e"
Jul 17 06:11:17.473963 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:17.473944    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx_odh-ai-gateway-infra(46e254c7-364a-4482-b215-423d8c83aee7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" podUID="46e254c7-364a-4482-b215-423d8c83aee7"
Jul 17 06:11:17.496494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.496466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:17.752180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.752093    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:17.756514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.756498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:17.761940 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.761908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:17.931480 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:17.931446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8\" (UID: \"42287142-b8f4-4375-aa1d-2fb46fa91a43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:18.032047 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.031957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8\" (UID: \"42287142-b8f4-4375-aa1d-2fb46fa91a43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:18.032595 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.032568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8\" (UID: \"42287142-b8f4-4375-aa1d-2fb46fa91a43\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:18.068472 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.068439    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:18.203270 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.203243    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:18.204724 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:11:18.204694    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42287142_b8f4_4375_aa1d_2fb46fa91a43.slice/crio-a3345aab6feaa13b69afa4e9e294e6d64a1988b75dd7c1dbc3330945cb1f97b2 WatchSource:0}: Error finding container a3345aab6feaa13b69afa4e9e294e6d64a1988b75dd7c1dbc3330945cb1f97b2: Status 404 returned error can't find the container with id a3345aab6feaa13b69afa4e9e294e6d64a1988b75dd7c1dbc3330945cb1f97b2
Jul 17 06:11:18.479918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.479889    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" event={"ID":"42287142-b8f4-4375-aa1d-2fb46fa91a43","Type":"ContainerStarted","Data":"a3345aab6feaa13b69afa4e9e294e6d64a1988b75dd7c1dbc3330945cb1f97b2"}
Jul 17 06:11:18.612066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.612041    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:18.738532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.738495    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca\") pod \"46e254c7-364a-4482-b215-423d8c83aee7\" (UID: \"46e254c7-364a-4482-b215-423d8c83aee7\") "
Jul 17 06:11:18.738897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.738867    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46e254c7-364a-4482-b215-423d8c83aee7" (UID: "46e254c7-364a-4482-b215-423d8c83aee7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:11:18.840107 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:18.840057    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e254c7-364a-4482-b215-423d8c83aee7-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:11:19.491490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.491452    2567 generic.go:356] "Generic (PLEG): container finished" podID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerID="5d32304ce1036287d22cf17dfeb9ae54a41159c824950504cab61fdacec03ef9" exitCode=7
Jul 17 06:11:19.491904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.491536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" event={"ID":"42287142-b8f4-4375-aa1d-2fb46fa91a43","Type":"ContainerDied","Data":"5d32304ce1036287d22cf17dfeb9ae54a41159c824950504cab61fdacec03ef9"}
Jul 17 06:11:19.491904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.491741    2567 scope.go:117] "RemoveContainer" containerID="5d32304ce1036287d22cf17dfeb9ae54a41159c824950504cab61fdacec03ef9"
Jul 17 06:11:19.493034 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.493016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx" event={"ID":"46e254c7-364a-4482-b215-423d8c83aee7","Type":"ContainerDied","Data":"a203640b3a893615d250be16334f237ec0c4e146687b62c2f51996249bc1d962"}
Jul 17 06:11:19.493124 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.493063    2567 scope.go:117] "RemoveContainer" containerID="807e64b3504f2ae4dac8bbf5ba27105271b1b44211eb5c694cd24e4e02a84b4e"
Jul 17 06:11:19.493124 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.493019    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"
Jul 17 06:11:19.518535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.518508    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:19.521258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:19.521235    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-bhvrx"]
Jul 17 06:11:20.020962 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.020931    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e254c7-364a-4482-b215-423d8c83aee7" path="/var/lib/kubelet/pods/46e254c7-364a-4482-b215-423d8c83aee7/volumes"
Jul 17 06:11:20.467732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.467691    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:20.468081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468068    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468083    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468104    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468110    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468188    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468196    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.468238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.468202    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:20.471217 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.471199    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:20.478285 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.478249    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:20.500428 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.500397    2567 generic.go:356] "Generic (PLEG): container finished" podID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerID="4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2" exitCode=7
Jul 17 06:11:20.500904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.500453    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" event={"ID":"42287142-b8f4-4375-aa1d-2fb46fa91a43","Type":"ContainerDied","Data":"4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2"}
Jul 17 06:11:20.500904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.500509    2567 scope.go:117] "RemoveContainer" containerID="5d32304ce1036287d22cf17dfeb9ae54a41159c824950504cab61fdacec03ef9"
Jul 17 06:11:20.500904 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.500717    2567 scope.go:117] "RemoveContainer" containerID="4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2"
Jul 17 06:11:20.501070 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:20.500964    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8_odh-ai-gateway-infra(42287142-b8f4-4375-aa1d-2fb46fa91a43)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43"
Jul 17 06:11:20.659559 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.659514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vkqnh\" (UID: \"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:20.760844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.760747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vkqnh\" (UID: \"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:20.761380 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.761353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vkqnh\" (UID: \"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:20.784008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.783983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:20.917617 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:20.917582    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:20.917763 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:11:20.917615    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fd6dc8_a5e5_4f06_868e_d7536c7a839c.slice/crio-cc6d7bc6296d1a06e942e2492ffbd12ddc1f2ec96226cc63ecf39a6d16a69b73 WatchSource:0}: Error finding container cc6d7bc6296d1a06e942e2492ffbd12ddc1f2ec96226cc63ecf39a6d16a69b73: Status 404 returned error can't find the container with id cc6d7bc6296d1a06e942e2492ffbd12ddc1f2ec96226cc63ecf39a6d16a69b73
Jul 17 06:11:21.015151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.015071    2567 scope.go:117] "RemoveContainer" containerID="186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d"
Jul 17 06:11:21.508961 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.508915    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerStarted","Data":"78d6c47069f64daa5aa6d5380174b7b9b547eb82e4098ec33de8d1a5439fcb11"}
Jul 17 06:11:21.509373 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.508989    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerStarted","Data":"cc6d7bc6296d1a06e942e2492ffbd12ddc1f2ec96226cc63ecf39a6d16a69b73"}
Jul 17 06:11:21.510573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.510557    2567 scope.go:117] "RemoveContainer" containerID="4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2"
Jul 17 06:11:21.510778 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:21.510761    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8_odh-ai-gateway-infra(42287142-b8f4-4375-aa1d-2fb46fa91a43)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43"
Jul 17 06:11:21.512129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.512109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerStarted","Data":"9a10265185851d811b31f5f6b3ad94e6ffa953b9ab242e57b3f338336e40adcd"}
Jul 17 06:11:21.523879 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.523839    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" podStartSLOduration=1.523826144 podStartE2EDuration="1.523826144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:11:21.52362887 +0000 UTC m=+2299.986812973" watchObservedRunningTime="2026-07-17 06:11:21.523826144 +0000 UTC m=+2299.987010248"
Jul 17 06:11:21.538412 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:21.538324    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" podStartSLOduration=18.538311217 podStartE2EDuration="18.538311217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:11:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:11:21.536998542 +0000 UTC m=+2300.000182646" watchObservedRunningTime="2026-07-17 06:11:21.538311217 +0000 UTC m=+2300.001495349"
Jul 17 06:11:22.518404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.518366    2567 generic.go:356] "Generic (PLEG): container finished" podID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerID="78d6c47069f64daa5aa6d5380174b7b9b547eb82e4098ec33de8d1a5439fcb11" exitCode=6
Jul 17 06:11:22.518862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.518465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerDied","Data":"78d6c47069f64daa5aa6d5380174b7b9b547eb82e4098ec33de8d1a5439fcb11"}
Jul 17 06:11:22.518862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.518706    2567 scope.go:117] "RemoveContainer" containerID="78d6c47069f64daa5aa6d5380174b7b9b547eb82e4098ec33de8d1a5439fcb11"
Jul 17 06:11:22.520388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.520363    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerID="9a10265185851d811b31f5f6b3ad94e6ffa953b9ab242e57b3f338336e40adcd" exitCode=6
Jul 17 06:11:22.520482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.520415    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerDied","Data":"9a10265185851d811b31f5f6b3ad94e6ffa953b9ab242e57b3f338336e40adcd"}
Jul 17 06:11:22.520482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.520452    2567 scope.go:117] "RemoveContainer" containerID="186125eb177b9210d72c30784dbd55286e4be75a1e0c30c4b3910044d1d6665d"
Jul 17 06:11:22.520714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.520698    2567 scope.go:117] "RemoveContainer" containerID="9a10265185851d811b31f5f6b3ad94e6ffa953b9ab242e57b3f338336e40adcd"
Jul 17 06:11:22.520927 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:22.520901    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rllv7_odh-ai-gateway-infra(9f87b9ec-6460-4f51-a05e-b38d64f21152)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152"
Jul 17 06:11:22.546921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:22.546898    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:23.530007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.529980    2567 generic.go:356] "Generic (PLEG): container finished" podID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerID="02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f" exitCode=6
Jul 17 06:11:23.530368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.530048    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerDied","Data":"02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f"}
Jul 17 06:11:23.530368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.530108    2567 scope.go:117] "RemoveContainer" containerID="78d6c47069f64daa5aa6d5380174b7b9b547eb82e4098ec33de8d1a5439fcb11"
Jul 17 06:11:23.530368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.530275    2567 scope.go:117] "RemoveContainer" containerID="02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f"
Jul 17 06:11:23.530567 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:23.530545    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vkqnh_odh-ai-gateway-infra(b8fd6dc8-a5e5-4f06-868e-d7536c7a839c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c"
Jul 17 06:11:23.667393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.667370    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:23.677805 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.677782    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca\") pod \"9f87b9ec-6460-4f51-a05e-b38d64f21152\" (UID: \"9f87b9ec-6460-4f51-a05e-b38d64f21152\") "
Jul 17 06:11:23.678104 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.678081    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f87b9ec-6460-4f51-a05e-b38d64f21152" (UID: "9f87b9ec-6460-4f51-a05e-b38d64f21152"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:11:23.779157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:23.779069    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f87b9ec-6460-4f51-a05e-b38d64f21152-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:11:24.537778 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.537745    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"
Jul 17 06:11:24.538250 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.537754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7" event={"ID":"9f87b9ec-6460-4f51-a05e-b38d64f21152","Type":"ContainerDied","Data":"a3b3753d8835b02cf9086c9ffec493c1a092044e3cc7aaa969c4072972e7a5bb"}
Jul 17 06:11:24.538250 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.537865    2567 scope.go:117] "RemoveContainer" containerID="9a10265185851d811b31f5f6b3ad94e6ffa953b9ab242e57b3f338336e40adcd"
Jul 17 06:11:24.539850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.539829    2567 scope.go:117] "RemoveContainer" containerID="02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f"
Jul 17 06:11:24.540126 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:24.540081    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vkqnh_odh-ai-gateway-infra(b8fd6dc8-a5e5-4f06-868e-d7536c7a839c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c"
Jul 17 06:11:24.553572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.553549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:24.556506 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:24.556470    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rllv7"]
Jul 17 06:11:26.022165 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:26.022129    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" path="/var/lib/kubelet/pods/9f87b9ec-6460-4f51-a05e-b38d64f21152/volumes"
Jul 17 06:11:34.015766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:34.015733    2567 scope.go:117] "RemoveContainer" containerID="4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2"
Jul 17 06:11:34.596591 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:34.596563    2567 generic.go:356] "Generic (PLEG): container finished" podID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerID="2d8b6c67cb58b03350131aa3e8a7b049a861b7512d990a26625bef4b3f4473b2" exitCode=7
Jul 17 06:11:34.596763 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:34.596638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" event={"ID":"42287142-b8f4-4375-aa1d-2fb46fa91a43","Type":"ContainerDied","Data":"2d8b6c67cb58b03350131aa3e8a7b049a861b7512d990a26625bef4b3f4473b2"}
Jul 17 06:11:34.596763 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:34.596731    2567 scope.go:117] "RemoveContainer" containerID="4113fc521b1cddb5fa3b655cd87888fba10b9bd8008c728b281110d99a6d1cc2"
Jul 17 06:11:34.597047 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:34.597029    2567 scope.go:117] "RemoveContainer" containerID="2d8b6c67cb58b03350131aa3e8a7b049a861b7512d990a26625bef4b3f4473b2"
Jul 17 06:11:34.597270 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:34.597247    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8_odh-ai-gateway-infra(42287142-b8f4-4375-aa1d-2fb46fa91a43)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43"
Jul 17 06:11:35.624459 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:35.624421    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:35.746628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:35.746600    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:35.770797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:35.770768    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca\") pod \"42287142-b8f4-4375-aa1d-2fb46fa91a43\" (UID: \"42287142-b8f4-4375-aa1d-2fb46fa91a43\") "
Jul 17 06:11:35.771162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:35.771141    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42287142-b8f4-4375-aa1d-2fb46fa91a43" (UID: "42287142-b8f4-4375-aa1d-2fb46fa91a43"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:11:35.871982 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:35.871925    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42287142-b8f4-4375-aa1d-2fb46fa91a43-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:11:36.611029 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:36.611000    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"
Jul 17 06:11:36.611029 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:36.611023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8" event={"ID":"42287142-b8f4-4375-aa1d-2fb46fa91a43","Type":"ContainerDied","Data":"a3345aab6feaa13b69afa4e9e294e6d64a1988b75dd7c1dbc3330945cb1f97b2"}
Jul 17 06:11:36.611257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:36.611078    2567 scope.go:117] "RemoveContainer" containerID="2d8b6c67cb58b03350131aa3e8a7b049a861b7512d990a26625bef4b3f4473b2"
Jul 17 06:11:36.627170 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:36.627136    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:36.629233 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:36.629211    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lj9p8"]
Jul 17 06:11:37.015424 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:37.015396    2567 scope.go:117] "RemoveContainer" containerID="02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f"
Jul 17 06:11:37.618215 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:37.618184    2567 generic.go:356] "Generic (PLEG): container finished" podID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerID="c017ac38016eee68fcad8d4c00962c9cae84e169dbe294258b4523b4315112d5" exitCode=6
Jul 17 06:11:37.618406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:37.618255    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerDied","Data":"c017ac38016eee68fcad8d4c00962c9cae84e169dbe294258b4523b4315112d5"}
Jul 17 06:11:37.618406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:37.618310    2567 scope.go:117] "RemoveContainer" containerID="02378f02a59480be2e1d051241bfed94a3113c4cb6fc5aa9180f307e90067a1f"
Jul 17 06:11:37.618903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:37.618886    2567 scope.go:117] "RemoveContainer" containerID="c017ac38016eee68fcad8d4c00962c9cae84e169dbe294258b4523b4315112d5"
Jul 17 06:11:37.619138 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:37.619111    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vkqnh_odh-ai-gateway-infra(b8fd6dc8-a5e5-4f06-868e-d7536c7a839c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c"
Jul 17 06:11:38.020341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.020311    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" path="/var/lib/kubelet/pods/42287142-b8f4-4375-aa1d-2fb46fa91a43/volumes"
Jul 17 06:11:38.643648 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.643619    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:38.776934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.776911    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:38.796892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.796862    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca\") pod \"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c\" (UID: \"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c\") "
Jul 17 06:11:38.797281 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.797256    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" (UID: "b8fd6dc8-a5e5-4f06-868e-d7536c7a839c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:11:38.897607 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:38.897509    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:11:39.632454 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:39.632416    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh" event={"ID":"b8fd6dc8-a5e5-4f06-868e-d7536c7a839c","Type":"ContainerDied","Data":"cc6d7bc6296d1a06e942e2492ffbd12ddc1f2ec96226cc63ecf39a6d16a69b73"}
Jul 17 06:11:39.632934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:39.632472    2567 scope.go:117] "RemoveContainer" containerID="c017ac38016eee68fcad8d4c00962c9cae84e169dbe294258b4523b4315112d5"
Jul 17 06:11:39.632934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:39.632427    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"
Jul 17 06:11:39.654963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:39.654938    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:39.660221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:39.660198    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vkqnh"]
Jul 17 06:11:40.020972 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:40.020941    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" path="/var/lib/kubelet/pods/b8fd6dc8-a5e5-4f06-868e-d7536c7a839c/volumes"
Jul 17 06:11:52.111411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111376    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111748    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111758    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111764    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111771    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111776    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111786    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111792    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111798    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111803    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111820    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111824    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111834    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111839    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111853    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:52.111873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111858    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e254c7-364a-4482-b215-423d8c83aee7" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111908    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111917    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111925    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111931    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111937    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111948    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:11:52.112406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.111953    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fd6dc8-a5e5-4f06-868e-d7536c7a839c" containerName="revoke-keys"
Jul 17 06:11:52.116406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.116384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:11:52.118973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.118954    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:11:52.119077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.118990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:11:52.123426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.123402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:11:52.215972 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.215931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-csbkk\" (UID: \"3ec0b6e7-80b2-4510-b469-13cc911644c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:11:52.316398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.316359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-csbkk\" (UID: \"3ec0b6e7-80b2-4510-b469-13cc911644c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:11:52.317058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.317036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-csbkk\" (UID: \"3ec0b6e7-80b2-4510-b469-13cc911644c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:11:52.429105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.429017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:11:52.561136 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.560955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:11:52.564079 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:11:52.564038    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec0b6e7_80b2_4510_b469_13cc911644c8.slice/crio-30de0101fcc4a608e1fd51cc36933e2265dbfe4d8ab0c9f02b708d187b2bc342 WatchSource:0}: Error finding container 30de0101fcc4a608e1fd51cc36933e2265dbfe4d8ab0c9f02b708d187b2bc342: Status 404 returned error can't find the container with id 30de0101fcc4a608e1fd51cc36933e2265dbfe4d8ab0c9f02b708d187b2bc342
Jul 17 06:11:52.708038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:52.708001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" event={"ID":"3ec0b6e7-80b2-4510-b469-13cc911644c8","Type":"ContainerStarted","Data":"30de0101fcc4a608e1fd51cc36933e2265dbfe4d8ab0c9f02b708d187b2bc342"}
Jul 17 06:11:53.714460 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:53.714422    2567 generic.go:356] "Generic (PLEG): container finished" podID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerID="87577fa32c663e0f850af6d9f22d482422e6ed56293eb8880f55486ee2b55926" exitCode=6
Jul 17 06:11:53.714886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:53.714510    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" event={"ID":"3ec0b6e7-80b2-4510-b469-13cc911644c8","Type":"ContainerDied","Data":"87577fa32c663e0f850af6d9f22d482422e6ed56293eb8880f55486ee2b55926"}
Jul 17 06:11:53.714886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:53.714721    2567 scope.go:117] "RemoveContainer" containerID="87577fa32c663e0f850af6d9f22d482422e6ed56293eb8880f55486ee2b55926"
Jul 17 06:11:54.721527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:54.721496    2567 generic.go:356] "Generic (PLEG): container finished" podID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerID="6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58" exitCode=6
Jul 17 06:11:54.722036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:54.721564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" event={"ID":"3ec0b6e7-80b2-4510-b469-13cc911644c8","Type":"ContainerDied","Data":"6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58"}
Jul 17 06:11:54.722036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:54.721610    2567 scope.go:117] "RemoveContainer" containerID="87577fa32c663e0f850af6d9f22d482422e6ed56293eb8880f55486ee2b55926"
Jul 17 06:11:54.722036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:54.721908    2567 scope.go:117] "RemoveContainer" containerID="6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58"
Jul 17 06:11:54.722196 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:54.722144    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-csbkk_odh-ai-gateway-infra(3ec0b6e7-80b2-4510-b469-13cc911644c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8"
Jul 17 06:11:55.728456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:11:55.728428    2567 scope.go:117] "RemoveContainer" containerID="6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58"
Jul 17 06:11:55.728897 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:11:55.728628    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-csbkk_odh-ai-gateway-infra(3ec0b6e7-80b2-4510-b469-13cc911644c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8"
Jul 17 06:12:03.836089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836048    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:03.836585 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836564    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:12:03.836728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836588    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:12:03.836728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836634    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:12:03.836728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836644    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f87b9ec-6460-4f51-a05e-b38d64f21152" containerName="revoke-keys"
Jul 17 06:12:03.836889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.836749    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42287142-b8f4-4375-aa1d-2fb46fa91a43" containerName="revoke-keys"
Jul 17 06:12:03.841388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.841365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:03.848356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.848322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:03.922376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:03.922330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd\" (UID: \"0b778dc2-f033-49f5-9d10-a98c645e40e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:04.023874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.023843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd\" (UID: \"0b778dc2-f033-49f5-9d10-a98c645e40e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:04.024426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.024407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd\" (UID: \"0b778dc2-f033-49f5-9d10-a98c645e40e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:04.154106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.154008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:04.297772 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.297746    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:04.299795 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:04.299769    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b778dc2_f033_49f5_9d10_a98c645e40e1.slice/crio-8d72983673d241c0267797a99aec8171268eaba1ad9eac86b3df0e0431618d9e WatchSource:0}: Error finding container 8d72983673d241c0267797a99aec8171268eaba1ad9eac86b3df0e0431618d9e: Status 404 returned error can't find the container with id 8d72983673d241c0267797a99aec8171268eaba1ad9eac86b3df0e0431618d9e
Jul 17 06:12:04.778076 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.778036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerStarted","Data":"db62256467b77a8b3f87276cd294e3462111c90f7070fd9ad6435be7e34f0a25"}
Jul 17 06:12:04.778241 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.778106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerStarted","Data":"8d72983673d241c0267797a99aec8171268eaba1ad9eac86b3df0e0431618d9e"}
Jul 17 06:12:04.803284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:04.803230    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" podStartSLOduration=1.803213336 podStartE2EDuration="1.803213336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:12:04.80078797 +0000 UTC m=+2343.263972075" watchObservedRunningTime="2026-07-17 06:12:04.803213336 +0000 UTC m=+2343.266397440"
Jul 17 06:12:05.784976 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:05.784940    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerID="db62256467b77a8b3f87276cd294e3462111c90f7070fd9ad6435be7e34f0a25" exitCode=6
Jul 17 06:12:05.785334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:05.784993    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerDied","Data":"db62256467b77a8b3f87276cd294e3462111c90f7070fd9ad6435be7e34f0a25"}
Jul 17 06:12:05.785334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:05.785182    2567 scope.go:117] "RemoveContainer" containerID="db62256467b77a8b3f87276cd294e3462111c90f7070fd9ad6435be7e34f0a25"
Jul 17 06:12:06.791732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:06.791611    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerID="490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329" exitCode=6
Jul 17 06:12:06.792121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:06.791720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerDied","Data":"490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329"}
Jul 17 06:12:06.792121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:06.791781    2567 scope.go:117] "RemoveContainer" containerID="db62256467b77a8b3f87276cd294e3462111c90f7070fd9ad6435be7e34f0a25"
Jul 17 06:12:06.792121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:06.792005    2567 scope.go:117] "RemoveContainer" containerID="490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329"
Jul 17 06:12:06.792295 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:06.792216    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd_odh-ai-gateway-infra(0b778dc2-f033-49f5-9d10-a98c645e40e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1"
Jul 17 06:12:07.014783 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.014748    2567 scope.go:117] "RemoveContainer" containerID="6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58"
Jul 17 06:12:07.799658 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.799626    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:07.802100 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.802073    2567 generic.go:356] "Generic (PLEG): container finished" podID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerID="8076afd7fc667b1d47cdfd94e6b34aa3b89df9d134f2c11ef13fc0e748cd4d5c" exitCode=6
Jul 17 06:12:07.803189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.803159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" event={"ID":"3ec0b6e7-80b2-4510-b469-13cc911644c8","Type":"ContainerDied","Data":"8076afd7fc667b1d47cdfd94e6b34aa3b89df9d134f2c11ef13fc0e748cd4d5c"}
Jul 17 06:12:07.803293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.803205    2567 scope.go:117] "RemoveContainer" containerID="6a1135f93e489756938ec56decdce1ade351b8a90e7987cbe6c054f223cd4b58"
Jul 17 06:12:07.803293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.803259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:07.803523 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.803494    2567 scope.go:117] "RemoveContainer" containerID="8076afd7fc667b1d47cdfd94e6b34aa3b89df9d134f2c11ef13fc0e748cd4d5c"
Jul 17 06:12:07.803764 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:07.803742    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-csbkk_odh-ai-gateway-infra(3ec0b6e7-80b2-4510-b469-13cc911644c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8"
Jul 17 06:12:07.803933 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.803911    2567 scope.go:117] "RemoveContainer" containerID="490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329"
Jul 17 06:12:07.807340 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:07.804481    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd_odh-ai-gateway-infra(0b778dc2-f033-49f5-9d10-a98c645e40e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1"
Jul 17 06:12:07.814793 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.814773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:07.959171 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:07.959124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-km866\" (UID: \"0151f45f-cca4-4c8d-ae8a-db59b201a140\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:08.060199 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.060163    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-km866\" (UID: \"0151f45f-cca4-4c8d-ae8a-db59b201a140\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:08.060787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.060770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-km866\" (UID: \"0151f45f-cca4-4c8d-ae8a-db59b201a140\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:08.120177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.120121    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:08.258612 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.258587    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:08.260520 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:08.260487    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0151f45f_cca4_4c8d_ae8a_db59b201a140.slice/crio-1a07650f7c26c57e0fe2d440aa9588996ef200184ef03111b3cc014e65a3ebd5 WatchSource:0}: Error finding container 1a07650f7c26c57e0fe2d440aa9588996ef200184ef03111b3cc014e65a3ebd5: Status 404 returned error can't find the container with id 1a07650f7c26c57e0fe2d440aa9588996ef200184ef03111b3cc014e65a3ebd5
Jul 17 06:12:08.810693 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.810581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerStarted","Data":"e056f50196d8aa3efa7b65c2c401ffbd9e256d53281a932e2a00c95c29f46d51"}
Jul 17 06:12:08.810693 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.810653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerStarted","Data":"1a07650f7c26c57e0fe2d440aa9588996ef200184ef03111b3cc014e65a3ebd5"}
Jul 17 06:12:08.839544 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.839487    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" podStartSLOduration=1.8394709489999999 podStartE2EDuration="1.839470949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:12:08.824658523 +0000 UTC m=+2347.287842640" watchObservedRunningTime="2026-07-17 06:12:08.839470949 +0000 UTC m=+2347.302655052"
Jul 17 06:12:08.839839 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.839824    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:12:08.959164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:08.959138    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:12:09.068160 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.068067    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca\") pod \"3ec0b6e7-80b2-4510-b469-13cc911644c8\" (UID: \"3ec0b6e7-80b2-4510-b469-13cc911644c8\") "
Jul 17 06:12:09.068482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.068451    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ec0b6e7-80b2-4510-b469-13cc911644c8" (UID: "3ec0b6e7-80b2-4510-b469-13cc911644c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:09.169242 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.169197    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ec0b6e7-80b2-4510-b469-13cc911644c8-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:12:09.818414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.818379    2567 generic.go:356] "Generic (PLEG): container finished" podID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerID="e056f50196d8aa3efa7b65c2c401ffbd9e256d53281a932e2a00c95c29f46d51" exitCode=7
Jul 17 06:12:09.818848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.818466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerDied","Data":"e056f50196d8aa3efa7b65c2c401ffbd9e256d53281a932e2a00c95c29f46d51"}
Jul 17 06:12:09.818848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.818627    2567 scope.go:117] "RemoveContainer" containerID="e056f50196d8aa3efa7b65c2c401ffbd9e256d53281a932e2a00c95c29f46d51"
Jul 17 06:12:09.819941 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.819912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk" event={"ID":"3ec0b6e7-80b2-4510-b469-13cc911644c8","Type":"ContainerDied","Data":"30de0101fcc4a608e1fd51cc36933e2265dbfe4d8ab0c9f02b708d187b2bc342"}
Jul 17 06:12:09.819941 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.819932    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"
Jul 17 06:12:09.820070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.819956    2567 scope.go:117] "RemoveContainer" containerID="8076afd7fc667b1d47cdfd94e6b34aa3b89df9d134f2c11ef13fc0e748cd4d5c"
Jul 17 06:12:09.843695 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.843651    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:12:09.847840 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:09.847819    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-csbkk"]
Jul 17 06:12:10.020998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.020969    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" path="/var/lib/kubelet/pods/3ec0b6e7-80b2-4510-b469-13cc911644c8/volumes"
Jul 17 06:12:10.513758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.513723    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:10.514141 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514127    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514144    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514158    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514164    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514170    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514176    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514355 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514236    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514355 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514243    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.514355 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.514251    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec0b6e7-80b2-4510-b469-13cc911644c8" containerName="revoke-keys"
Jul 17 06:12:10.517204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.517187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:10.523393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.523363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:10.683748 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.683704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-xj78j\" (UID: \"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:10.784603 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.784512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-xj78j\" (UID: \"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:10.785172 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.785153    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-xj78j\" (UID: \"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:10.828736 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.828707    2567 generic.go:356] "Generic (PLEG): container finished" podID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerID="376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18" exitCode=7
Jul 17 06:12:10.829162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.828758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerDied","Data":"376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18"}
Jul 17 06:12:10.829162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.828803    2567 scope.go:117] "RemoveContainer" containerID="e056f50196d8aa3efa7b65c2c401ffbd9e256d53281a932e2a00c95c29f46d51"
Jul 17 06:12:10.829162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.828949    2567 scope.go:117] "RemoveContainer" containerID="376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18"
Jul 17 06:12:10.829308 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:10.829179    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-km866_odh-ai-gateway-infra(0151f45f-cca4-4c8d-ae8a-db59b201a140)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140"
Jul 17 06:12:10.840488 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.840471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:10.979190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:10.979169    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:10.981266 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:10.981237    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcc5ab4_bf3e_4145_bb0c_9bb2302666e7.slice/crio-48204fa36ab5c235ba415c55151ad05c9f56ff7a0815e81bb4513bc5c1ed2adb WatchSource:0}: Error finding container 48204fa36ab5c235ba415c55151ad05c9f56ff7a0815e81bb4513bc5c1ed2adb: Status 404 returned error can't find the container with id 48204fa36ab5c235ba415c55151ad05c9f56ff7a0815e81bb4513bc5c1ed2adb
Jul 17 06:12:11.835697 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:11.835594    2567 generic.go:356] "Generic (PLEG): container finished" podID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerID="061ff8594e9c9aadfdaf076ddf3fde75d04d9a39d531e1028ce9ad01fe43cc97" exitCode=6
Jul 17 06:12:11.836135 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:11.835700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" event={"ID":"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7","Type":"ContainerDied","Data":"061ff8594e9c9aadfdaf076ddf3fde75d04d9a39d531e1028ce9ad01fe43cc97"}
Jul 17 06:12:11.836135 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:11.835766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" event={"ID":"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7","Type":"ContainerStarted","Data":"48204fa36ab5c235ba415c55151ad05c9f56ff7a0815e81bb4513bc5c1ed2adb"}
Jul 17 06:12:11.836135 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:11.835895    2567 scope.go:117] "RemoveContainer" containerID="061ff8594e9c9aadfdaf076ddf3fde75d04d9a39d531e1028ce9ad01fe43cc97"
Jul 17 06:12:11.837441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:11.837426    2567 scope.go:117] "RemoveContainer" containerID="376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18"
Jul 17 06:12:11.837595 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:11.837577    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-km866_odh-ai-gateway-infra(0151f45f-cca4-4c8d-ae8a-db59b201a140)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140"
Jul 17 06:12:12.844532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:12.844431    2567 generic.go:356] "Generic (PLEG): container finished" podID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerID="9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45" exitCode=6
Jul 17 06:12:12.844532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:12.844495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" event={"ID":"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7","Type":"ContainerDied","Data":"9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45"}
Jul 17 06:12:12.845051 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:12.844555    2567 scope.go:117] "RemoveContainer" containerID="061ff8594e9c9aadfdaf076ddf3fde75d04d9a39d531e1028ce9ad01fe43cc97"
Jul 17 06:12:12.845051 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:12.844728    2567 scope.go:117] "RemoveContainer" containerID="9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45"
Jul 17 06:12:12.845051 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:12.844966    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-xj78j_odh-ai-gateway-infra(0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7"
Jul 17 06:12:13.851906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:13.851878    2567 scope.go:117] "RemoveContainer" containerID="9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45"
Jul 17 06:12:13.852295 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:13.852077    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-xj78j_odh-ai-gateway-infra(0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7"
Jul 17 06:12:20.015906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:20.015870    2567 scope.go:117] "RemoveContainer" containerID="490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329"
Jul 17 06:12:20.889892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:20.889811    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerID="4f1526b3a16db12a134d64a732106a7c81ba63efc9667cbdfabd892826f5ea6c" exitCode=6
Jul 17 06:12:20.889892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:20.889865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerDied","Data":"4f1526b3a16db12a134d64a732106a7c81ba63efc9667cbdfabd892826f5ea6c"}
Jul 17 06:12:20.890105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:20.889914    2567 scope.go:117] "RemoveContainer" containerID="490f7ab67021ae9a5068fde81f12b8a1be8d1b3c5c23aff74d5f4ae22fb02329"
Jul 17 06:12:20.890242 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:20.890224    2567 scope.go:117] "RemoveContainer" containerID="4f1526b3a16db12a134d64a732106a7c81ba63efc9667cbdfabd892826f5ea6c"
Jul 17 06:12:20.890493 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:20.890466    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd_odh-ai-gateway-infra(0b778dc2-f033-49f5-9d10-a98c645e40e1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1"
Jul 17 06:12:21.931371 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:21.931340    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:22.068040 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.068013    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:22.080911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.080889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca\") pod \"0b778dc2-f033-49f5-9d10-a98c645e40e1\" (UID: \"0b778dc2-f033-49f5-9d10-a98c645e40e1\") "
Jul 17 06:12:22.081302 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.081269    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b778dc2-f033-49f5-9d10-a98c645e40e1" (UID: "0b778dc2-f033-49f5-9d10-a98c645e40e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:22.081416 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.081391    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b778dc2-f033-49f5-9d10-a98c645e40e1-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:12:22.909884 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.909853    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"
Jul 17 06:12:22.910076 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.909849    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd" event={"ID":"0b778dc2-f033-49f5-9d10-a98c645e40e1","Type":"ContainerDied","Data":"8d72983673d241c0267797a99aec8171268eaba1ad9eac86b3df0e0431618d9e"}
Jul 17 06:12:22.910076 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.909998    2567 scope.go:117] "RemoveContainer" containerID="4f1526b3a16db12a134d64a732106a7c81ba63efc9667cbdfabd892826f5ea6c"
Jul 17 06:12:22.930736 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.930713    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:22.934944 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:22.934922    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-zd5cd"]
Jul 17 06:12:24.015277 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.015242    2567 scope.go:117] "RemoveContainer" containerID="376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18"
Jul 17 06:12:24.022268 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.022223    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" path="/var/lib/kubelet/pods/0b778dc2-f033-49f5-9d10-a98c645e40e1/volumes"
Jul 17 06:12:24.923410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.923325    2567 generic.go:356] "Generic (PLEG): container finished" podID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerID="5da7921478aed128b4089e487a0fcae28c20b60f9aae7acaf57b4f6c5cbce4f0" exitCode=7
Jul 17 06:12:24.923410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.923391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerDied","Data":"5da7921478aed128b4089e487a0fcae28c20b60f9aae7acaf57b4f6c5cbce4f0"}
Jul 17 06:12:24.923590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.923439    2567 scope.go:117] "RemoveContainer" containerID="376da2e27b67d7b8ec19d71be669efdffc633e5caca183a064add33e1d0ebe18"
Jul 17 06:12:24.923797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:24.923781    2567 scope.go:117] "RemoveContainer" containerID="5da7921478aed128b4089e487a0fcae28c20b60f9aae7acaf57b4f6c5cbce4f0"
Jul 17 06:12:24.924043 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:24.924015    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-km866_odh-ai-gateway-infra(0151f45f-cca4-4c8d-ae8a-db59b201a140)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140"
Jul 17 06:12:25.948897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:25.948859    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:26.095585 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.095560    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:26.114758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.114728    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca\") pod \"0151f45f-cca4-4c8d-ae8a-db59b201a140\" (UID: \"0151f45f-cca4-4c8d-ae8a-db59b201a140\") "
Jul 17 06:12:26.115133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.115106    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0151f45f-cca4-4c8d-ae8a-db59b201a140" (UID: "0151f45f-cca4-4c8d-ae8a-db59b201a140"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:26.215731 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.215592    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0151f45f-cca4-4c8d-ae8a-db59b201a140-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:12:26.936943 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.936913    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"
Jul 17 06:12:26.936943 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.936920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866" event={"ID":"0151f45f-cca4-4c8d-ae8a-db59b201a140","Type":"ContainerDied","Data":"1a07650f7c26c57e0fe2d440aa9588996ef200184ef03111b3cc014e65a3ebd5"}
Jul 17 06:12:26.937213 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.936982    2567 scope.go:117] "RemoveContainer" containerID="5da7921478aed128b4089e487a0fcae28c20b60f9aae7acaf57b4f6c5cbce4f0"
Jul 17 06:12:26.960011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.959983    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:26.965929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:26.965908    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-km866"]
Jul 17 06:12:28.027500 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:28.027460    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" path="/var/lib/kubelet/pods/0151f45f-cca4-4c8d-ae8a-db59b201a140/volumes"
Jul 17 06:12:29.015597 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:29.015565    2567 scope.go:117] "RemoveContainer" containerID="9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45"
Jul 17 06:12:29.955590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:29.955561    2567 generic.go:356] "Generic (PLEG): container finished" podID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerID="a6b0bee7acb7b3eb308fa91ea79373382fc4ad8d47033aac1b128a577d6c8ba0" exitCode=6
Jul 17 06:12:29.956013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:29.955635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" event={"ID":"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7","Type":"ContainerDied","Data":"a6b0bee7acb7b3eb308fa91ea79373382fc4ad8d47033aac1b128a577d6c8ba0"}
Jul 17 06:12:29.956013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:29.955707    2567 scope.go:117] "RemoveContainer" containerID="9f6665bad61279efbf771d1580f3a770ad228ca63dc354794a90d714aa9d8b45"
Jul 17 06:12:29.956013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:29.955962    2567 scope.go:117] "RemoveContainer" containerID="a6b0bee7acb7b3eb308fa91ea79373382fc4ad8d47033aac1b128a577d6c8ba0"
Jul 17 06:12:29.956194 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:29.956148    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-xj78j_odh-ai-gateway-infra(0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7"
Jul 17 06:12:30.980493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:30.980462    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:31.014891 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.014861    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:12:31.121430 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.121406    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:31.160667 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.160632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca\") pod \"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7\" (UID: \"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7\") "
Jul 17 06:12:31.160975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.160953    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" (UID: "0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:31.262392 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.262300    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:12:31.969177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.969144    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"
Jul 17 06:12:31.969350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.969143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j" event={"ID":"0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7","Type":"ContainerDied","Data":"48204fa36ab5c235ba415c55151ad05c9f56ff7a0815e81bb4513bc5c1ed2adb"}
Jul 17 06:12:31.969350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.969286    2567 scope.go:117] "RemoveContainer" containerID="a6b0bee7acb7b3eb308fa91ea79373382fc4ad8d47033aac1b128a577d6c8ba0"
Jul 17 06:12:31.991252 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.991225    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:31.994964 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:31.994940    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-xj78j"]
Jul 17 06:12:32.020521 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:32.020486    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" path="/var/lib/kubelet/pods/0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7/volumes"
Jul 17 06:12:42.157368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157332    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157735    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157750    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157758    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157764    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157775    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157781    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157786    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157792    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157796    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157801    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157817    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157821    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157828    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157884    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157891    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157896    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157901    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157910    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157916    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.157975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.157921    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:42.161035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.161019    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:12:42.163534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.163508    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:12:42.163534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.163523    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:12:42.168663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.168639    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:12:42.261310 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.261273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-wljvd\" (UID: \"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:12:42.362037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.362004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-wljvd\" (UID: \"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:12:42.362617 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.362597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-wljvd\" (UID: \"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:12:42.471968 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.471934    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:12:42.823201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:42.823174    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:12:42.824644 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:42.824617    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c975c93_c2e0_4198_adcf_b2cb3a1dbba9.slice/crio-f02731ba1f941fec57def23014ac1dbe77054bd5053455402a0c1ef258e53240 WatchSource:0}: Error finding container f02731ba1f941fec57def23014ac1dbe77054bd5053455402a0c1ef258e53240: Status 404 returned error can't find the container with id f02731ba1f941fec57def23014ac1dbe77054bd5053455402a0c1ef258e53240
Jul 17 06:12:43.027492 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:43.027460    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" event={"ID":"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9","Type":"ContainerStarted","Data":"f02731ba1f941fec57def23014ac1dbe77054bd5053455402a0c1ef258e53240"}
Jul 17 06:12:44.033427 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:44.033398    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerID="43a053b7ddaeb16e2b1939cf72bd3b28310a05656b374197680f44e3ed3d8ce2" exitCode=6
Jul 17 06:12:44.033837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:44.033483    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" event={"ID":"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9","Type":"ContainerDied","Data":"43a053b7ddaeb16e2b1939cf72bd3b28310a05656b374197680f44e3ed3d8ce2"}
Jul 17 06:12:44.033837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:44.033631    2567 scope.go:117] "RemoveContainer" containerID="43a053b7ddaeb16e2b1939cf72bd3b28310a05656b374197680f44e3ed3d8ce2"
Jul 17 06:12:45.040934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:45.040897    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerID="61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88" exitCode=6
Jul 17 06:12:45.041439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:45.040938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" event={"ID":"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9","Type":"ContainerDied","Data":"61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88"}
Jul 17 06:12:45.041439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:45.040995    2567 scope.go:117] "RemoveContainer" containerID="43a053b7ddaeb16e2b1939cf72bd3b28310a05656b374197680f44e3ed3d8ce2"
Jul 17 06:12:45.041439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:45.041164    2567 scope.go:117] "RemoveContainer" containerID="61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88"
Jul 17 06:12:45.041439 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:45.041359    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-wljvd_odh-ai-gateway-infra(3c975c93-c2e0-4198-adcf-b2cb3a1dbba9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9"
Jul 17 06:12:46.047889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:46.047865    2567 scope.go:117] "RemoveContainer" containerID="61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88"
Jul 17 06:12:46.048297 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:46.048058    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-wljvd_odh-ai-gateway-infra(3c975c93-c2e0-4198-adcf-b2cb3a1dbba9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9"
Jul 17 06:12:53.873544 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873508    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:12:53.873953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873878    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:53.873953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873890    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:53.873953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873901    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:53.873953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873906    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b778dc2-f033-49f5-9d10-a98c645e40e1" containerName="revoke-keys"
Jul 17 06:12:53.874093 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873974    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0151f45f-cca4-4c8d-ae8a-db59b201a140" containerName="revoke-keys"
Jul 17 06:12:53.874093 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.873984    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcc5ab4-bf3e-4145-bb0c-9bb2302666e7" containerName="revoke-keys"
Jul 17 06:12:53.878371 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.878353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:12:53.883461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.883435    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:12:53.969288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:53.969227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j\" (UID: \"0b287d5b-1ba4-41a5-b92e-296321981aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:12:54.070123 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:54.070085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j\" (UID: \"0b287d5b-1ba4-41a5-b92e-296321981aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:12:54.070798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:54.070780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j\" (UID: \"0b287d5b-1ba4-41a5-b92e-296321981aba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:12:54.190346 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:54.190262    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:12:54.330023 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:54.329995    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:12:54.332444 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:54.332417    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b287d5b_1ba4_41a5_b92e_296321981aba.slice/crio-983649bd82e188af885da2bf91e61d6ef7539a564784cc22114b3b7328dc370b WatchSource:0}: Error finding container 983649bd82e188af885da2bf91e61d6ef7539a564784cc22114b3b7328dc370b: Status 404 returned error can't find the container with id 983649bd82e188af885da2bf91e61d6ef7539a564784cc22114b3b7328dc370b
Jul 17 06:12:55.096305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:55.096274    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerID="74644ff856f67879c724792b4197758154b6e0f7b5508ec3d2e0932b61b5f640" exitCode=6
Jul 17 06:12:55.096792 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:55.096348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" event={"ID":"0b287d5b-1ba4-41a5-b92e-296321981aba","Type":"ContainerDied","Data":"74644ff856f67879c724792b4197758154b6e0f7b5508ec3d2e0932b61b5f640"}
Jul 17 06:12:55.096792 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:55.096406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" event={"ID":"0b287d5b-1ba4-41a5-b92e-296321981aba","Type":"ContainerStarted","Data":"983649bd82e188af885da2bf91e61d6ef7539a564784cc22114b3b7328dc370b"}
Jul 17 06:12:55.096792 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:55.096546    2567 scope.go:117] "RemoveContainer" containerID="74644ff856f67879c724792b4197758154b6e0f7b5508ec3d2e0932b61b5f640"
Jul 17 06:12:56.104011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:56.103970    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerID="1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d" exitCode=6
Jul 17 06:12:56.104421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:56.104058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" event={"ID":"0b287d5b-1ba4-41a5-b92e-296321981aba","Type":"ContainerDied","Data":"1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d"}
Jul 17 06:12:56.104421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:56.104120    2567 scope.go:117] "RemoveContainer" containerID="74644ff856f67879c724792b4197758154b6e0f7b5508ec3d2e0932b61b5f640"
Jul 17 06:12:56.104421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:56.104305    2567 scope.go:117] "RemoveContainer" containerID="1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d"
Jul 17 06:12:56.104558 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:56.104528    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j_odh-ai-gateway-infra(0b287d5b-1ba4-41a5-b92e-296321981aba)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba"
Jul 17 06:12:57.111518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:57.111486    2567 scope.go:117] "RemoveContainer" containerID="1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d"
Jul 17 06:12:57.111923 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:12:57.111711    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j_odh-ai-gateway-infra(0b287d5b-1ba4-41a5-b92e-296321981aba)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba"
Jul 17 06:12:57.839493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:57.839457    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:12:57.844145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:57.844126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:12:57.849090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:57.849043    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:12:58.006423 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:58.006377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4\" (UID: \"eb9f9465-8dd3-4184-8cef-f639cbda3e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:12:58.108006 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:58.107918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4\" (UID: \"eb9f9465-8dd3-4184-8cef-f639cbda3e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:12:58.108527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:58.108504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4\" (UID: \"eb9f9465-8dd3-4184-8cef-f639cbda3e0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:12:58.154999 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:58.154965    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:12:58.285713 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:58.285661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:12:58.287413 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:12:58.287385    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f9465_8dd3_4184_8cef_f639cbda3e0b.slice/crio-3c4b634bdb1333c70edbc617d2e54d4978ed340aa1dbb943c62a7338b1422283 WatchSource:0}: Error finding container 3c4b634bdb1333c70edbc617d2e54d4978ed340aa1dbb943c62a7338b1422283: Status 404 returned error can't find the container with id 3c4b634bdb1333c70edbc617d2e54d4978ed340aa1dbb943c62a7338b1422283
Jul 17 06:12:59.123157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:59.123121    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerID="b40f9220458cd6e44b162f97136d313813f7ea8c79fa073105436227fd7ea014" exitCode=6
Jul 17 06:12:59.123356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:59.123213    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerDied","Data":"b40f9220458cd6e44b162f97136d313813f7ea8c79fa073105436227fd7ea014"}
Jul 17 06:12:59.123356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:59.123276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerStarted","Data":"3c4b634bdb1333c70edbc617d2e54d4978ed340aa1dbb943c62a7338b1422283"}
Jul 17 06:12:59.123457 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:12:59.123363    2567 scope.go:117] "RemoveContainer" containerID="b40f9220458cd6e44b162f97136d313813f7ea8c79fa073105436227fd7ea014"
Jul 17 06:13:00.130140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:00.130052    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerID="101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a" exitCode=6
Jul 17 06:13:00.130533 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:00.130134    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerDied","Data":"101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a"}
Jul 17 06:13:00.130533 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:00.130203    2567 scope.go:117] "RemoveContainer" containerID="b40f9220458cd6e44b162f97136d313813f7ea8c79fa073105436227fd7ea014"
Jul 17 06:13:00.130533 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:00.130414    2567 scope.go:117] "RemoveContainer" containerID="101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a"
Jul 17 06:13:00.130667 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:00.130618    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4_odh-ai-gateway-infra(eb9f9465-8dd3-4184-8cef-f639cbda3e0b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b"
Jul 17 06:13:01.015357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:01.015328    2567 scope.go:117] "RemoveContainer" containerID="61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88"
Jul 17 06:13:01.136834 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:01.136811    2567 scope.go:117] "RemoveContainer" containerID="101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a"
Jul 17 06:13:01.137219 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:01.137013    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4_odh-ai-gateway-infra(eb9f9465-8dd3-4184-8cef-f639cbda3e0b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b"
Jul 17 06:13:02.143730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.143670    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerID="3cddf6e7fada01494d73d74000da244929f977e94598991b6df898a46d8b157b" exitCode=6
Jul 17 06:13:02.144227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.143746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" event={"ID":"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9","Type":"ContainerDied","Data":"3cddf6e7fada01494d73d74000da244929f977e94598991b6df898a46d8b157b"}
Jul 17 06:13:02.144227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.143810    2567 scope.go:117] "RemoveContainer" containerID="61e832bce14e64ed2c7ff5e21f763d67473ebdb682e72ff8daaf0bc279bd7b88"
Jul 17 06:13:02.144227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.144131    2567 scope.go:117] "RemoveContainer" containerID="3cddf6e7fada01494d73d74000da244929f977e94598991b6df898a46d8b157b"
Jul 17 06:13:02.144421 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:02.144396    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-wljvd_odh-ai-gateway-infra(3c975c93-c2e0-4198-adcf-b2cb3a1dbba9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9"
Jul 17 06:13:02.234949 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.234914    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:13:02.243885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:02.243862    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:13:03.168734 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:03.168695    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:13:03.315524 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:03.315499    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:13:03.347607 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:03.347582    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca\") pod \"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9\" (UID: \"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9\") "
Jul 17 06:13:03.347960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:03.347935    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" (UID: "3c975c93-c2e0-4198-adcf-b2cb3a1dbba9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:13:03.448478 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:03.448439    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:13:04.158479 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:04.158445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd" event={"ID":"3c975c93-c2e0-4198-adcf-b2cb3a1dbba9","Type":"ContainerDied","Data":"f02731ba1f941fec57def23014ac1dbe77054bd5053455402a0c1ef258e53240"}
Jul 17 06:13:04.158479 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:04.158472    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"
Jul 17 06:13:04.158750 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:04.158507    2567 scope.go:117] "RemoveContainer" containerID="3cddf6e7fada01494d73d74000da244929f977e94598991b6df898a46d8b157b"
Jul 17 06:13:04.174562 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:04.174535    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:13:04.182099 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:04.182056    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-wljvd"]
Jul 17 06:13:06.021091 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:06.021047    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" path="/var/lib/kubelet/pods/3c975c93-c2e0-4198-adcf-b2cb3a1dbba9/volumes"
Jul 17 06:13:09.014996 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:09.014964    2567 scope.go:117] "RemoveContainer" containerID="1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d"
Jul 17 06:13:10.193166 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.193130    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerID="54cdf7140e9a0ef90f6776567e83e270208ed5fe8091765c9c9149466580d099" exitCode=6
Jul 17 06:13:10.193616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.193200    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" event={"ID":"0b287d5b-1ba4-41a5-b92e-296321981aba","Type":"ContainerDied","Data":"54cdf7140e9a0ef90f6776567e83e270208ed5fe8091765c9c9149466580d099"}
Jul 17 06:13:10.193616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.193313    2567 scope.go:117] "RemoveContainer" containerID="1333b70564c7fa1a28e93fcbb4b003333e04e5bc50c1e1671e7b7fafdd19be1d"
Jul 17 06:13:10.193616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.193610    2567 scope.go:117] "RemoveContainer" containerID="54cdf7140e9a0ef90f6776567e83e270208ed5fe8091765c9c9149466580d099"
Jul 17 06:13:10.193907 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:10.193886    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j_odh-ai-gateway-infra(0b287d5b-1ba4-41a5-b92e-296321981aba)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba"
Jul 17 06:13:10.559500 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559420    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:10.559830 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559816    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.559882 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559831    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.559882 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559844    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.559882 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559850    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.559973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559919    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.559973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.559927    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:10.564066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.564048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:10.569903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.569873    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:10.598185 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.598154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-b7g5v\" (UID: \"18d3f55a-469f-4bd4-ab99-35d934f46022\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:10.698981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.698941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-b7g5v\" (UID: \"18d3f55a-469f-4bd4-ab99-35d934f46022\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:10.699590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.699562    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-b7g5v\" (UID: \"18d3f55a-469f-4bd4-ab99-35d934f46022\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:10.875576 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:10.875489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:11.008428 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.008396    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:11.011466 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:13:11.011434    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d3f55a_469f_4bd4_ab99_35d934f46022.slice/crio-0cf834dc07dbbb825206fd2e790c8038e52597f7dea46a348c9b9316ad87fe65 WatchSource:0}: Error finding container 0cf834dc07dbbb825206fd2e790c8038e52597f7dea46a348c9b9316ad87fe65: Status 404 returned error can't find the container with id 0cf834dc07dbbb825206fd2e790c8038e52597f7dea46a348c9b9316ad87fe65
Jul 17 06:13:11.200804 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.200771    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerStarted","Data":"0cf834dc07dbbb825206fd2e790c8038e52597f7dea46a348c9b9316ad87fe65"}
Jul 17 06:13:11.218553 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.218526    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:13:11.346163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.346140    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:13:11.403953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.403925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca\") pod \"0b287d5b-1ba4-41a5-b92e-296321981aba\" (UID: \"0b287d5b-1ba4-41a5-b92e-296321981aba\") "
Jul 17 06:13:11.404315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.404293    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b287d5b-1ba4-41a5-b92e-296321981aba" (UID: "0b287d5b-1ba4-41a5-b92e-296321981aba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:13:11.504972 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:11.504935    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b287d5b-1ba4-41a5-b92e-296321981aba-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:13:12.209292 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.209256    2567 generic.go:356] "Generic (PLEG): container finished" podID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerID="d7499a0e40ea1916c9d95aa2c478372258ce597c9e73e2197b7de833134ac097" exitCode=6
Jul 17 06:13:12.209790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.209348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerDied","Data":"d7499a0e40ea1916c9d95aa2c478372258ce597c9e73e2197b7de833134ac097"}
Jul 17 06:13:12.209790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.209530    2567 scope.go:117] "RemoveContainer" containerID="d7499a0e40ea1916c9d95aa2c478372258ce597c9e73e2197b7de833134ac097"
Jul 17 06:13:12.210749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.210733    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"
Jul 17 06:13:12.210836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.210764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j" event={"ID":"0b287d5b-1ba4-41a5-b92e-296321981aba","Type":"ContainerDied","Data":"983649bd82e188af885da2bf91e61d6ef7539a564784cc22114b3b7328dc370b"}
Jul 17 06:13:12.210836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.210811    2567 scope.go:117] "RemoveContainer" containerID="54cdf7140e9a0ef90f6776567e83e270208ed5fe8091765c9c9149466580d099"
Jul 17 06:13:12.238011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.237986    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:13:12.239969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:12.239950    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-8kc2j"]
Jul 17 06:13:13.015416 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.015386    2567 scope.go:117] "RemoveContainer" containerID="101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a"
Jul 17 06:13:13.217893 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.217862    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerStarted","Data":"a51d3834f6d08c3fd6b1890cdcfd250a0f55f89b55a446f1e414f787e3e9fe0a"}
Jul 17 06:13:13.219540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.219517    2567 generic.go:356] "Generic (PLEG): container finished" podID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerID="0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f" exitCode=6
Jul 17 06:13:13.219656 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.219599    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerDied","Data":"0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f"}
Jul 17 06:13:13.219755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.219658    2567 scope.go:117] "RemoveContainer" containerID="d7499a0e40ea1916c9d95aa2c478372258ce597c9e73e2197b7de833134ac097"
Jul 17 06:13:13.219807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.219757    2567 scope.go:117] "RemoveContainer" containerID="0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f"
Jul 17 06:13:13.219957 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:13.219936    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-b7g5v_odh-ai-gateway-infra(18d3f55a-469f-4bd4-ab99-35d934f46022)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022"
Jul 17 06:13:13.232081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:13.232037    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" podStartSLOduration=16.232020396 podStartE2EDuration="16.232020396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:13:13.23145243 +0000 UTC m=+2411.694636534" watchObservedRunningTime="2026-07-17 06:13:13.232020396 +0000 UTC m=+2411.695204494"
Jul 17 06:13:14.021298 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.021261    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" path="/var/lib/kubelet/pods/0b287d5b-1ba4-41a5-b92e-296321981aba/volumes"
Jul 17 06:13:14.235185 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.235153    2567 scope.go:117] "RemoveContainer" containerID="0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f"
Jul 17 06:13:14.235702 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:14.235365    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-b7g5v_odh-ai-gateway-infra(18d3f55a-469f-4bd4-ab99-35d934f46022)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022"
Jul 17 06:13:14.236908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.236886    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerID="a51d3834f6d08c3fd6b1890cdcfd250a0f55f89b55a446f1e414f787e3e9fe0a" exitCode=6
Jul 17 06:13:14.236987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.236960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerDied","Data":"a51d3834f6d08c3fd6b1890cdcfd250a0f55f89b55a446f1e414f787e3e9fe0a"}
Jul 17 06:13:14.237045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.237034    2567 scope.go:117] "RemoveContainer" containerID="101c0f1d6d9b25683ac93c91a01a915c360347b993854af8724bba880eabe19a"
Jul 17 06:13:14.237270 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.237253    2567 scope.go:117] "RemoveContainer" containerID="a51d3834f6d08c3fd6b1890cdcfd250a0f55f89b55a446f1e414f787e3e9fe0a"
Jul 17 06:13:14.237496 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:14.237473    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4_odh-ai-gateway-infra(eb9f9465-8dd3-4184-8cef-f639cbda3e0b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b"
Jul 17 06:13:14.243205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:14.243180    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:13:15.380917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:15.380891    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:13:15.434103 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:15.434068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca\") pod \"eb9f9465-8dd3-4184-8cef-f639cbda3e0b\" (UID: \"eb9f9465-8dd3-4184-8cef-f639cbda3e0b\") "
Jul 17 06:13:15.434459 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:15.434430    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb9f9465-8dd3-4184-8cef-f639cbda3e0b" (UID: "eb9f9465-8dd3-4184-8cef-f639cbda3e0b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:13:15.535760 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:15.535641    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f9465-8dd3-4184-8cef-f639cbda3e0b-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:13:16.251643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:16.251614    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"
Jul 17 06:13:16.251817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:16.251659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4" event={"ID":"eb9f9465-8dd3-4184-8cef-f639cbda3e0b","Type":"ContainerDied","Data":"3c4b634bdb1333c70edbc617d2e54d4978ed340aa1dbb943c62a7338b1422283"}
Jul 17 06:13:16.251817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:16.251732    2567 scope.go:117] "RemoveContainer" containerID="a51d3834f6d08c3fd6b1890cdcfd250a0f55f89b55a446f1e414f787e3e9fe0a"
Jul 17 06:13:16.269280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:16.269253    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:13:16.274748 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:16.274725    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zgvj4"]
Jul 17 06:13:18.021286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:18.021250    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" path="/var/lib/kubelet/pods/eb9f9465-8dd3-4184-8cef-f639cbda3e0b/volumes"
Jul 17 06:13:28.015100 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:28.015062    2567 scope.go:117] "RemoveContainer" containerID="0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f"
Jul 17 06:13:28.320755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:28.320708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerStarted","Data":"baffb12080b6d04a9228ca0fa4c81298912806ab26607e0f8f721c4b1549a7f0"}
Jul 17 06:13:28.338741 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:28.338672    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" podStartSLOduration=18.338656761 podStartE2EDuration="18.338656761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:13:28.336781982 +0000 UTC m=+2426.799966085" watchObservedRunningTime="2026-07-17 06:13:28.338656761 +0000 UTC m=+2426.801840865"
Jul 17 06:13:29.327340 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:29.327304    2567 generic.go:356] "Generic (PLEG): container finished" podID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerID="baffb12080b6d04a9228ca0fa4c81298912806ab26607e0f8f721c4b1549a7f0" exitCode=6
Jul 17 06:13:29.327780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:29.327374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerDied","Data":"baffb12080b6d04a9228ca0fa4c81298912806ab26607e0f8f721c4b1549a7f0"}
Jul 17 06:13:29.327780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:29.327433    2567 scope.go:117] "RemoveContainer" containerID="0ee0962e676471b22476993684b134406a0c25d03ba6905b75f17a6738f2bc0f"
Jul 17 06:13:29.327780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:29.327659    2567 scope.go:117] "RemoveContainer" containerID="baffb12080b6d04a9228ca0fa4c81298912806ab26607e0f8f721c4b1549a7f0"
Jul 17 06:13:29.327993 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:29.327896    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-b7g5v_odh-ai-gateway-infra(18d3f55a-469f-4bd4-ab99-35d934f46022)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022"
Jul 17 06:13:29.352550 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:29.352525    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:30.469307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:30.469275    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:30.573907 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:30.573859    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca\") pod \"18d3f55a-469f-4bd4-ab99-35d934f46022\" (UID: \"18d3f55a-469f-4bd4-ab99-35d934f46022\") "
Jul 17 06:13:30.574280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:30.574259    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18d3f55a-469f-4bd4-ab99-35d934f46022" (UID: "18d3f55a-469f-4bd4-ab99-35d934f46022"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:13:30.675039 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:30.674947    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18d3f55a-469f-4bd4-ab99-35d934f46022-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:13:31.341233 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:31.341203    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"
Jul 17 06:13:31.341233 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:31.341223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v" event={"ID":"18d3f55a-469f-4bd4-ab99-35d934f46022","Type":"ContainerDied","Data":"0cf834dc07dbbb825206fd2e790c8038e52597f7dea46a348c9b9316ad87fe65"}
Jul 17 06:13:31.341490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:31.341291    2567 scope.go:117] "RemoveContainer" containerID="baffb12080b6d04a9228ca0fa4c81298912806ab26607e0f8f721c4b1549a7f0"
Jul 17 06:13:31.363337 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:31.363311    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:31.369008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:31.368986    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-b7g5v"]
Jul 17 06:13:32.021893 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:32.021860    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" path="/var/lib/kubelet/pods/18d3f55a-469f-4bd4-ab99-35d934f46022/volumes"
Jul 17 06:13:42.291477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.291436    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:13:42.292015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.291965    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.291984    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292001    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292009    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292018    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292026    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292035    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292042    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292052    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292061    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292083    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292091    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292104    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292114    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292133    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292141    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292234    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292246    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292255    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292264    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292272    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c975c93-c2e0-4198-adcf-b2cb3a1dbba9" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292280    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292292    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.292293 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.292300    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:42.295583 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.295561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:13:42.300875 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.300855    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:13:42.301016 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.300995    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:13:42.328982 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.328954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:13:42.377609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.377559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd\" (UID: \"9d7446ba-9b4d-440e-a4db-6367a32d6fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:13:42.479108 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.479074    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd\" (UID: \"9d7446ba-9b4d-440e-a4db-6367a32d6fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:13:42.479740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.479717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd\" (UID: \"9d7446ba-9b4d-440e-a4db-6367a32d6fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:13:42.605857 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.605768    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:13:42.740736 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:42.740712    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:13:42.742372 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:13:42.742349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7446ba_9b4d_440e_a4db_6367a32d6fed.slice/crio-a800a227e9321f292b55cafd2863d793604e1797077750781002369a36323262 WatchSource:0}: Error finding container a800a227e9321f292b55cafd2863d793604e1797077750781002369a36323262: Status 404 returned error can't find the container with id a800a227e9321f292b55cafd2863d793604e1797077750781002369a36323262
Jul 17 06:13:43.408898 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.408856    2567 generic.go:356] "Generic (PLEG): container finished" podID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerID="95d64e1125d380e891c7c8597425c205bf415eba8c49267fdcf81529fa5f94c5" exitCode=6
Jul 17 06:13:43.409260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.408933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerDied","Data":"95d64e1125d380e891c7c8597425c205bf415eba8c49267fdcf81529fa5f94c5"}
Jul 17 06:13:43.409260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.408990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerStarted","Data":"a800a227e9321f292b55cafd2863d793604e1797077750781002369a36323262"}
Jul 17 06:13:43.409260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.409100    2567 scope.go:117] "RemoveContainer" containerID="95d64e1125d380e891c7c8597425c205bf415eba8c49267fdcf81529fa5f94c5"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.918260    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919117    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919138    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919171    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919182    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3f55a-469f-4bd4-ab99-35d934f46022" containerName="revoke-keys"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919401    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b287d5b-1ba4-41a5-b92e-296321981aba" containerName="revoke-keys"
Jul 17 06:13:43.921155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.919422    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f9465-8dd3-4184-8cef-f639cbda3e0b" containerName="revoke-keys"
Jul 17 06:13:43.923411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.923385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:13:43.933176 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:43.933152    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:13:44.001473 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.001435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8\" (UID: \"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:13:44.102925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.102890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8\" (UID: \"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:13:44.103530 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.103508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8\" (UID: \"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:13:44.236522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.236488    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:13:44.369032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.369009    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:13:44.370858 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:13:44.370827    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ade6dd2_c4e6_4f3f_aa05_d9bf22eacd0a.slice/crio-3b137a645560f85fcfb13e327317e776b76611bf0b6f1d0b8c64b5d90dc0c8a7 WatchSource:0}: Error finding container 3b137a645560f85fcfb13e327317e776b76611bf0b6f1d0b8c64b5d90dc0c8a7: Status 404 returned error can't find the container with id 3b137a645560f85fcfb13e327317e776b76611bf0b6f1d0b8c64b5d90dc0c8a7
Jul 17 06:13:44.415743 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.415707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerStarted","Data":"3b137a645560f85fcfb13e327317e776b76611bf0b6f1d0b8c64b5d90dc0c8a7"}
Jul 17 06:13:44.417479 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.417453    2567 generic.go:356] "Generic (PLEG): container finished" podID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerID="eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746" exitCode=6
Jul 17 06:13:44.417608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.417517    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerDied","Data":"eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746"}
Jul 17 06:13:44.417608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.417577    2567 scope.go:117] "RemoveContainer" containerID="95d64e1125d380e891c7c8597425c205bf415eba8c49267fdcf81529fa5f94c5"
Jul 17 06:13:44.417846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:44.417832    2567 scope.go:117] "RemoveContainer" containerID="eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746"
Jul 17 06:13:44.418063 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:44.418042    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd_odh-ai-gateway-infra(9d7446ba-9b4d-440e-a4db-6367a32d6fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed"
Jul 17 06:13:45.424477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:45.424388    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerID="7c76e8b7300c6374f862da519be77e370b9fba6fde88e0718af41519777b52ff" exitCode=6
Jul 17 06:13:45.424923 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:45.424490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerDied","Data":"7c76e8b7300c6374f862da519be77e370b9fba6fde88e0718af41519777b52ff"}
Jul 17 06:13:45.424923 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:45.424633    2567 scope.go:117] "RemoveContainer" containerID="7c76e8b7300c6374f862da519be77e370b9fba6fde88e0718af41519777b52ff"
Jul 17 06:13:45.426278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:45.426262    2567 scope.go:117] "RemoveContainer" containerID="eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746"
Jul 17 06:13:45.426434 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:45.426418    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd_odh-ai-gateway-infra(9d7446ba-9b4d-440e-a4db-6367a32d6fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed"
Jul 17 06:13:46.432927 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:46.432829    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerID="0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e" exitCode=6
Jul 17 06:13:46.433339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:46.432919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerDied","Data":"0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e"}
Jul 17 06:13:46.433339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:46.432989    2567 scope.go:117] "RemoveContainer" containerID="7c76e8b7300c6374f862da519be77e370b9fba6fde88e0718af41519777b52ff"
Jul 17 06:13:46.433339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:46.433174    2567 scope.go:117] "RemoveContainer" containerID="0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e"
Jul 17 06:13:46.433501 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:46.433391    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8_odh-ai-gateway-infra(0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a"
Jul 17 06:13:47.439946 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:47.439920    2567 scope.go:117] "RemoveContainer" containerID="0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e"
Jul 17 06:13:47.440400 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:47.440163    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8_odh-ai-gateway-infra(0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a"
Jul 17 06:13:47.885960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:47.885922    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:13:47.891312 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:47.891197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:13:47.894604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:47.894570    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:13:48.036924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.036885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs\" (UID: \"59efaa38-3ae7-40cb-a19a-446172d3d25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:13:48.138282 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.138183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs\" (UID: \"59efaa38-3ae7-40cb-a19a-446172d3d25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:13:48.138896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.138878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs\" (UID: \"59efaa38-3ae7-40cb-a19a-446172d3d25c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:13:48.203360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.203328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:13:48.341789 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.341008    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:13:48.446305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:48.446270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerStarted","Data":"df8e016dd95e12ed638624a431647d624bc55b6feeda9925e2ff5de60dcc80b2"}
Jul 17 06:13:49.453901 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:49.453864    2567 generic.go:356] "Generic (PLEG): container finished" podID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerID="9f0446a7866634fc529e8f700a960126f0081482b914e1bcde484621e2ee5e8d" exitCode=6
Jul 17 06:13:49.454332 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:49.453953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerDied","Data":"9f0446a7866634fc529e8f700a960126f0081482b914e1bcde484621e2ee5e8d"}
Jul 17 06:13:49.454332 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:49.454113    2567 scope.go:117] "RemoveContainer" containerID="9f0446a7866634fc529e8f700a960126f0081482b914e1bcde484621e2ee5e8d"
Jul 17 06:13:50.461052 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:50.461023    2567 generic.go:356] "Generic (PLEG): container finished" podID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerID="f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e" exitCode=6
Jul 17 06:13:50.461447 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:50.461079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerDied","Data":"f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e"}
Jul 17 06:13:50.461447 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:50.461126    2567 scope.go:117] "RemoveContainer" containerID="9f0446a7866634fc529e8f700a960126f0081482b914e1bcde484621e2ee5e8d"
Jul 17 06:13:50.461447 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:50.461303    2567 scope.go:117] "RemoveContainer" containerID="f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e"
Jul 17 06:13:50.461589 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:50.461530    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs_odh-ai-gateway-infra(59efaa38-3ae7-40cb-a19a-446172d3d25c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c"
Jul 17 06:13:51.468231 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:13:51.468207    2567 scope.go:117] "RemoveContainer" containerID="f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e"
Jul 17 06:13:51.468590 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:13:51.468386    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs_odh-ai-gateway-infra(59efaa38-3ae7-40cb-a19a-446172d3d25c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c"
Jul 17 06:14:00.015487 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:00.015455    2567 scope.go:117] "RemoveContainer" containerID="eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746"
Jul 17 06:14:00.518667 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:00.518629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerStarted","Data":"9c328bcb71be4f429e43d46b678dcaf29d2372d80f91ad7e11be838dcc811780"}
Jul 17 06:14:00.542708 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:00.542641    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" podStartSLOduration=18.542625402 podStartE2EDuration="18.542625402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:00.540169909 +0000 UTC m=+2459.003354013" watchObservedRunningTime="2026-07-17 06:14:00.542625402 +0000 UTC m=+2459.005809505"
Jul 17 06:14:01.526081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:01.526045    2567 generic.go:356] "Generic (PLEG): container finished" podID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerID="9c328bcb71be4f429e43d46b678dcaf29d2372d80f91ad7e11be838dcc811780" exitCode=6
Jul 17 06:14:01.526514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:01.526122    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerDied","Data":"9c328bcb71be4f429e43d46b678dcaf29d2372d80f91ad7e11be838dcc811780"}
Jul 17 06:14:01.526514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:01.526185    2567 scope.go:117] "RemoveContainer" containerID="eefcb2235c9c41ffcb39c404af82392c9098a1a40e6c1b55e87215737588d746"
Jul 17 06:14:01.526514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:01.526468    2567 scope.go:117] "RemoveContainer" containerID="9c328bcb71be4f429e43d46b678dcaf29d2372d80f91ad7e11be838dcc811780"
Jul 17 06:14:01.526775 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:01.526752    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd_odh-ai-gateway-infra(9d7446ba-9b4d-440e-a4db-6367a32d6fed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed"
Jul 17 06:14:01.557155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:01.557128    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:14:02.018104 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.018033    2567 scope.go:117] "RemoveContainer" containerID="0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e"
Jul 17 06:14:02.533658 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.533577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerStarted","Data":"72aa996d21a26f7722d6a9e9713bc1bcd6541e4f7dad15bef1b2532253b1e254"}
Jul 17 06:14:02.549405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.549355    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" podStartSLOduration=19.549338704 podStartE2EDuration="19.549338704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:02.547954651 +0000 UTC m=+2461.011138757" watchObservedRunningTime="2026-07-17 06:14:02.549338704 +0000 UTC m=+2461.012522854"
Jul 17 06:14:02.671435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.671394    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:14:02.776717 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.776648    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca\") pod \"9d7446ba-9b4d-440e-a4db-6367a32d6fed\" (UID: \"9d7446ba-9b4d-440e-a4db-6367a32d6fed\") "
Jul 17 06:14:02.777022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.776999    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d7446ba-9b4d-440e-a4db-6367a32d6fed" (UID: "9d7446ba-9b4d-440e-a4db-6367a32d6fed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:02.877337 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:02.877247    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7446ba-9b4d-440e-a4db-6367a32d6fed-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:03.015439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.015410    2567 scope.go:117] "RemoveContainer" containerID="f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e"
Jul 17 06:14:03.036364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.036334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:14:03.542833 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.542798    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerID="72aa996d21a26f7722d6a9e9713bc1bcd6541e4f7dad15bef1b2532253b1e254" exitCode=6
Jul 17 06:14:03.543288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.542867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerDied","Data":"72aa996d21a26f7722d6a9e9713bc1bcd6541e4f7dad15bef1b2532253b1e254"}
Jul 17 06:14:03.543288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.542925    2567 scope.go:117] "RemoveContainer" containerID="0e233aac3e64d2cfaef5de911d392a88a9962226279da00695a8c0dc9b66698e"
Jul 17 06:14:03.543288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.543256    2567 scope.go:117] "RemoveContainer" containerID="72aa996d21a26f7722d6a9e9713bc1bcd6541e4f7dad15bef1b2532253b1e254"
Jul 17 06:14:03.543514 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:03.543494    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8_odh-ai-gateway-infra(0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a"
Jul 17 06:14:03.544468 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.544452    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"
Jul 17 06:14:03.544533 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.544493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd" event={"ID":"9d7446ba-9b4d-440e-a4db-6367a32d6fed","Type":"ContainerDied","Data":"a800a227e9321f292b55cafd2863d793604e1797077750781002369a36323262"}
Jul 17 06:14:03.546338 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.546318    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerStarted","Data":"20b9ce90b2675668fe778c7b258f3f04e2855305b52ce8844e15c68bd1d5664f"}
Jul 17 06:14:03.555181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.555155    2567 scope.go:117] "RemoveContainer" containerID="9c328bcb71be4f429e43d46b678dcaf29d2372d80f91ad7e11be838dcc811780"
Jul 17 06:14:03.560835 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.560810    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:14:03.584921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.584855    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:14:03.590735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.590709    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-vm9jd"]
Jul 17 06:14:03.603586 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:03.603541    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" podStartSLOduration=16.603525472 podStartE2EDuration="16.603525472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:03.602356653 +0000 UTC m=+2462.065540758" watchObservedRunningTime="2026-07-17 06:14:03.603525472 +0000 UTC m=+2462.066709577"
Jul 17 06:14:04.021145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.021112    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" path="/var/lib/kubelet/pods/9d7446ba-9b4d-440e-a4db-6367a32d6fed/volumes"
Jul 17 06:14:04.554027 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.553996    2567 generic.go:356] "Generic (PLEG): container finished" podID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerID="20b9ce90b2675668fe778c7b258f3f04e2855305b52ce8844e15c68bd1d5664f" exitCode=6
Jul 17 06:14:04.554445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.554067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerDied","Data":"20b9ce90b2675668fe778c7b258f3f04e2855305b52ce8844e15c68bd1d5664f"}
Jul 17 06:14:04.554445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.554126    2567 scope.go:117] "RemoveContainer" containerID="f788ee9e1563a577bead4491b5aa57866a971e9d36bd2f2b22ee4a3e20f53e0e"
Jul 17 06:14:04.554445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.554432    2567 scope.go:117] "RemoveContainer" containerID="20b9ce90b2675668fe778c7b258f3f04e2855305b52ce8844e15c68bd1d5664f"
Jul 17 06:14:04.554730 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:04.554710    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs_odh-ai-gateway-infra(59efaa38-3ae7-40cb-a19a-446172d3d25c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c"
Jul 17 06:14:04.613429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.613396    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:14:04.699118 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.699092    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:14:04.795566 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.795519    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca\") pod \"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a\" (UID: \"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a\") "
Jul 17 06:14:04.795900 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.795875    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" (UID: "0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:04.897175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:04.897084    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:05.563504 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.563474    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"
Jul 17 06:14:05.564019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.563506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8" event={"ID":"0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a","Type":"ContainerDied","Data":"3b137a645560f85fcfb13e327317e776b76611bf0b6f1d0b8c64b5d90dc0c8a7"}
Jul 17 06:14:05.564019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.563576    2567 scope.go:117] "RemoveContainer" containerID="72aa996d21a26f7722d6a9e9713bc1bcd6541e4f7dad15bef1b2532253b1e254"
Jul 17 06:14:05.600244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.600203    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:14:05.604991 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.604960    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-vbmb8"]
Jul 17 06:14:05.729110 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.729083    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:14:05.804790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.804754    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca\") pod \"59efaa38-3ae7-40cb-a19a-446172d3d25c\" (UID: \"59efaa38-3ae7-40cb-a19a-446172d3d25c\") "
Jul 17 06:14:05.805155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.805130    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59efaa38-3ae7-40cb-a19a-446172d3d25c" (UID: "59efaa38-3ae7-40cb-a19a-446172d3d25c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:05.905467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:05.905387    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59efaa38-3ae7-40cb-a19a-446172d3d25c-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:06.022654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.022613    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" path="/var/lib/kubelet/pods/0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a/volumes"
Jul 17 06:14:06.571847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.571816    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"
Jul 17 06:14:06.572314 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.571860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs" event={"ID":"59efaa38-3ae7-40cb-a19a-446172d3d25c","Type":"ContainerDied","Data":"df8e016dd95e12ed638624a431647d624bc55b6feeda9925e2ff5de60dcc80b2"}
Jul 17 06:14:06.572314 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.571917    2567 scope.go:117] "RemoveContainer" containerID="20b9ce90b2675668fe778c7b258f3f04e2855305b52ce8844e15c68bd1d5664f"
Jul 17 06:14:06.589672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.589645    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:14:06.591807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:06.591785    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-bkpvs"]
Jul 17 06:14:08.021189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:08.021158    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" path="/var/lib/kubelet/pods/59efaa38-3ae7-40cb-a19a-446172d3d25c/volumes"
Jul 17 06:14:10.603870 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.603836    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604175    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604186    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604201    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604206    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604214    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604219    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604226    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604232    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604240    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604245    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604260    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604265    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604276    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604280    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604329    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604336    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604342    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604347    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604352    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:10.604556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.604360    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:10.607461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.607445    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:10.609899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.609879    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:14:10.610008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.609924    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:14:10.613957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.613927    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:10.748333 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.748294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ppczx\" (UID: \"4750c436-a07b-4998-ab7e-92f3a52f2af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:10.849171 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.849136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ppczx\" (UID: \"4750c436-a07b-4998-ab7e-92f3a52f2af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:10.849795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.849773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ppczx\" (UID: \"4750c436-a07b-4998-ab7e-92f3a52f2af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:10.919493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:10.919394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:11.258489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:11.258463    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:11.260490 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:14:11.260464    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4750c436_a07b_4998_ab7e_92f3a52f2af4.slice/crio-895bf8e1f4eb7c439bbedd8fcf45ac93e9e6cd3ac45654daf2ea8b4256c51353 WatchSource:0}: Error finding container 895bf8e1f4eb7c439bbedd8fcf45ac93e9e6cd3ac45654daf2ea8b4256c51353: Status 404 returned error can't find the container with id 895bf8e1f4eb7c439bbedd8fcf45ac93e9e6cd3ac45654daf2ea8b4256c51353
Jul 17 06:14:11.602186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:11.602155    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerStarted","Data":"34fd99e6733c17d256b1fab699e68a4927a6a751f248082579b9e15ddf77bf96"}
Jul 17 06:14:11.602329 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:11.602209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerStarted","Data":"895bf8e1f4eb7c439bbedd8fcf45ac93e9e6cd3ac45654daf2ea8b4256c51353"}
Jul 17 06:14:11.617206 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:11.617160    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" podStartSLOduration=1.6171464169999998 podStartE2EDuration="1.617146417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:11.615711217 +0000 UTC m=+2470.078895324" watchObservedRunningTime="2026-07-17 06:14:11.617146417 +0000 UTC m=+2470.080330522"
Jul 17 06:14:12.418176 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:12.418134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:14:12.609620 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:12.609581    2567 generic.go:356] "Generic (PLEG): container finished" podID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerID="34fd99e6733c17d256b1fab699e68a4927a6a751f248082579b9e15ddf77bf96" exitCode=6
Jul 17 06:14:12.609831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:12.609675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerDied","Data":"34fd99e6733c17d256b1fab699e68a4927a6a751f248082579b9e15ddf77bf96"}
Jul 17 06:14:12.609888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:12.609871    2567 scope.go:117] "RemoveContainer" containerID="34fd99e6733c17d256b1fab699e68a4927a6a751f248082579b9e15ddf77bf96"
Jul 17 06:14:13.618280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:13.618241    2567 generic.go:356] "Generic (PLEG): container finished" podID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerID="f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371" exitCode=6
Jul 17 06:14:13.618749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:13.618312    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerDied","Data":"f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371"}
Jul 17 06:14:13.618749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:13.618372    2567 scope.go:117] "RemoveContainer" containerID="34fd99e6733c17d256b1fab699e68a4927a6a751f248082579b9e15ddf77bf96"
Jul 17 06:14:13.618749 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:13.618593    2567 scope.go:117] "RemoveContainer" containerID="f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371"
Jul 17 06:14:13.618882 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:13.618852    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ppczx_odh-ai-gateway-infra(4750c436-a07b-4998-ab7e-92f3a52f2af4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4"
Jul 17 06:14:14.625169 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:14.625137    2567 scope.go:117] "RemoveContainer" containerID="f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371"
Jul 17 06:14:14.625582 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:14.625349    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ppczx_odh-ai-gateway-infra(4750c436-a07b-4998-ab7e-92f3a52f2af4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4"
Jul 17 06:14:23.620062 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:23.620027    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:14:27.015538 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:27.015503    2567 scope.go:117] "RemoveContainer" containerID="f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371"
Jul 17 06:14:27.699595 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:27.699560    2567 generic.go:356] "Generic (PLEG): container finished" podID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerID="61cd89f1208835682c73c19b6e01aef71e7a9a17d2ffeea3c6de8bf225223738" exitCode=6
Jul 17 06:14:27.699790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:27.699633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerDied","Data":"61cd89f1208835682c73c19b6e01aef71e7a9a17d2ffeea3c6de8bf225223738"}
Jul 17 06:14:27.699790 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:27.699737    2567 scope.go:117] "RemoveContainer" containerID="f989c99eb7f9f2b6c85a5967315868b894abd5aab5537702d54a68d81913a371"
Jul 17 06:14:27.700067 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:27.700043    2567 scope.go:117] "RemoveContainer" containerID="61cd89f1208835682c73c19b6e01aef71e7a9a17d2ffeea3c6de8bf225223738"
Jul 17 06:14:27.700228 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:27.700210    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ppczx_odh-ai-gateway-infra(4750c436-a07b-4998-ab7e-92f3a52f2af4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4"
Jul 17 06:14:28.723417 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:28.723378    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:28.863201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:28.863173    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:29.008933 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.008835    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca\") pod \"4750c436-a07b-4998-ab7e-92f3a52f2af4\" (UID: \"4750c436-a07b-4998-ab7e-92f3a52f2af4\") "
Jul 17 06:14:29.009202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.009178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4750c436-a07b-4998-ab7e-92f3a52f2af4" (UID: "4750c436-a07b-4998-ab7e-92f3a52f2af4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:29.109477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.109439    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4750c436-a07b-4998-ab7e-92f3a52f2af4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:29.713268 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.713236    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"
Jul 17 06:14:29.713448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.713234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx" event={"ID":"4750c436-a07b-4998-ab7e-92f3a52f2af4","Type":"ContainerDied","Data":"895bf8e1f4eb7c439bbedd8fcf45ac93e9e6cd3ac45654daf2ea8b4256c51353"}
Jul 17 06:14:29.713448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.713389    2567 scope.go:117] "RemoveContainer" containerID="61cd89f1208835682c73c19b6e01aef71e7a9a17d2ffeea3c6de8bf225223738"
Jul 17 06:14:29.734842 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.734821    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:29.742334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:29.742312    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ppczx"]
Jul 17 06:14:30.021186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.021105    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" path="/var/lib/kubelet/pods/4750c436-a07b-4998-ab7e-92f3a52f2af4/volumes"
Jul 17 06:14:30.332203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332115    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"]
Jul 17 06:14:30.332550 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332532    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332554    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332581    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332590    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332601    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332610    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332637    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332645    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332654    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332662    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332772    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332783    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ade6dd2-c4e6-4f3f-aa05-d9bf22eacd0a" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332796    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332805    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7446ba-9b4d-440e-a4db-6367a32d6fed" containerName="revoke-keys"
Jul 17 06:14:30.332987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.332815    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59efaa38-3ae7-40cb-a19a-446172d3d25c" containerName="revoke-keys"
Jul 17 06:14:30.336129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.336107    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:30.338700 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.338667    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:14:30.338804 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.338745    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:14:30.343746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.343725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"]
Jul 17 06:14:30.420541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.420506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67214823-4jqjs\" (UID: \"b2e5a613-eaca-4f4a-9f88-c8905fa94205\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:30.521230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.521196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67214823-4jqjs\" (UID: \"b2e5a613-eaca-4f4a-9f88-c8905fa94205\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:30.521839 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.521819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67214823-4jqjs\" (UID: \"b2e5a613-eaca-4f4a-9f88-c8905fa94205\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:30.648494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.648403    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:30.789957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:30.789912    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"]
Jul 17 06:14:30.792428 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:14:30.792400    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e5a613_eaca_4f4a_9f88_c8905fa94205.slice/crio-cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce WatchSource:0}: Error finding container cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce: Status 404 returned error can't find the container with id cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce
Jul 17 06:14:31.727489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:31.727408    2567 generic.go:356] "Generic (PLEG): container finished" podID="b2e5a613-eaca-4f4a-9f88-c8905fa94205" containerID="2fcd1b8f51637e1d2c15f0826b5e2a692ea3e692924c0da16ca54c64aba86081" exitCode=0
Jul 17 06:14:31.727489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:31.727462    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs" event={"ID":"b2e5a613-eaca-4f4a-9f88-c8905fa94205","Type":"ContainerDied","Data":"2fcd1b8f51637e1d2c15f0826b5e2a692ea3e692924c0da16ca54c64aba86081"}
Jul 17 06:14:31.727669 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:31.727505    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs" event={"ID":"b2e5a613-eaca-4f4a-9f88-c8905fa94205","Type":"ContainerStarted","Data":"cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce"}
Jul 17 06:14:32.870228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:32.870200    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:33.044392 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.044297    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca\") pod \"b2e5a613-eaca-4f4a-9f88-c8905fa94205\" (UID: \"b2e5a613-eaca-4f4a-9f88-c8905fa94205\") "
Jul 17 06:14:33.044633 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.044610    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2e5a613-eaca-4f4a-9f88-c8905fa94205" (UID: "b2e5a613-eaca-4f4a-9f88-c8905fa94205"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:33.145334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.145298    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e5a613-eaca-4f4a-9f88-c8905fa94205-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:33.739265 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.739227    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs"
Jul 17 06:14:33.739445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.739227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67214823-4jqjs" event={"ID":"b2e5a613-eaca-4f4a-9f88-c8905fa94205","Type":"ContainerDied","Data":"cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce"}
Jul 17 06:14:33.739445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:33.739362    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf4c2ddb95bca78d4842a4384470a84b2030a59efab963af38f2048c407340ce"
Jul 17 06:14:37.927767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.927730    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:37.928197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.928120    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e5a613-eaca-4f4a-9f88-c8905fa94205" containerName="revoke-keys"
Jul 17 06:14:37.928197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.928132    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e5a613-eaca-4f4a-9f88-c8905fa94205" containerName="revoke-keys"
Jul 17 06:14:37.928271 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.928201    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e5a613-eaca-4f4a-9f88-c8905fa94205" containerName="revoke-keys"
Jul 17 06:14:37.928271 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.928215    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4750c436-a07b-4998-ab7e-92f3a52f2af4" containerName="revoke-keys"
Jul 17 06:14:37.931147 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.931129    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:37.933721 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.933696    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:14:37.933864 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.933762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:14:37.938390 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.938356    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:37.989098 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:37.989058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs\" (UID: \"54ee3783-8c7d-4581-a1f7-c4c260c67148\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:38.089765 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.089727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs\" (UID: \"54ee3783-8c7d-4581-a1f7-c4c260c67148\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:38.090389 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.090370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs\" (UID: \"54ee3783-8c7d-4581-a1f7-c4c260c67148\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:38.243036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.243002    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:38.371694 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.371652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:38.374531 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:14:38.374503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ee3783_8c7d_4581_a1f7_c4c260c67148.slice/crio-5852edad26556625617ba6306c5c157b87f9230927533fc470b2551f753276c7 WatchSource:0}: Error finding container 5852edad26556625617ba6306c5c157b87f9230927533fc470b2551f753276c7: Status 404 returned error can't find the container with id 5852edad26556625617ba6306c5c157b87f9230927533fc470b2551f753276c7
Jul 17 06:14:38.766470 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.766420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerStarted","Data":"56c71c1301bdef80ef0672e515c339a9448537d5e447df7cc4662a5a208c6c56"}
Jul 17 06:14:38.766650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.766495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerStarted","Data":"5852edad26556625617ba6306c5c157b87f9230927533fc470b2551f753276c7"}
Jul 17 06:14:38.783009 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:38.782954    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" podStartSLOduration=1.7829396929999999 podStartE2EDuration="1.782939693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:38.780838687 +0000 UTC m=+2497.244022792" watchObservedRunningTime="2026-07-17 06:14:38.782939693 +0000 UTC m=+2497.246123800"
Jul 17 06:14:39.777333 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:39.777297    2567 generic.go:356] "Generic (PLEG): container finished" podID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerID="56c71c1301bdef80ef0672e515c339a9448537d5e447df7cc4662a5a208c6c56" exitCode=6
Jul 17 06:14:39.777751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:39.777345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerDied","Data":"56c71c1301bdef80ef0672e515c339a9448537d5e447df7cc4662a5a208c6c56"}
Jul 17 06:14:39.777751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:39.777592    2567 scope.go:117] "RemoveContainer" containerID="56c71c1301bdef80ef0672e515c339a9448537d5e447df7cc4662a5a208c6c56"
Jul 17 06:14:40.785424 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:40.785388    2567 generic.go:356] "Generic (PLEG): container finished" podID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerID="c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920" exitCode=6
Jul 17 06:14:40.785897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:40.785473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerDied","Data":"c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920"}
Jul 17 06:14:40.785897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:40.785537    2567 scope.go:117] "RemoveContainer" containerID="56c71c1301bdef80ef0672e515c339a9448537d5e447df7cc4662a5a208c6c56"
Jul 17 06:14:40.785897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:40.785756    2567 scope.go:117] "RemoveContainer" containerID="c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920"
Jul 17 06:14:40.786073 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:40.786021    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs_odh-ai-gateway-infra(54ee3783-8c7d-4581-a1f7-c4c260c67148)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148"
Jul 17 06:14:41.792440 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:41.792412    2567 scope.go:117] "RemoveContainer" containerID="c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920"
Jul 17 06:14:41.792849 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:41.792611    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs_odh-ai-gateway-infra(54ee3783-8c7d-4581-a1f7-c4c260c67148)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148"
Jul 17 06:14:42.284701 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.284649    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:14:42.289393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.289374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:42.294744 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.294723    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:14:42.320281 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.320248    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh\" (UID: \"e1074ab1-2959-4362-8b77-002721b02c29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:42.420807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.420768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh\" (UID: \"e1074ab1-2959-4362-8b77-002721b02c29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:42.421397 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.421375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh\" (UID: \"e1074ab1-2959-4362-8b77-002721b02c29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:42.601131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.601034    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:42.939536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:42.939498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:14:42.940735 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:14:42.940709    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1074ab1_2959_4362_8b77_002721b02c29.slice/crio-c0d25fc72d39605ef742f6588043eae65dc770632965624e6b4596978918cef4 WatchSource:0}: Error finding container c0d25fc72d39605ef742f6588043eae65dc770632965624e6b4596978918cef4: Status 404 returned error can't find the container with id c0d25fc72d39605ef742f6588043eae65dc770632965624e6b4596978918cef4
Jul 17 06:14:43.804843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.804805    2567 generic.go:356] "Generic (PLEG): container finished" podID="e1074ab1-2959-4362-8b77-002721b02c29" containerID="14ba4611bf5cbdbdca5bc58ace9ba28306061c7cafdae3e283528ba4d5bbc4e7" exitCode=6
Jul 17 06:14:43.805068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.804850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" event={"ID":"e1074ab1-2959-4362-8b77-002721b02c29","Type":"ContainerDied","Data":"14ba4611bf5cbdbdca5bc58ace9ba28306061c7cafdae3e283528ba4d5bbc4e7"}
Jul 17 06:14:43.805068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.804896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" event={"ID":"e1074ab1-2959-4362-8b77-002721b02c29","Type":"ContainerStarted","Data":"c0d25fc72d39605ef742f6588043eae65dc770632965624e6b4596978918cef4"}
Jul 17 06:14:43.805171 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.805080    2567 scope.go:117] "RemoveContainer" containerID="14ba4611bf5cbdbdca5bc58ace9ba28306061c7cafdae3e283528ba4d5bbc4e7"
Jul 17 06:14:43.824195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.824163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:14:43.969981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.969944    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:14:43.974584 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.974565    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:14:43.981425 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:43.981395    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:14:44.034106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.034076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt\" (UID: \"4a7f448a-b0b6-40f5-9d71-9e27707f8885\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:14:44.135618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.135532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt\" (UID: \"4a7f448a-b0b6-40f5-9d71-9e27707f8885\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:14:44.136162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.136143    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt\" (UID: \"4a7f448a-b0b6-40f5-9d71-9e27707f8885\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:14:44.287013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.286971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:14:44.423117 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.423089    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:14:44.425746 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:14:44.425719    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7f448a_b0b6_40f5_9d71_9e27707f8885.slice/crio-22e70123ff003ba010c52b9b6032d2ba348acb317a90de29891bf423d2d6b234 WatchSource:0}: Error finding container 22e70123ff003ba010c52b9b6032d2ba348acb317a90de29891bf423d2d6b234: Status 404 returned error can't find the container with id 22e70123ff003ba010c52b9b6032d2ba348acb317a90de29891bf423d2d6b234
Jul 17 06:14:44.811849 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.811804    2567 generic.go:356] "Generic (PLEG): container finished" podID="e1074ab1-2959-4362-8b77-002721b02c29" containerID="7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59" exitCode=6
Jul 17 06:14:44.812026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.811839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" event={"ID":"e1074ab1-2959-4362-8b77-002721b02c29","Type":"ContainerDied","Data":"7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59"}
Jul 17 06:14:44.812026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.811941    2567 scope.go:117] "RemoveContainer" containerID="14ba4611bf5cbdbdca5bc58ace9ba28306061c7cafdae3e283528ba4d5bbc4e7"
Jul 17 06:14:44.812241 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.812225    2567 scope.go:117] "RemoveContainer" containerID="7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59"
Jul 17 06:14:44.812518 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:44.812473    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh_odh-ai-gateway-infra(e1074ab1-2959-4362-8b77-002721b02c29)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" podUID="e1074ab1-2959-4362-8b77-002721b02c29"
Jul 17 06:14:44.813584 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.813563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerStarted","Data":"1e00b1a7d6b1eaf5d23460b0542245e6c100ab1c53a198fa258101d40ff5b94e"}
Jul 17 06:14:44.813710 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.813605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerStarted","Data":"22e70123ff003ba010c52b9b6032d2ba348acb317a90de29891bf423d2d6b234"}
Jul 17 06:14:44.839448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:44.839402    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" podStartSLOduration=1.839387271 podStartE2EDuration="1.839387271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:44.837973345 +0000 UTC m=+2503.301157448" watchObservedRunningTime="2026-07-17 06:14:44.839387271 +0000 UTC m=+2503.302571375"
Jul 17 06:14:45.820797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:45.820765    2567 scope.go:117] "RemoveContainer" containerID="7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59"
Jul 17 06:14:45.821245 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:45.821011    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh_odh-ai-gateway-infra(e1074ab1-2959-4362-8b77-002721b02c29)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" podUID="e1074ab1-2959-4362-8b77-002721b02c29"
Jul 17 06:14:45.822030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:45.822009    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerID="1e00b1a7d6b1eaf5d23460b0542245e6c100ab1c53a198fa258101d40ff5b94e" exitCode=6
Jul 17 06:14:45.822115 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:45.822091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerDied","Data":"1e00b1a7d6b1eaf5d23460b0542245e6c100ab1c53a198fa258101d40ff5b94e"}
Jul 17 06:14:45.822214 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:45.822201    2567 scope.go:117] "RemoveContainer" containerID="1e00b1a7d6b1eaf5d23460b0542245e6c100ab1c53a198fa258101d40ff5b94e"
Jul 17 06:14:46.830471 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:46.830432    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerID="186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695" exitCode=6
Jul 17 06:14:46.830966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:46.830499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerDied","Data":"186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695"}
Jul 17 06:14:46.830966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:46.830548    2567 scope.go:117] "RemoveContainer" containerID="1e00b1a7d6b1eaf5d23460b0542245e6c100ab1c53a198fa258101d40ff5b94e"
Jul 17 06:14:46.830966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:46.830730    2567 scope.go:117] "RemoveContainer" containerID="186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695"
Jul 17 06:14:46.831102 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:46.830986    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt_odh-ai-gateway-infra(4a7f448a-b0b6-40f5-9d71-9e27707f8885)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885"
Jul 17 06:14:47.837495 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:47.837466    2567 scope.go:117] "RemoveContainer" containerID="186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695"
Jul 17 06:14:47.837910 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:47.837691    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt_odh-ai-gateway-infra(4a7f448a-b0b6-40f5-9d71-9e27707f8885)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885"
Jul 17 06:14:54.020716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:54.020635    2567 scope.go:117] "RemoveContainer" containerID="c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920"
Jul 17 06:14:54.881402 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:54.881317    2567 generic.go:356] "Generic (PLEG): container finished" podID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerID="41c9d4a2b846783786658d25271b6cedf74ac1b3376bb16eac7bae8de974c55e" exitCode=6
Jul 17 06:14:54.881540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:54.881389    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerDied","Data":"41c9d4a2b846783786658d25271b6cedf74ac1b3376bb16eac7bae8de974c55e"}
Jul 17 06:14:54.881540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:54.881452    2567 scope.go:117] "RemoveContainer" containerID="c9508a9a9045881c8c886335c0ddc63bf133489ab20c245a8c0b2cfe5fa13920"
Jul 17 06:14:54.881768 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:54.881752    2567 scope.go:117] "RemoveContainer" containerID="41c9d4a2b846783786658d25271b6cedf74ac1b3376bb16eac7bae8de974c55e"
Jul 17 06:14:54.882024 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:54.882003    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs_odh-ai-gateway-infra(54ee3783-8c7d-4581-a1f7-c4c260c67148)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148"
Jul 17 06:14:55.906871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:55.906840    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:56.015112 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.015081    2567 scope.go:117] "RemoveContainer" containerID="7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59"
Jul 17 06:14:56.071529 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.071489    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:56.129957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.129922    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca\") pod \"54ee3783-8c7d-4581-a1f7-c4c260c67148\" (UID: \"54ee3783-8c7d-4581-a1f7-c4c260c67148\") "
Jul 17 06:14:56.130283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.130256    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54ee3783-8c7d-4581-a1f7-c4c260c67148" (UID: "54ee3783-8c7d-4581-a1f7-c4c260c67148"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:56.231606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.231566    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54ee3783-8c7d-4581-a1f7-c4c260c67148-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:56.896714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.896607    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"
Jul 17 06:14:56.896714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.896602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs" event={"ID":"54ee3783-8c7d-4581-a1f7-c4c260c67148","Type":"ContainerDied","Data":"5852edad26556625617ba6306c5c157b87f9230927533fc470b2551f753276c7"}
Jul 17 06:14:56.896916 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.896741    2567 scope.go:117] "RemoveContainer" containerID="41c9d4a2b846783786658d25271b6cedf74ac1b3376bb16eac7bae8de974c55e"
Jul 17 06:14:56.898556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.898536    2567 generic.go:356] "Generic (PLEG): container finished" podID="e1074ab1-2959-4362-8b77-002721b02c29" containerID="a4380edf9514c2476889d45f174d9221924bed226e43592b250795268069ce07" exitCode=6
Jul 17 06:14:56.898650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.898618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" event={"ID":"e1074ab1-2959-4362-8b77-002721b02c29","Type":"ContainerDied","Data":"a4380edf9514c2476889d45f174d9221924bed226e43592b250795268069ce07"}
Jul 17 06:14:56.898946 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.898929    2567 scope.go:117] "RemoveContainer" containerID="a4380edf9514c2476889d45f174d9221924bed226e43592b250795268069ce07"
Jul 17 06:14:56.899174 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:14:56.899154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh_odh-ai-gateway-infra(e1074ab1-2959-4362-8b77-002721b02c29)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" podUID="e1074ab1-2959-4362-8b77-002721b02c29"
Jul 17 06:14:56.906640 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.906625    2567 scope.go:117] "RemoveContainer" containerID="7e5776fca4b6afd44468fd8fc4c4265784eab6aba751cfeef4e98ddb3c462f59"
Jul 17 06:14:56.932232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.932206    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:56.936246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:56.936223    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2mhrs"]
Jul 17 06:14:57.927648 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:57.927612    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:14:58.021783 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.021751    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" path="/var/lib/kubelet/pods/54ee3783-8c7d-4581-a1f7-c4c260c67148/volumes"
Jul 17 06:14:58.063691 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.063653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:58.150414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.150377    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca\") pod \"e1074ab1-2959-4362-8b77-002721b02c29\" (UID: \"e1074ab1-2959-4362-8b77-002721b02c29\") "
Jul 17 06:14:58.150814 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.150786    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1074ab1-2959-4362-8b77-002721b02c29" (UID: "e1074ab1-2959-4362-8b77-002721b02c29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:58.251914 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.251863    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1074ab1-2959-4362-8b77-002721b02c29-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:14:58.913753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.913706    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"
Jul 17 06:14:58.913753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.913726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh" event={"ID":"e1074ab1-2959-4362-8b77-002721b02c29","Type":"ContainerDied","Data":"c0d25fc72d39605ef742f6588043eae65dc770632965624e6b4596978918cef4"}
Jul 17 06:14:58.914030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.913799    2567 scope.go:117] "RemoveContainer" containerID="a4380edf9514c2476889d45f174d9221924bed226e43592b250795268069ce07"
Jul 17 06:14:58.933493 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.933467    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:14:58.939936 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:14:58.939913    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-kf8lh"]
Jul 17 06:15:00.020372 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.020336    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1074ab1-2959-4362-8b77-002721b02c29" path="/var/lib/kubelet/pods/e1074ab1-2959-4362-8b77-002721b02c29/volumes"
Jul 17 06:15:00.135935 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.135898    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"]
Jul 17 06:15:00.136263 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136250    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136266    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136278    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136283    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136290    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136295    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136301    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136306    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136316    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136321    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136382    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136390    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136396    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136402    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.136511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.136407    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ee3783-8c7d-4581-a1f7-c4c260c67148" containerName="revoke-keys"
Jul 17 06:15:00.140655 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.140639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"
Jul 17 06:15:00.145732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.145706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"]
Jul 17 06:15:00.151644 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.151626    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"
Jul 17 06:15:00.287062 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.287033    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"]
Jul 17 06:15:00.288739 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:00.288712    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e242655_f8b6_438b_a4bf_051fe9d5afbf.slice/crio-465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032 WatchSource:0}: Error finding container 465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032: Status 404 returned error can't find the container with id 465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032
Jul 17 06:15:00.646540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.646458    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:00.646913 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.646896    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.646965 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.646921    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.647012 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.647002    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1074ab1-2959-4362-8b77-002721b02c29" containerName="revoke-keys"
Jul 17 06:15:00.650109 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.650091    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:00.656924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.656898    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:00.775454 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.775417    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c58b4\" (UID: \"56cec8b7-1d09-48cb-aae0-717783a3a461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:00.876953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.876917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c58b4\" (UID: \"56cec8b7-1d09-48cb-aae0-717783a3a461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:00.877536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.877517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-c58b4\" (UID: \"56cec8b7-1d09-48cb-aae0-717783a3a461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:00.927274 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.927184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x" event={"ID":"1e242655-f8b6-438b-a4bf-051fe9d5afbf","Type":"ContainerStarted","Data":"c100a6a064ba5e2f35ab7f93010dc65a271497e7a513964947dfed560e63fab8"}
Jul 17 06:15:00.927274 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.927247    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x" event={"ID":"1e242655-f8b6-438b-a4bf-051fe9d5afbf","Type":"ContainerStarted","Data":"465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032"}
Jul 17 06:15:00.941409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.941366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x" podStartSLOduration=0.94135175 podStartE2EDuration="941.35175ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:15:00.940156708 +0000 UTC m=+2519.403340802" watchObservedRunningTime="2026-07-17 06:15:00.94135175 +0000 UTC m=+2519.404535855"
Jul 17 06:15:00.962200 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:00.962165    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:01.098099 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.098067    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:01.101284 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:01.101257    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cec8b7_1d09_48cb_aae0_717783a3a461.slice/crio-4694c65eb65def634e847f54a569a92a32629c0f189092834c8a6df161b8a940 WatchSource:0}: Error finding container 4694c65eb65def634e847f54a569a92a32629c0f189092834c8a6df161b8a940: Status 404 returned error can't find the container with id 4694c65eb65def634e847f54a569a92a32629c0f189092834c8a6df161b8a940
Jul 17 06:15:01.934560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.934523    2567 generic.go:356] "Generic (PLEG): container finished" podID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerID="80be070c70b47b6e57683819e7a426698700d0e909436c6b00533d974236ec85" exitCode=6
Jul 17 06:15:01.934801 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.934613    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" event={"ID":"56cec8b7-1d09-48cb-aae0-717783a3a461","Type":"ContainerDied","Data":"80be070c70b47b6e57683819e7a426698700d0e909436c6b00533d974236ec85"}
Jul 17 06:15:01.934801 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.934738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" event={"ID":"56cec8b7-1d09-48cb-aae0-717783a3a461","Type":"ContainerStarted","Data":"4694c65eb65def634e847f54a569a92a32629c0f189092834c8a6df161b8a940"}
Jul 17 06:15:01.934929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.934816    2567 scope.go:117] "RemoveContainer" containerID="80be070c70b47b6e57683819e7a426698700d0e909436c6b00533d974236ec85"
Jul 17 06:15:01.936299 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.936280    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e242655-f8b6-438b-a4bf-051fe9d5afbf" containerID="c100a6a064ba5e2f35ab7f93010dc65a271497e7a513964947dfed560e63fab8" exitCode=0
Jul 17 06:15:01.936405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:01.936301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x" event={"ID":"1e242655-f8b6-438b-a4bf-051fe9d5afbf","Type":"ContainerDied","Data":"c100a6a064ba5e2f35ab7f93010dc65a271497e7a513964947dfed560e63fab8"}
Jul 17 06:15:02.944100 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:02.944069    2567 generic.go:356] "Generic (PLEG): container finished" podID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerID="24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83" exitCode=6
Jul 17 06:15:02.944527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:02.944155    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" event={"ID":"56cec8b7-1d09-48cb-aae0-717783a3a461","Type":"ContainerDied","Data":"24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83"}
Jul 17 06:15:02.944527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:02.944208    2567 scope.go:117] "RemoveContainer" containerID="80be070c70b47b6e57683819e7a426698700d0e909436c6b00533d974236ec85"
Jul 17 06:15:02.944527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:02.944321    2567 scope.go:117] "RemoveContainer" containerID="24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83"
Jul 17 06:15:02.944720 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:02.944592    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c58b4_odh-ai-gateway-infra(56cec8b7-1d09-48cb-aae0-717783a3a461)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461"
Jul 17 06:15:03.015330 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.015306    2567 scope.go:117] "RemoveContainer" containerID="186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695"
Jul 17 06:15:03.077263 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.077238    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"
Jul 17 06:15:03.951862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.951831    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerID="478aa50d24ea10ce4709811bff997f41e1f782bff9b4840945682c2343ca4fa8" exitCode=6
Jul 17 06:15:03.952320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.951913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerDied","Data":"478aa50d24ea10ce4709811bff997f41e1f782bff9b4840945682c2343ca4fa8"}
Jul 17 06:15:03.952320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.951974    2567 scope.go:117] "RemoveContainer" containerID="186418c955c847ce7eaa2d05641f6a521bb59f0acc57e4903d0fee424e838695"
Jul 17 06:15:03.952320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.952276    2567 scope.go:117] "RemoveContainer" containerID="478aa50d24ea10ce4709811bff997f41e1f782bff9b4840945682c2343ca4fa8"
Jul 17 06:15:03.952560 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:03.952538    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt_odh-ai-gateway-infra(4a7f448a-b0b6-40f5-9d71-9e27707f8885)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885"
Jul 17 06:15:03.953872 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.953853    2567 scope.go:117] "RemoveContainer" containerID="24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83"
Jul 17 06:15:03.954062 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:03.954043    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c58b4_odh-ai-gateway-infra(56cec8b7-1d09-48cb-aae0-717783a3a461)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461"
Jul 17 06:15:03.955014 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.954963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x" event={"ID":"1e242655-f8b6-438b-a4bf-051fe9d5afbf","Type":"ContainerDied","Data":"465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032"}
Jul 17 06:15:03.955111 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.955038    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="465a6dc271b1a7b6f8b612a6b2065f1c97e4775d0b118915ef28fe2086292032"
Jul 17 06:15:03.955111 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:03.954983    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737815-w4c6x"
Jul 17 06:15:04.976703 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:04.976655    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:15:05.109877 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.109849    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:15:05.217511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.217481    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca\") pod \"4a7f448a-b0b6-40f5-9d71-9e27707f8885\" (UID: \"4a7f448a-b0b6-40f5-9d71-9e27707f8885\") "
Jul 17 06:15:05.217934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.217908    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a7f448a-b0b6-40f5-9d71-9e27707f8885" (UID: "4a7f448a-b0b6-40f5-9d71-9e27707f8885"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:05.319106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.319017    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f448a-b0b6-40f5-9d71-9e27707f8885-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:15:05.968212 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.968186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"
Jul 17 06:15:05.968387 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.968227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt" event={"ID":"4a7f448a-b0b6-40f5-9d71-9e27707f8885","Type":"ContainerDied","Data":"22e70123ff003ba010c52b9b6032d2ba348acb317a90de29891bf423d2d6b234"}
Jul 17 06:15:05.968387 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.968304    2567 scope.go:117] "RemoveContainer" containerID="478aa50d24ea10ce4709811bff997f41e1f782bff9b4840945682c2343ca4fa8"
Jul 17 06:15:05.993739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.993710    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:15:05.996928 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:05.996904    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-jvnmt"]
Jul 17 06:15:06.021230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:06.021198    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" path="/var/lib/kubelet/pods/4a7f448a-b0b6-40f5-9d71-9e27707f8885/volumes"
Jul 17 06:15:17.015653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:17.015619    2567 scope.go:117] "RemoveContainer" containerID="24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83"
Jul 17 06:15:18.042368 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:18.042331    2567 generic.go:356] "Generic (PLEG): container finished" podID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerID="2394ed6dab695824973d05d30029b9bedd3490a06fdf4271861c169e295fc258" exitCode=6
Jul 17 06:15:18.042883 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:18.042400    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" event={"ID":"56cec8b7-1d09-48cb-aae0-717783a3a461","Type":"ContainerDied","Data":"2394ed6dab695824973d05d30029b9bedd3490a06fdf4271861c169e295fc258"}
Jul 17 06:15:18.042883 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:18.042494    2567 scope.go:117] "RemoveContainer" containerID="24f2fdd55f3804860a2d96a6dc1b49eb89b2ae456f50376cabd01a2774465c83"
Jul 17 06:15:18.042883 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:18.042817    2567 scope.go:117] "RemoveContainer" containerID="2394ed6dab695824973d05d30029b9bedd3490a06fdf4271861c169e295fc258"
Jul 17 06:15:18.043074 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:18.043052    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-c58b4_odh-ai-gateway-infra(56cec8b7-1d09-48cb-aae0-717783a3a461)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461"
Jul 17 06:15:19.070642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:19.070604    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:19.209270 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:19.209247    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:19.343283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:19.343194    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca\") pod \"56cec8b7-1d09-48cb-aae0-717783a3a461\" (UID: \"56cec8b7-1d09-48cb-aae0-717783a3a461\") "
Jul 17 06:15:19.343564 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:19.343540    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56cec8b7-1d09-48cb-aae0-717783a3a461" (UID: "56cec8b7-1d09-48cb-aae0-717783a3a461"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:19.444261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:19.444222    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56cec8b7-1d09-48cb-aae0-717783a3a461-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:15:20.056070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:20.056043    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"
Jul 17 06:15:20.056232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:20.056081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4" event={"ID":"56cec8b7-1d09-48cb-aae0-717783a3a461","Type":"ContainerDied","Data":"4694c65eb65def634e847f54a569a92a32629c0f189092834c8a6df161b8a940"}
Jul 17 06:15:20.056232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:20.056143    2567 scope.go:117] "RemoveContainer" containerID="2394ed6dab695824973d05d30029b9bedd3490a06fdf4271861c169e295fc258"
Jul 17 06:15:20.082965 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:20.082934    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:20.091598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:20.091576    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-c58b4"]
Jul 17 06:15:21.424291 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:21.424245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:15:22.020886 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:22.020852    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" path="/var/lib/kubelet/pods/56cec8b7-1d09-48cb-aae0-717783a3a461/volumes"
Jul 17 06:15:27.977581 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977548    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977920    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977932    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977942    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977947    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977955    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977961    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977972    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977977    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977983    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977989    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.977995    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e242655-f8b6-438b-a4bf-051fe9d5afbf" containerName="cleanup"
Jul 17 06:15:27.977998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978000    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e242655-f8b6-438b-a4bf-051fe9d5afbf" containerName="cleanup"
Jul 17 06:15:27.978366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978062    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.978366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978069    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e242655-f8b6-438b-a4bf-051fe9d5afbf" containerName="cleanup"
Jul 17 06:15:27.978366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978075    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:27.978366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978081    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.978366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.978090    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:27.982536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.982519    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:27.985717 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.985388    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:15:27.985717 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.985391    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:15:27.988306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:27.988285    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:28.121606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:28.121574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d\" (UID: \"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:28.222090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:28.222051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d\" (UID: \"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:28.222730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:28.222708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d\" (UID: \"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:28.295700 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:28.295582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:28.438771 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:28.438743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:28.440776 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:28.440747    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a9dfc1_1d59_4473_9e90_ae0ef6c09bb8.slice/crio-0267ed05124a9854787ee43863c6c39a189866080c3a50484109a49243ddc7e0 WatchSource:0}: Error finding container 0267ed05124a9854787ee43863c6c39a189866080c3a50484109a49243ddc7e0: Status 404 returned error can't find the container with id 0267ed05124a9854787ee43863c6c39a189866080c3a50484109a49243ddc7e0
Jul 17 06:15:29.114652 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:29.114618    2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerID="de3dab7b020a3306c0fc0a89cb6872d1d12fc6b153ae876fcb3b66207d49b4c6" exitCode=6
Jul 17 06:15:29.115068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:29.114727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" event={"ID":"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8","Type":"ContainerDied","Data":"de3dab7b020a3306c0fc0a89cb6872d1d12fc6b153ae876fcb3b66207d49b4c6"}
Jul 17 06:15:29.115068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:29.114789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" event={"ID":"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8","Type":"ContainerStarted","Data":"0267ed05124a9854787ee43863c6c39a189866080c3a50484109a49243ddc7e0"}
Jul 17 06:15:29.115068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:29.114923    2567 scope.go:117] "RemoveContainer" containerID="de3dab7b020a3306c0fc0a89cb6872d1d12fc6b153ae876fcb3b66207d49b4c6"
Jul 17 06:15:30.121832 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:30.121744    2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerID="459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8" exitCode=6
Jul 17 06:15:30.122276 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:30.121836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" event={"ID":"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8","Type":"ContainerDied","Data":"459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8"}
Jul 17 06:15:30.122276 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:30.121904    2567 scope.go:117] "RemoveContainer" containerID="de3dab7b020a3306c0fc0a89cb6872d1d12fc6b153ae876fcb3b66207d49b4c6"
Jul 17 06:15:30.122276 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:30.122019    2567 scope.go:117] "RemoveContainer" containerID="459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8"
Jul 17 06:15:30.122276 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:30.122253    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d_odh-ai-gateway-infra(f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8"
Jul 17 06:15:31.129053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:31.129025    2567 scope.go:117] "RemoveContainer" containerID="459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8"
Jul 17 06:15:31.129500 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:31.129286    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d_odh-ai-gateway-infra(f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8"
Jul 17 06:15:32.326472 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.326429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:32.326874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.326816    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:32.326874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.326828    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:32.326945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.326898    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56cec8b7-1d09-48cb-aae0-717783a3a461" containerName="revoke-keys"
Jul 17 06:15:32.326945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.326907    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7f448a-b0b6-40f5-9d71-9e27707f8885" containerName="revoke-keys"
Jul 17 06:15:32.331296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.331279    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:32.337133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.337104    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:32.461587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.461543    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-klwqh\" (UID: \"b6f1ebda-9ae2-409b-952e-0a7f8a517c98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:32.518403 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.518367    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:15:32.562846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.562807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-klwqh\" (UID: \"b6f1ebda-9ae2-409b-952e-0a7f8a517c98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:32.563469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.563451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-klwqh\" (UID: \"b6f1ebda-9ae2-409b-952e-0a7f8a517c98\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:32.643514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.643420    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:32.776208 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:32.776181    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:32.777513 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:32.777487    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f1ebda_9ae2_409b_952e_0a7f8a517c98.slice/crio-177b44da87e017ff86375cbba0fee129512dc3f4b897f0f466ac2540991c9017 WatchSource:0}: Error finding container 177b44da87e017ff86375cbba0fee129512dc3f4b897f0f466ac2540991c9017: Status 404 returned error can't find the container with id 177b44da87e017ff86375cbba0fee129512dc3f4b897f0f466ac2540991c9017
Jul 17 06:15:33.142083 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:33.142044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerStarted","Data":"b9498ec1c3111bda749d19f16b5fd9db74890ac60ee22397dbce4f69deece620"}
Jul 17 06:15:33.142256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:33.142099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerStarted","Data":"177b44da87e017ff86375cbba0fee129512dc3f4b897f0f466ac2540991c9017"}
Jul 17 06:15:33.156498 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:33.156450    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" podStartSLOduration=1.156435285 podStartE2EDuration="1.156435285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:15:33.155569636 +0000 UTC m=+2551.618753741" watchObservedRunningTime="2026-07-17 06:15:33.156435285 +0000 UTC m=+2551.619619388"
Jul 17 06:15:34.148784 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:34.148749    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerID="b9498ec1c3111bda749d19f16b5fd9db74890ac60ee22397dbce4f69deece620" exitCode=6
Jul 17 06:15:34.149204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:34.148847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerDied","Data":"b9498ec1c3111bda749d19f16b5fd9db74890ac60ee22397dbce4f69deece620"}
Jul 17 06:15:34.149204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:34.148977    2567 scope.go:117] "RemoveContainer" containerID="b9498ec1c3111bda749d19f16b5fd9db74890ac60ee22397dbce4f69deece620"
Jul 17 06:15:35.157428 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:35.157345    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerID="37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5" exitCode=6
Jul 17 06:15:35.157844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:35.157426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerDied","Data":"37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5"}
Jul 17 06:15:35.157844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:35.157486    2567 scope.go:117] "RemoveContainer" containerID="b9498ec1c3111bda749d19f16b5fd9db74890ac60ee22397dbce4f69deece620"
Jul 17 06:15:35.157844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:35.157704    2567 scope.go:117] "RemoveContainer" containerID="37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5"
Jul 17 06:15:35.157963 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:35.157941    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-klwqh_odh-ai-gateway-infra(b6f1ebda-9ae2-409b-952e-0a7f8a517c98)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98"
Jul 17 06:15:36.164792 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:36.164767    2567 scope.go:117] "RemoveContainer" containerID="37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5"
Jul 17 06:15:36.165188 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:36.164984    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-klwqh_odh-ai-gateway-infra(b6f1ebda-9ae2-409b-952e-0a7f8a517c98)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98"
Jul 17 06:15:44.014285 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.014250    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:15:44.017783 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.017759    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:15:44.025541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.025513    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:15:44.026265 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.026243    2567 scope.go:117] "RemoveContainer" containerID="459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8"
Jul 17 06:15:44.047803 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.047776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n\" (UID: \"03437372-d597-41b7-b1ea-dd98d147ae15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:15:44.148529 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.148487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n\" (UID: \"03437372-d597-41b7-b1ea-dd98d147ae15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:15:44.149162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.149138    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n\" (UID: \"03437372-d597-41b7-b1ea-dd98d147ae15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:15:44.331489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.331458    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:15:44.467410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:44.467382    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:15:44.469715 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:44.469648    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03437372_d597_41b7_b1ea_dd98d147ae15.slice/crio-a020538cb02f463f2227618406c0e733954faf4fb4d6272d42cdcea1bcaaaa58 WatchSource:0}: Error finding container a020538cb02f463f2227618406c0e733954faf4fb4d6272d42cdcea1bcaaaa58: Status 404 returned error can't find the container with id a020538cb02f463f2227618406c0e733954faf4fb4d6272d42cdcea1bcaaaa58
Jul 17 06:15:45.217100 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.217052    2567 generic.go:356] "Generic (PLEG): container finished" podID="03437372-d597-41b7-b1ea-dd98d147ae15" containerID="9c7833a7f27715836ae68588a4bfdc10fa8c3502ba17e82f2849da088c20ae6c" exitCode=6
Jul 17 06:15:45.217485 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.217130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerDied","Data":"9c7833a7f27715836ae68588a4bfdc10fa8c3502ba17e82f2849da088c20ae6c"}
Jul 17 06:15:45.217485 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.217185    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerStarted","Data":"a020538cb02f463f2227618406c0e733954faf4fb4d6272d42cdcea1bcaaaa58"}
Jul 17 06:15:45.217485 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.217355    2567 scope.go:117] "RemoveContainer" containerID="9c7833a7f27715836ae68588a4bfdc10fa8c3502ba17e82f2849da088c20ae6c"
Jul 17 06:15:45.226024 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.225992    2567 generic.go:356] "Generic (PLEG): container finished" podID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerID="8d42f5bf148208223357ec929ffcf29658f38dce9619bb72e8ee30ef385f62d7" exitCode=6
Jul 17 06:15:45.226208 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.226070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" event={"ID":"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8","Type":"ContainerDied","Data":"8d42f5bf148208223357ec929ffcf29658f38dce9619bb72e8ee30ef385f62d7"}
Jul 17 06:15:45.226342 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.226231    2567 scope.go:117] "RemoveContainer" containerID="459a60bb01bcea54763c7e57aa23da647d82d45d5ff5f41895612f3c4b7816f8"
Jul 17 06:15:45.226626 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:45.226611    2567 scope.go:117] "RemoveContainer" containerID="8d42f5bf148208223357ec929ffcf29658f38dce9619bb72e8ee30ef385f62d7"
Jul 17 06:15:45.226863 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:45.226833    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d_odh-ai-gateway-infra(f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8"
Jul 17 06:15:46.233807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.233768    2567 generic.go:356] "Generic (PLEG): container finished" podID="03437372-d597-41b7-b1ea-dd98d147ae15" containerID="78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032" exitCode=6
Jul 17 06:15:46.234228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.233858    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerDied","Data":"78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032"}
Jul 17 06:15:46.234228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.233913    2567 scope.go:117] "RemoveContainer" containerID="9c7833a7f27715836ae68588a4bfdc10fa8c3502ba17e82f2849da088c20ae6c"
Jul 17 06:15:46.234228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.234084    2567 scope.go:117] "RemoveContainer" containerID="78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032"
Jul 17 06:15:46.234508 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:46.234312    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n_odh-ai-gateway-infra(03437372-d597-41b7-b1ea-dd98d147ae15)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" podUID="03437372-d597-41b7-b1ea-dd98d147ae15"
Jul 17 06:15:46.257940 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.257914    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:46.393157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.393132    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:46.467257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.467225    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca\") pod \"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8\" (UID: \"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8\") "
Jul 17 06:15:46.467600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.467569    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" (UID: "f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:46.567892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:46.567800    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:15:47.242919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.242886    2567 scope.go:117] "RemoveContainer" containerID="78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032"
Jul 17 06:15:47.243421 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:47.243118    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n_odh-ai-gateway-infra(03437372-d597-41b7-b1ea-dd98d147ae15)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" podUID="03437372-d597-41b7-b1ea-dd98d147ae15"
Jul 17 06:15:47.243934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.243916    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"
Jul 17 06:15:47.244049 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.243919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d" event={"ID":"f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8","Type":"ContainerDied","Data":"0267ed05124a9854787ee43863c6c39a189866080c3a50484109a49243ddc7e0"}
Jul 17 06:15:47.244049 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.244045    2567 scope.go:117] "RemoveContainer" containerID="8d42f5bf148208223357ec929ffcf29658f38dce9619bb72e8ee30ef385f62d7"
Jul 17 06:15:47.283558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.283531    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:47.287172 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:47.287147    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-cb22d"]
Jul 17 06:15:48.020960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:48.020924    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" path="/var/lib/kubelet/pods/f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8/volumes"
Jul 17 06:15:48.223480 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:48.223446    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:15:49.015499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:49.015469    2567 scope.go:117] "RemoveContainer" containerID="37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5"
Jul 17 06:15:49.258452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:49.258413    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerStarted","Data":"ff6aa9eb933c197a87106f6664bf3576dc34bc96df55d6b5b28336e63955dc54"}
Jul 17 06:15:50.265316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.265278    2567 generic.go:356] "Generic (PLEG): container finished" podID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerID="ff6aa9eb933c197a87106f6664bf3576dc34bc96df55d6b5b28336e63955dc54" exitCode=6
Jul 17 06:15:50.265755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.265346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerDied","Data":"ff6aa9eb933c197a87106f6664bf3576dc34bc96df55d6b5b28336e63955dc54"}
Jul 17 06:15:50.265755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.265407    2567 scope.go:117] "RemoveContainer" containerID="37bdeda76300e801b96b136998bba5239cd4b3d392cbc18bfdd2ef60f94926c5"
Jul 17 06:15:50.265846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.265759    2567 scope.go:117] "RemoveContainer" containerID="ff6aa9eb933c197a87106f6664bf3576dc34bc96df55d6b5b28336e63955dc54"
Jul 17 06:15:50.266021 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:50.265997    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-klwqh_odh-ai-gateway-infra(b6f1ebda-9ae2-409b-952e-0a7f8a517c98)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98"
Jul 17 06:15:50.288610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.288584    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:50.686181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686097    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:15:50.686477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686464    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686520 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686479    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686520 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686499    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686520 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686505    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686622 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686567    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686622 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686577    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.686622 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.686583    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:50.690933 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.690916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:15:50.696523 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.696494    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:15:50.701654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.701632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-dmgpw\" (UID: \"ef7b37f8-78db-4117-ab42-3fa73f194726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:15:50.802420 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.802384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-dmgpw\" (UID: \"ef7b37f8-78db-4117-ab42-3fa73f194726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:15:50.803026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:50.803006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-dmgpw\" (UID: \"ef7b37f8-78db-4117-ab42-3fa73f194726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:15:51.003860 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.003824    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:15:51.139519 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.139491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:15:51.141388 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:51.141363    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7b37f8_78db_4117_ab42_3fa73f194726.slice/crio-085da363ab80a3ce452daa42bf3d12dbabc91a3a50c89bbf2ecf7440a21c378e WatchSource:0}: Error finding container 085da363ab80a3ce452daa42bf3d12dbabc91a3a50c89bbf2ecf7440a21c378e: Status 404 returned error can't find the container with id 085da363ab80a3ce452daa42bf3d12dbabc91a3a50c89bbf2ecf7440a21c378e
Jul 17 06:15:51.272383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.272303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerStarted","Data":"085da363ab80a3ce452daa42bf3d12dbabc91a3a50c89bbf2ecf7440a21c378e"}
Jul 17 06:15:51.406015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.405985    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"]
Jul 17 06:15:51.406357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.406342    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:51.406357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.406356    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a9dfc1-1d59-4473-9e90-ae0ef6c09bb8" containerName="revoke-keys"
Jul 17 06:15:51.410755 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.410732    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:51.416803 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.416774    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"]
Jul 17 06:15:51.418556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.418538    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:51.509791 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.509769    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca\") pod \"b6f1ebda-9ae2-409b-952e-0a7f8a517c98\" (UID: \"b6f1ebda-9ae2-409b-952e-0a7f8a517c98\") "
Jul 17 06:15:51.509963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.509946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-603a20da-t6lbz\" (UID: \"258a35a8-6b98-4f31-97cb-8bf1c2f16c62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:51.510084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.510064    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6f1ebda-9ae2-409b-952e-0a7f8a517c98" (UID: "b6f1ebda-9ae2-409b-952e-0a7f8a517c98"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:51.610592 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.610495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-603a20da-t6lbz\" (UID: \"258a35a8-6b98-4f31-97cb-8bf1c2f16c62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:51.610592 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.610569    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f1ebda-9ae2-409b-952e-0a7f8a517c98-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:15:51.611153 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.611134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-603a20da-t6lbz\" (UID: \"258a35a8-6b98-4f31-97cb-8bf1c2f16c62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:51.728443 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.728412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:51.860849 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:51.860795    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"]
Jul 17 06:15:51.862488 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:15:51.862462    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258a35a8_6b98_4f31_97cb_8bf1c2f16c62.slice/crio-0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8 WatchSource:0}: Error finding container 0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8: Status 404 returned error can't find the container with id 0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8
Jul 17 06:15:52.280624 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.280588    2567 generic.go:356] "Generic (PLEG): container finished" podID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerID="89fd07a05abe8095a47fd4cee65c7ee0f3b7e7fe381f33ddd0c2c8e124144402" exitCode=6
Jul 17 06:15:52.281133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.280641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerDied","Data":"89fd07a05abe8095a47fd4cee65c7ee0f3b7e7fe381f33ddd0c2c8e124144402"}
Jul 17 06:15:52.281133 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.280975    2567 scope.go:117] "RemoveContainer" containerID="89fd07a05abe8095a47fd4cee65c7ee0f3b7e7fe381f33ddd0c2c8e124144402"
Jul 17 06:15:52.282557 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.282534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz" event={"ID":"258a35a8-6b98-4f31-97cb-8bf1c2f16c62","Type":"ContainerStarted","Data":"fdb40473f796bd667847b9c73a4d9e8951b5dea079aae2708821f877bc5433bb"}
Jul 17 06:15:52.282711 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.282578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz" event={"ID":"258a35a8-6b98-4f31-97cb-8bf1c2f16c62","Type":"ContainerStarted","Data":"0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8"}
Jul 17 06:15:52.283957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.283924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh" event={"ID":"b6f1ebda-9ae2-409b-952e-0a7f8a517c98","Type":"ContainerDied","Data":"177b44da87e017ff86375cbba0fee129512dc3f4b897f0f466ac2540991c9017"}
Jul 17 06:15:52.283957 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.283941    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"
Jul 17 06:15:52.284131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.283977    2567 scope.go:117] "RemoveContainer" containerID="ff6aa9eb933c197a87106f6664bf3576dc34bc96df55d6b5b28336e63955dc54"
Jul 17 06:15:52.311089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.311043    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz" podStartSLOduration=1.311028034 podStartE2EDuration="1.311028034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:15:52.309562666 +0000 UTC m=+2570.772746771" watchObservedRunningTime="2026-07-17 06:15:52.311028034 +0000 UTC m=+2570.774212139"
Jul 17 06:15:52.322173 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.322149    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:52.324354 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:52.324327    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-klwqh"]
Jul 17 06:15:53.291206 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.291118    2567 generic.go:356] "Generic (PLEG): container finished" podID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerID="7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb" exitCode=6
Jul 17 06:15:53.291672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.291209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerDied","Data":"7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb"}
Jul 17 06:15:53.291672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.291273    2567 scope.go:117] "RemoveContainer" containerID="89fd07a05abe8095a47fd4cee65c7ee0f3b7e7fe381f33ddd0c2c8e124144402"
Jul 17 06:15:53.291672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.291487    2567 scope.go:117] "RemoveContainer" containerID="7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb"
Jul 17 06:15:53.291843 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:53.291738    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-dmgpw_odh-ai-gateway-infra(ef7b37f8-78db-4117-ab42-3fa73f194726)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726"
Jul 17 06:15:53.292855 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.292830    2567 generic.go:356] "Generic (PLEG): container finished" podID="258a35a8-6b98-4f31-97cb-8bf1c2f16c62" containerID="fdb40473f796bd667847b9c73a4d9e8951b5dea079aae2708821f877bc5433bb" exitCode=0
Jul 17 06:15:53.292960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:53.292913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz" event={"ID":"258a35a8-6b98-4f31-97cb-8bf1c2f16c62","Type":"ContainerDied","Data":"fdb40473f796bd667847b9c73a4d9e8951b5dea079aae2708821f877bc5433bb"}
Jul 17 06:15:54.020979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.020947    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" path="/var/lib/kubelet/pods/b6f1ebda-9ae2-409b-952e-0a7f8a517c98/volumes"
Jul 17 06:15:54.301798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.301706    2567 scope.go:117] "RemoveContainer" containerID="7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb"
Jul 17 06:15:54.302295 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:15:54.301951    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-dmgpw_odh-ai-gateway-infra(ef7b37f8-78db-4117-ab42-3fa73f194726)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726"
Jul 17 06:15:54.438195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.438166    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:54.539894 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.539858    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca\") pod \"258a35a8-6b98-4f31-97cb-8bf1c2f16c62\" (UID: \"258a35a8-6b98-4f31-97cb-8bf1c2f16c62\") "
Jul 17 06:15:54.540239 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.540212    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "258a35a8-6b98-4f31-97cb-8bf1c2f16c62" (UID: "258a35a8-6b98-4f31-97cb-8bf1c2f16c62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:54.640730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:54.640629    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/258a35a8-6b98-4f31-97cb-8bf1c2f16c62-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:15:55.308934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:55.308902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz" event={"ID":"258a35a8-6b98-4f31-97cb-8bf1c2f16c62","Type":"ContainerDied","Data":"0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8"}
Jul 17 06:15:55.308934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:55.308929    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-603a20da-t6lbz"
Jul 17 06:15:55.309367 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:15:55.308952    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cf6b945d30ad67e0b0684962c4e2b29615ddeeb9fef47091a97f517bb74d1c8"
Jul 17 06:16:02.018376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:02.018342    2567 scope.go:117] "RemoveContainer" containerID="78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032"
Jul 17 06:16:02.347786 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:02.347751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerStarted","Data":"891b61a82e775b8baedda9bbde6f796c888fb220b33667a40371cf4221f5ae05"}
Jul 17 06:16:02.363847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:02.363794    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" podStartSLOduration=19.363778059 podStartE2EDuration="19.363778059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:16:02.362734359 +0000 UTC m=+2580.825918465" watchObservedRunningTime="2026-07-17 06:16:02.363778059 +0000 UTC m=+2580.826962188"
Jul 17 06:16:03.355277 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:03.355242    2567 generic.go:356] "Generic (PLEG): container finished" podID="03437372-d597-41b7-b1ea-dd98d147ae15" containerID="891b61a82e775b8baedda9bbde6f796c888fb220b33667a40371cf4221f5ae05" exitCode=6
Jul 17 06:16:03.355722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:03.355277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerDied","Data":"891b61a82e775b8baedda9bbde6f796c888fb220b33667a40371cf4221f5ae05"}
Jul 17 06:16:03.355722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:03.355341    2567 scope.go:117] "RemoveContainer" containerID="78e48edc1ab946c37ded6ef8a96b4c260b8e2d0eb5acfb368e81192ae99f3032"
Jul 17 06:16:03.355722 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:03.355711    2567 scope.go:117] "RemoveContainer" containerID="891b61a82e775b8baedda9bbde6f796c888fb220b33667a40371cf4221f5ae05"
Jul 17 06:16:03.355914 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:03.355894    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n_odh-ai-gateway-infra(03437372-d597-41b7-b1ea-dd98d147ae15)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" podUID="03437372-d597-41b7-b1ea-dd98d147ae15"
Jul 17 06:16:03.380152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:03.380126    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:16:04.497801 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:04.497773    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:16:04.535000 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:04.534964    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca\") pod \"03437372-d597-41b7-b1ea-dd98d147ae15\" (UID: \"03437372-d597-41b7-b1ea-dd98d147ae15\") "
Jul 17 06:16:04.535369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:04.535338    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03437372-d597-41b7-b1ea-dd98d147ae15" (UID: "03437372-d597-41b7-b1ea-dd98d147ae15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:16:04.635701 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:04.635591    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03437372-d597-41b7-b1ea-dd98d147ae15-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:16:05.015369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.015332    2567 scope.go:117] "RemoveContainer" containerID="7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb"
Jul 17 06:16:05.369004 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.368908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerStarted","Data":"f61ea27d66e49860b6f3149b420742bdfcf8887315ef6de83bc5dca27252954a"}
Jul 17 06:16:05.370289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.370254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n" event={"ID":"03437372-d597-41b7-b1ea-dd98d147ae15","Type":"ContainerDied","Data":"a020538cb02f463f2227618406c0e733954faf4fb4d6272d42cdcea1bcaaaa58"}
Jul 17 06:16:05.370289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.370278    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"
Jul 17 06:16:05.370477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.370324    2567 scope.go:117] "RemoveContainer" containerID="891b61a82e775b8baedda9bbde6f796c888fb220b33667a40371cf4221f5ae05"
Jul 17 06:16:05.400200 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.400136    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" podStartSLOduration=15.400119748 podStartE2EDuration="15.400119748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:16:05.398094993 +0000 UTC m=+2583.861279100" watchObservedRunningTime="2026-07-17 06:16:05.400119748 +0000 UTC m=+2583.863303889"
Jul 17 06:16:05.418166 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.418127    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:16:05.421951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:05.421925    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zj8n"]
Jul 17 06:16:06.013481 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.013445    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:16:06.021436 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.021407    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" path="/var/lib/kubelet/pods/03437372-d597-41b7-b1ea-dd98d147ae15/volumes"
Jul 17 06:16:06.378565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.378478    2567 generic.go:356] "Generic (PLEG): container finished" podID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerID="f61ea27d66e49860b6f3149b420742bdfcf8887315ef6de83bc5dca27252954a" exitCode=6
Jul 17 06:16:06.378565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.378552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerDied","Data":"f61ea27d66e49860b6f3149b420742bdfcf8887315ef6de83bc5dca27252954a"}
Jul 17 06:16:06.378834 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.378609    2567 scope.go:117] "RemoveContainer" containerID="7e56b2cb39be4bf3371100efd7cc920a23b1ff63dadf9f26fd3e02101a4d52eb"
Jul 17 06:16:06.378919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.378903    2567 scope.go:117] "RemoveContainer" containerID="f61ea27d66e49860b6f3149b420742bdfcf8887315ef6de83bc5dca27252954a"
Jul 17 06:16:06.379157 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:06.379137    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-dmgpw_odh-ai-gateway-infra(ef7b37f8-78db-4117-ab42-3fa73f194726)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726"
Jul 17 06:16:06.408664 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:06.408629    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:16:07.521575 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:07.521547    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:16:07.663899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:07.663811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca\") pod \"ef7b37f8-78db-4117-ab42-3fa73f194726\" (UID: \"ef7b37f8-78db-4117-ab42-3fa73f194726\") "
Jul 17 06:16:07.664224 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:07.664201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef7b37f8-78db-4117-ab42-3fa73f194726" (UID: "ef7b37f8-78db-4117-ab42-3fa73f194726"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:16:07.765244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:07.765211    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7b37f8-78db-4117-ab42-3fa73f194726-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:16:08.394661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:08.394575    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"
Jul 17 06:16:08.394661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:08.394619    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw" event={"ID":"ef7b37f8-78db-4117-ab42-3fa73f194726","Type":"ContainerDied","Data":"085da363ab80a3ce452daa42bf3d12dbabc91a3a50c89bbf2ecf7440a21c378e"}
Jul 17 06:16:08.394906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:08.394700    2567 scope.go:117] "RemoveContainer" containerID="f61ea27d66e49860b6f3149b420742bdfcf8887315ef6de83bc5dca27252954a"
Jul 17 06:16:08.411001 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:08.410897    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:16:08.413598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:08.413576    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-dmgpw"]
Jul 17 06:16:10.020195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:10.020161    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" path="/var/lib/kubelet/pods/ef7b37f8-78db-4117-ab42-3fa73f194726/volumes"
Jul 17 06:16:18.026637 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.026598    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.026984    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.026997    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027007    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258a35a8-6b98-4f31-97cb-8bf1c2f16c62" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027015    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="258a35a8-6b98-4f31-97cb-8bf1c2f16c62" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027027    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027034    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027040    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027045 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027044    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027056    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027061    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027067    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027071    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027087    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027094    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027153    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027161    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027167    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027173    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="258a35a8-6b98-4f31-97cb-8bf1c2f16c62" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027181    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027188    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027197    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:18.027290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.027205    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:18.031449 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.031433    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:18.034154 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.034102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:16:18.034154 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.034121    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:16:18.038704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.038659    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:18.160132 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.160097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs\" (UID: \"009393d2-2918-40e0-85da-7c0bad43c9ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:18.261064 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.261018    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs\" (UID: \"009393d2-2918-40e0-85da-7c0bad43c9ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:18.261652 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.261631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs\" (UID: \"009393d2-2918-40e0-85da-7c0bad43c9ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:18.344589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.344497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:18.479751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:18.479722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:18.481671 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:16:18.481642    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009393d2_2918_40e0_85da_7c0bad43c9ec.slice/crio-44c5887264043212552ac9921fa03290a3a64cc9f2b16fb7ec132f1f19092cc0 WatchSource:0}: Error finding container 44c5887264043212552ac9921fa03290a3a64cc9f2b16fb7ec132f1f19092cc0: Status 404 returned error can't find the container with id 44c5887264043212552ac9921fa03290a3a64cc9f2b16fb7ec132f1f19092cc0
Jul 17 06:16:19.459821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:19.459789    2567 generic.go:356] "Generic (PLEG): container finished" podID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerID="fba2ee9dfbc0a286ed634bb42f94a245c79c522c6c39a379493c7185ada90058" exitCode=6
Jul 17 06:16:19.460343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:19.459872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerDied","Data":"fba2ee9dfbc0a286ed634bb42f94a245c79c522c6c39a379493c7185ada90058"}
Jul 17 06:16:19.460343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:19.459923    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerStarted","Data":"44c5887264043212552ac9921fa03290a3a64cc9f2b16fb7ec132f1f19092cc0"}
Jul 17 06:16:19.460343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:19.460045    2567 scope.go:117] "RemoveContainer" containerID="fba2ee9dfbc0a286ed634bb42f94a245c79c522c6c39a379493c7185ada90058"
Jul 17 06:16:20.468397 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:20.468361    2567 generic.go:356] "Generic (PLEG): container finished" podID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerID="eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d" exitCode=6
Jul 17 06:16:20.468847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:20.468447    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerDied","Data":"eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d"}
Jul 17 06:16:20.468847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:20.468506    2567 scope.go:117] "RemoveContainer" containerID="fba2ee9dfbc0a286ed634bb42f94a245c79c522c6c39a379493c7185ada90058"
Jul 17 06:16:20.468847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:20.468650    2567 scope.go:117] "RemoveContainer" containerID="eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d"
Jul 17 06:16:20.468969 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:20.468911    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs_odh-ai-gateway-infra(009393d2-2918-40e0-85da-7c0bad43c9ec)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec"
Jul 17 06:16:21.475239 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:21.475210    2567 scope.go:117] "RemoveContainer" containerID="eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d"
Jul 17 06:16:21.475704 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:21.475454    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs_odh-ai-gateway-infra(009393d2-2918-40e0-85da-7c0bad43c9ec)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec"
Jul 17 06:16:22.374548 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.374503    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:22.374989 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.374970    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:22.374989 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.374991    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:22.375140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375004    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:22.375140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375012    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:22.375140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375053    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:22.375140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375063    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="03437372-d597-41b7-b1ea-dd98d147ae15" containerName="revoke-keys"
Jul 17 06:16:22.375341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375183    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7b37f8-78db-4117-ab42-3fa73f194726" containerName="revoke-keys"
Jul 17 06:16:22.375341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.375202    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1ebda-9ae2-409b-952e-0a7f8a517c98" containerName="revoke-keys"
Jul 17 06:16:22.379437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.379416    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:22.384831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.384804    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:22.495872 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.495834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r\" (UID: \"05b96741-ec08-48e0-ba71-ee34e6cd628d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:22.597036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.596997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r\" (UID: \"05b96741-ec08-48e0-ba71-ee34e6cd628d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:22.597624 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.597602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r\" (UID: \"05b96741-ec08-48e0-ba71-ee34e6cd628d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:22.692179 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.692150    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:22.831181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:22.831148    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:22.832646 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:16:22.832618    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b96741_ec08_48e0_ba71_ee34e6cd628d.slice/crio-3951b16503c51ae952f8e9dab650fa4123bebd7df0d8a9b3ca95c0949da3bca2 WatchSource:0}: Error finding container 3951b16503c51ae952f8e9dab650fa4123bebd7df0d8a9b3ca95c0949da3bca2: Status 404 returned error can't find the container with id 3951b16503c51ae952f8e9dab650fa4123bebd7df0d8a9b3ca95c0949da3bca2
Jul 17 06:16:23.489283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:23.489253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerStarted","Data":"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"}
Jul 17 06:16:23.489392 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:23.489313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerStarted","Data":"3951b16503c51ae952f8e9dab650fa4123bebd7df0d8a9b3ca95c0949da3bca2"}
Jul 17 06:16:23.489434 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:23.489425    2567 scope.go:117] "RemoveContainer" containerID="b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"
Jul 17 06:16:24.496908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.496878    2567 generic.go:356] "Generic (PLEG): container finished" podID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerID="b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707" exitCode=6
Jul 17 06:16:24.496908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.496900    2567 generic.go:356] "Generic (PLEG): container finished" podID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerID="def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43" exitCode=6
Jul 17 06:16:24.497429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.496974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerDied","Data":"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"}
Jul 17 06:16:24.497429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.497041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerDied","Data":"def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43"}
Jul 17 06:16:24.497429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.497074    2567 scope.go:117] "RemoveContainer" containerID="b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"
Jul 17 06:16:24.497429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.497122    2567 scope.go:117] "RemoveContainer" containerID="def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43"
Jul 17 06:16:24.497429 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:24.497322    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r_odh-ai-gateway-infra(05b96741-ec08-48e0-ba71-ee34e6cd628d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d"
Jul 17 06:16:24.508520 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.508499    2567 scope.go:117] "RemoveContainer" containerID="b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"
Jul 17 06:16:24.508805 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:24.508786    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707\": container with ID starting with b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707 not found: ID does not exist" containerID="b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"
Jul 17 06:16:24.508856 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:24.508814    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707"} err="failed to get container status \"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707\": rpc error: code = NotFound desc = could not find container \"b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707\": container with ID starting with b699ae4fda93bc39ff6aee868b061268c53a00971c1acceea13d9ae9799f0707 not found: ID does not exist"
Jul 17 06:16:25.505999 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:25.505970    2567 scope.go:117] "RemoveContainer" containerID="def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43"
Jul 17 06:16:25.506378 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:25.506174    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r_odh-ai-gateway-infra(05b96741-ec08-48e0-ba71-ee34e6cd628d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d"
Jul 17 06:16:33.015623 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:33.015589    2567 scope.go:117] "RemoveContainer" containerID="eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d"
Jul 17 06:16:33.552084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:33.552047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerStarted","Data":"24639125a1e485195fd565b71be461b5ed787d8d9e3d2f308fbaa3cef072c6bf"}
Jul 17 06:16:33.568587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:33.568533    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" podStartSLOduration=15.568516677 podStartE2EDuration="15.568516677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:16:33.567169986 +0000 UTC m=+2612.030354091" watchObservedRunningTime="2026-07-17 06:16:33.568516677 +0000 UTC m=+2612.031700781"
Jul 17 06:16:34.559184 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:34.559150    2567 generic.go:356] "Generic (PLEG): container finished" podID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerID="24639125a1e485195fd565b71be461b5ed787d8d9e3d2f308fbaa3cef072c6bf" exitCode=6
Jul 17 06:16:34.559653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:34.559231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerDied","Data":"24639125a1e485195fd565b71be461b5ed787d8d9e3d2f308fbaa3cef072c6bf"}
Jul 17 06:16:34.559653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:34.559305    2567 scope.go:117] "RemoveContainer" containerID="eb7b3a3052f40bfad2de135ff47d395475493ce9d57d16fa1b5af4a91b01f35d"
Jul 17 06:16:34.559653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:34.559584    2567 scope.go:117] "RemoveContainer" containerID="24639125a1e485195fd565b71be461b5ed787d8d9e3d2f308fbaa3cef072c6bf"
Jul 17 06:16:34.559864 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:34.559849    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs_odh-ai-gateway-infra(009393d2-2918-40e0-85da-7c0bad43c9ec)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec"
Jul 17 06:16:34.589717 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:34.589667    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:35.703891 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:35.703864    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:35.813847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:35.813807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca\") pod \"009393d2-2918-40e0-85da-7c0bad43c9ec\" (UID: \"009393d2-2918-40e0-85da-7c0bad43c9ec\") "
Jul 17 06:16:35.814163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:35.814139    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "009393d2-2918-40e0-85da-7c0bad43c9ec" (UID: "009393d2-2918-40e0-85da-7c0bad43c9ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:16:35.914746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:35.914617    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/009393d2-2918-40e0-85da-7c0bad43c9ec-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:16:36.573415 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:36.573381    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"
Jul 17 06:16:36.573593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:36.573384    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs" event={"ID":"009393d2-2918-40e0-85da-7c0bad43c9ec","Type":"ContainerDied","Data":"44c5887264043212552ac9921fa03290a3a64cc9f2b16fb7ec132f1f19092cc0"}
Jul 17 06:16:36.573593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:36.573525    2567 scope.go:117] "RemoveContainer" containerID="24639125a1e485195fd565b71be461b5ed787d8d9e3d2f308fbaa3cef072c6bf"
Jul 17 06:16:36.597494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:36.597464    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:36.602127 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:36.602102    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-tqqxs"]
Jul 17 06:16:38.014834 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.014799    2567 scope.go:117] "RemoveContainer" containerID="def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43"
Jul 17 06:16:38.020467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.020439    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" path="/var/lib/kubelet/pods/009393d2-2918-40e0-85da-7c0bad43c9ec/volumes"
Jul 17 06:16:38.588288 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.588258    2567 generic.go:356] "Generic (PLEG): container finished" podID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerID="be2806fdc58fb36260cc490ee8603c08b39edbd15d39229c5a453cbba7bf08da" exitCode=6
Jul 17 06:16:38.588426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.588328    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerDied","Data":"be2806fdc58fb36260cc490ee8603c08b39edbd15d39229c5a453cbba7bf08da"}
Jul 17 06:16:38.588426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.588392    2567 scope.go:117] "RemoveContainer" containerID="def3bf0585890ebb6748e4f69644ec23634b21e7a0317e9f45f89883b7834a43"
Jul 17 06:16:38.588791 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:38.588772    2567 scope.go:117] "RemoveContainer" containerID="be2806fdc58fb36260cc490ee8603c08b39edbd15d39229c5a453cbba7bf08da"
Jul 17 06:16:38.589031 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:38.589009    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r_odh-ai-gateway-infra(05b96741-ec08-48e0-ba71-ee34e6cd628d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d"
Jul 17 06:16:39.614642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:39.614603    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:39.750051 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:39.750024    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:39.851041 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:39.851005    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca\") pod \"05b96741-ec08-48e0-ba71-ee34e6cd628d\" (UID: \"05b96741-ec08-48e0-ba71-ee34e6cd628d\") "
Jul 17 06:16:39.851283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:39.851263    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05b96741-ec08-48e0-ba71-ee34e6cd628d" (UID: "05b96741-ec08-48e0-ba71-ee34e6cd628d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:16:39.952227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:39.952187    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05b96741-ec08-48e0-ba71-ee34e6cd628d-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:16:40.602622 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.602592    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"
Jul 17 06:16:40.602847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.602620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r" event={"ID":"05b96741-ec08-48e0-ba71-ee34e6cd628d","Type":"ContainerDied","Data":"3951b16503c51ae952f8e9dab650fa4123bebd7df0d8a9b3ca95c0949da3bca2"}
Jul 17 06:16:40.602847 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.602706    2567 scope.go:117] "RemoveContainer" containerID="be2806fdc58fb36260cc490ee8603c08b39edbd15d39229c5a453cbba7bf08da"
Jul 17 06:16:40.618636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.618606    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:40.624739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.624713    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zsc8r"]
Jul 17 06:16:40.732306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:16:40.732654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732638    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732666    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732671    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732690    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732697    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732721    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732728    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.732740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732741    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.733014 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732811    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.733014 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732819    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.733014 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732825    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:40.733014 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.732832    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:40.737153 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.737135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:40.739572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.739547    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:16:40.740086 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.740063    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:16:40.743236 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.743214    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:16:40.760010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.759984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-rf4wz\" (UID: \"e56c7b83-cb73-4258-9d98-a3610a268472\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:40.860496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.860404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-rf4wz\" (UID: \"e56c7b83-cb73-4258-9d98-a3610a268472\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:40.861050 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:40.861030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-rf4wz\" (UID: \"e56c7b83-cb73-4258-9d98-a3610a268472\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:41.049810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:41.049773    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:41.186253 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:41.186223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:16:41.188414 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:16:41.188373    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56c7b83_cb73_4258_9d98_a3610a268472.slice/crio-527b6574e8f508765813eae11481bb68b6b81d41b711a5a939fcd01b5cfb07b6 WatchSource:0}: Error finding container 527b6574e8f508765813eae11481bb68b6b81d41b711a5a939fcd01b5cfb07b6: Status 404 returned error can't find the container with id 527b6574e8f508765813eae11481bb68b6b81d41b711a5a939fcd01b5cfb07b6
Jul 17 06:16:41.611186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:41.611146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerStarted","Data":"50593210480cfe147a31ac1a036b782e811098b4ed2ba1ef0416e0c6e5625988"}
Jul 17 06:16:41.611390 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:41.611198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerStarted","Data":"527b6574e8f508765813eae11481bb68b6b81d41b711a5a939fcd01b5cfb07b6"}
Jul 17 06:16:41.627347 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:41.627290    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" podStartSLOduration=1.627273541 podStartE2EDuration="1.627273541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:16:41.625997723 +0000 UTC m=+2620.089181829" watchObservedRunningTime="2026-07-17 06:16:41.627273541 +0000 UTC m=+2620.090457685"
Jul 17 06:16:42.021388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:42.021351    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" path="/var/lib/kubelet/pods/05b96741-ec08-48e0-ba71-ee34e6cd628d/volumes"
Jul 17 06:16:42.617404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:42.617372    2567 generic.go:356] "Generic (PLEG): container finished" podID="e56c7b83-cb73-4258-9d98-a3610a268472" containerID="50593210480cfe147a31ac1a036b782e811098b4ed2ba1ef0416e0c6e5625988" exitCode=6
Jul 17 06:16:42.617608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:42.617473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerDied","Data":"50593210480cfe147a31ac1a036b782e811098b4ed2ba1ef0416e0c6e5625988"}
Jul 17 06:16:42.617736 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:42.617655    2567 scope.go:117] "RemoveContainer" containerID="50593210480cfe147a31ac1a036b782e811098b4ed2ba1ef0416e0c6e5625988"
Jul 17 06:16:43.627551 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:43.627517    2567 generic.go:356] "Generic (PLEG): container finished" podID="e56c7b83-cb73-4258-9d98-a3610a268472" containerID="711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50" exitCode=6
Jul 17 06:16:43.628008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:43.627560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerDied","Data":"711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50"}
Jul 17 06:16:43.628008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:43.627618    2567 scope.go:117] "RemoveContainer" containerID="50593210480cfe147a31ac1a036b782e811098b4ed2ba1ef0416e0c6e5625988"
Jul 17 06:16:43.628008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:43.627819    2567 scope.go:117] "RemoveContainer" containerID="711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50"
Jul 17 06:16:43.628149 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:43.628040    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-rf4wz_odh-ai-gateway-infra(e56c7b83-cb73-4258-9d98-a3610a268472)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" podUID="e56c7b83-cb73-4258-9d98-a3610a268472"
Jul 17 06:16:44.060198 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.060161    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:16:44.060519 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.060507    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:44.060558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.060521    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:44.060608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.060592    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="009393d2-2918-40e0-85da-7c0bad43c9ec" containerName="revoke-keys"
Jul 17 06:16:44.060608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.060603    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b96741-ec08-48e0-ba71-ee34e6cd628d" containerName="revoke-keys"
Jul 17 06:16:44.064636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.064619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:16:44.070054 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.070028    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:16:44.090262 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.090234    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dfcks\" (UID: \"a27f6f52-708b-4512-9cac-2c453a4d46d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:16:44.191782 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.191742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dfcks\" (UID: \"a27f6f52-708b-4512-9cac-2c453a4d46d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:16:44.192819 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.192790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-dfcks\" (UID: \"a27f6f52-708b-4512-9cac-2c453a4d46d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:16:44.376611 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.376519    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:16:44.517410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.517385    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:16:44.519210 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:16:44.519182    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27f6f52_708b_4512_9cac_2c453a4d46d8.slice/crio-885ec3ca8786ffc5683da2bd7771a97dea233fecfa757695c05d26fd0f0b9dcc WatchSource:0}: Error finding container 885ec3ca8786ffc5683da2bd7771a97dea233fecfa757695c05d26fd0f0b9dcc: Status 404 returned error can't find the container with id 885ec3ca8786ffc5683da2bd7771a97dea233fecfa757695c05d26fd0f0b9dcc
Jul 17 06:16:44.634617 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.634520    2567 scope.go:117] "RemoveContainer" containerID="711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50"
Jul 17 06:16:44.635103 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:44.634819    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-rf4wz_odh-ai-gateway-infra(e56c7b83-cb73-4258-9d98-a3610a268472)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" podUID="e56c7b83-cb73-4258-9d98-a3610a268472"
Jul 17 06:16:44.635639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:44.635616    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" event={"ID":"a27f6f52-708b-4512-9cac-2c453a4d46d8","Type":"ContainerStarted","Data":"885ec3ca8786ffc5683da2bd7771a97dea233fecfa757695c05d26fd0f0b9dcc"}
Jul 17 06:16:45.642199 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:45.642159    2567 generic.go:356] "Generic (PLEG): container finished" podID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerID="8e4c78a227f636c36124b9e0d58680586f18f2fa0e50c65b4522607f853b2fbf" exitCode=6
Jul 17 06:16:45.642593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:45.642207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" event={"ID":"a27f6f52-708b-4512-9cac-2c453a4d46d8","Type":"ContainerDied","Data":"8e4c78a227f636c36124b9e0d58680586f18f2fa0e50c65b4522607f853b2fbf"}
Jul 17 06:16:45.642593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:45.642438    2567 scope.go:117] "RemoveContainer" containerID="8e4c78a227f636c36124b9e0d58680586f18f2fa0e50c65b4522607f853b2fbf"
Jul 17 06:16:46.649723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:46.649607    2567 generic.go:356] "Generic (PLEG): container finished" podID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerID="2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8" exitCode=6
Jul 17 06:16:46.649723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:46.649706    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" event={"ID":"a27f6f52-708b-4512-9cac-2c453a4d46d8","Type":"ContainerDied","Data":"2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8"}
Jul 17 06:16:46.650189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:46.649769    2567 scope.go:117] "RemoveContainer" containerID="8e4c78a227f636c36124b9e0d58680586f18f2fa0e50c65b4522607f853b2fbf"
Jul 17 06:16:46.650189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:46.649932    2567 scope.go:117] "RemoveContainer" containerID="2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8"
Jul 17 06:16:46.650189 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:46.650168    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dfcks_odh-ai-gateway-infra(a27f6f52-708b-4512-9cac-2c453a4d46d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8"
Jul 17 06:16:47.658274 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:47.658242    2567 scope.go:117] "RemoveContainer" containerID="2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8"
Jul 17 06:16:47.658709 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:47.658440    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dfcks_odh-ai-gateway-infra(a27f6f52-708b-4512-9cac-2c453a4d46d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8"
Jul 17 06:16:58.020851 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:58.020820    2567 scope.go:117] "RemoveContainer" containerID="711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50"
Jul 17 06:16:58.726855 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:58.726820    2567 generic.go:356] "Generic (PLEG): container finished" podID="e56c7b83-cb73-4258-9d98-a3610a268472" containerID="2b68996ee6ca9a9f18cac0c8d3752e3e9368dcf5e3de73dfcbe021e5ad4242e8" exitCode=6
Jul 17 06:16:58.727035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:58.726900    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerDied","Data":"2b68996ee6ca9a9f18cac0c8d3752e3e9368dcf5e3de73dfcbe021e5ad4242e8"}
Jul 17 06:16:58.727035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:58.727000    2567 scope.go:117] "RemoveContainer" containerID="711d139b6df4f17663f55faf472b30235a8bcc17becd25a96ac497327acbef50"
Jul 17 06:16:58.727339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:58.727323    2567 scope.go:117] "RemoveContainer" containerID="2b68996ee6ca9a9f18cac0c8d3752e3e9368dcf5e3de73dfcbe021e5ad4242e8"
Jul 17 06:16:58.727556 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:16:58.727535    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-rf4wz_odh-ai-gateway-infra(e56c7b83-cb73-4258-9d98-a3610a268472)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" podUID="e56c7b83-cb73-4258-9d98-a3610a268472"
Jul 17 06:16:59.756019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:59.755983    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:16:59.899376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:59.899347    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:16:59.929266 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:59.929233    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca\") pod \"e56c7b83-cb73-4258-9d98-a3610a268472\" (UID: \"e56c7b83-cb73-4258-9d98-a3610a268472\") "
Jul 17 06:16:59.929585 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:16:59.929561    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e56c7b83-cb73-4258-9d98-a3610a268472" (UID: "e56c7b83-cb73-4258-9d98-a3610a268472"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:17:00.029813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.029790    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e56c7b83-cb73-4258-9d98-a3610a268472-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:17:00.740031 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.739996    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"
Jul 17 06:17:00.740217 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.740033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz" event={"ID":"e56c7b83-cb73-4258-9d98-a3610a268472","Type":"ContainerDied","Data":"527b6574e8f508765813eae11481bb68b6b81d41b711a5a939fcd01b5cfb07b6"}
Jul 17 06:17:00.740217 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.740094    2567 scope.go:117] "RemoveContainer" containerID="2b68996ee6ca9a9f18cac0c8d3752e3e9368dcf5e3de73dfcbe021e5ad4242e8"
Jul 17 06:17:00.756555 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.756528    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:17:00.758729 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:00.758674    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-rf4wz"]
Jul 17 06:17:02.022461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:02.022423    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" path="/var/lib/kubelet/pods/e56c7b83-cb73-4258-9d98-a3610a268472/volumes"
Jul 17 06:17:03.014921 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:03.014890    2567 scope.go:117] "RemoveContainer" containerID="2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8"
Jul 17 06:17:03.761968 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:03.761930    2567 generic.go:356] "Generic (PLEG): container finished" podID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerID="dce0bbc39255319bec1b2603938f07b2a93e980def32282c25793334b95469c5" exitCode=6
Jul 17 06:17:03.762388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:03.762016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" event={"ID":"a27f6f52-708b-4512-9cac-2c453a4d46d8","Type":"ContainerDied","Data":"dce0bbc39255319bec1b2603938f07b2a93e980def32282c25793334b95469c5"}
Jul 17 06:17:03.762388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:03.762100    2567 scope.go:117] "RemoveContainer" containerID="2efe07a15a6caef8a07e005e23f872467d705ed0347c2616d2f769a136a934e8"
Jul 17 06:17:03.762516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:03.762444    2567 scope.go:117] "RemoveContainer" containerID="dce0bbc39255319bec1b2603938f07b2a93e980def32282c25793334b95469c5"
Jul 17 06:17:03.762674 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:03.762654    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-dfcks_odh-ai-gateway-infra(a27f6f52-708b-4512-9cac-2c453a4d46d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8"
Jul 17 06:17:04.793593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:04.793561    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:17:04.928275 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:04.928247    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:17:04.970557 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:04.970531    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca\") pod \"a27f6f52-708b-4512-9cac-2c453a4d46d8\" (UID: \"a27f6f52-708b-4512-9cac-2c453a4d46d8\") "
Jul 17 06:17:04.970900 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:04.970880    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a27f6f52-708b-4512-9cac-2c453a4d46d8" (UID: "a27f6f52-708b-4512-9cac-2c453a4d46d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:17:05.071979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.071897    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a27f6f52-708b-4512-9cac-2c453a4d46d8-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:17:05.774892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.774864    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"
Jul 17 06:17:05.775075 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.774895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks" event={"ID":"a27f6f52-708b-4512-9cac-2c453a4d46d8","Type":"ContainerDied","Data":"885ec3ca8786ffc5683da2bd7771a97dea233fecfa757695c05d26fd0f0b9dcc"}
Jul 17 06:17:05.775075 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.774955    2567 scope.go:117] "RemoveContainer" containerID="dce0bbc39255319bec1b2603938f07b2a93e980def32282c25793334b95469c5"
Jul 17 06:17:05.797472 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.797443    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:17:05.818013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:05.817982    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-dfcks"]
Jul 17 06:17:06.021094 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:06.021062    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" path="/var/lib/kubelet/pods/a27f6f52-708b-4512-9cac-2c453a4d46d8/volumes"
Jul 17 06:17:08.072979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.072943    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073275    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073285    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073295    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073301    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073308    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073314    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073325    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073330    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073343    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073348    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.073401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073403    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073411    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073418    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e56c7b83-cb73-4258-9d98-a3610a268472" containerName="revoke-keys"
Jul 17 06:17:08.073885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073425    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.073885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.073430    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:08.077911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.077893    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:08.080727 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.080700    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:17:08.081145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.080743    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:17:08.084954 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.084936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:08.198950 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.198916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc\" (UID: \"4f6668c7-7cec-431a-a743-005cb2a025a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:08.300181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.300134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc\" (UID: \"4f6668c7-7cec-431a-a743-005cb2a025a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:08.300857 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.300834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc\" (UID: \"4f6668c7-7cec-431a-a743-005cb2a025a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:08.390098 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.390014    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:08.522892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.522864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:08.524458 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:17:08.524430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6668c7_7cec_431a_a743_005cb2a025a8.slice/crio-262badc9d66716727e5abde39d85eb4e93a6ea6cc4bf5f9c062fae6b6806f9c0 WatchSource:0}: Error finding container 262badc9d66716727e5abde39d85eb4e93a6ea6cc4bf5f9c062fae6b6806f9c0: Status 404 returned error can't find the container with id 262badc9d66716727e5abde39d85eb4e93a6ea6cc4bf5f9c062fae6b6806f9c0
Jul 17 06:17:08.794482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.794437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerStarted","Data":"ce3f8bf55a42f670e7b4dc1dd909acba2937ba87da5f8b30d5e185d8b2e6ba79"}
Jul 17 06:17:08.794666 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.794504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerStarted","Data":"262badc9d66716727e5abde39d85eb4e93a6ea6cc4bf5f9c062fae6b6806f9c0"}
Jul 17 06:17:08.809367 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:08.809313    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" podStartSLOduration=0.809295926 podStartE2EDuration="809.295926ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:17:08.808918979 +0000 UTC m=+2647.272103095" watchObservedRunningTime="2026-07-17 06:17:08.809295926 +0000 UTC m=+2647.272480033"
Jul 17 06:17:09.801951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:09.801917    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerID="ce3f8bf55a42f670e7b4dc1dd909acba2937ba87da5f8b30d5e185d8b2e6ba79" exitCode=6
Jul 17 06:17:09.802349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:09.802009    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerDied","Data":"ce3f8bf55a42f670e7b4dc1dd909acba2937ba87da5f8b30d5e185d8b2e6ba79"}
Jul 17 06:17:09.802349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:09.802181    2567 scope.go:117] "RemoveContainer" containerID="ce3f8bf55a42f670e7b4dc1dd909acba2937ba87da5f8b30d5e185d8b2e6ba79"
Jul 17 06:17:10.808786 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:10.808754    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerID="3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0" exitCode=6
Jul 17 06:17:10.809260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:10.808843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerDied","Data":"3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0"}
Jul 17 06:17:10.809260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:10.808911    2567 scope.go:117] "RemoveContainer" containerID="ce3f8bf55a42f670e7b4dc1dd909acba2937ba87da5f8b30d5e185d8b2e6ba79"
Jul 17 06:17:10.809260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:10.809146    2567 scope.go:117] "RemoveContainer" containerID="3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0"
Jul 17 06:17:10.809418 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:10.809396    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc_odh-ai-gateway-infra(4f6668c7-7cec-431a-a743-005cb2a025a8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8"
Jul 17 06:17:11.816504 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:11.816479    2567 scope.go:117] "RemoveContainer" containerID="3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0"
Jul 17 06:17:11.816913 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:11.816697    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc_odh-ai-gateway-infra(4f6668c7-7cec-431a-a743-005cb2a025a8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8"
Jul 17 06:17:12.420789 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.420751    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:12.421126 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.421114    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:12.421180 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.421128    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:12.421229 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.421220    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27f6f52-708b-4512-9cac-2c453a4d46d8" containerName="revoke-keys"
Jul 17 06:17:12.425184 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.425166    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:12.431429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.431404    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:12.538614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.538578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9\" (UID: \"b5e27281-34df-4866-9fad-5461a6f20bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:12.639641 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.639578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9\" (UID: \"b5e27281-34df-4866-9fad-5461a6f20bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:12.640249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.640228    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9\" (UID: \"b5e27281-34df-4866-9fad-5461a6f20bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:12.736995 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.736946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:12.879456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:12.879431    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:12.884566 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:17:12.884527    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e27281_34df_4866_9fad_5461a6f20bb4.slice/crio-53cfd43ae837bd309afc3e865e61f104c69505e7ad27cc5ff95bfa37eaa49dc4 WatchSource:0}: Error finding container 53cfd43ae837bd309afc3e865e61f104c69505e7ad27cc5ff95bfa37eaa49dc4: Status 404 returned error can't find the container with id 53cfd43ae837bd309afc3e865e61f104c69505e7ad27cc5ff95bfa37eaa49dc4
Jul 17 06:17:13.224087 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:13.224056    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:17:13.831099 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:13.831010    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerID="df67eedcba7efe73f9d07426ec67a4acd27be7d45bf2d491b2fa340ae81a893a" exitCode=6
Jul 17 06:17:13.831246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:13.831093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" event={"ID":"b5e27281-34df-4866-9fad-5461a6f20bb4","Type":"ContainerDied","Data":"df67eedcba7efe73f9d07426ec67a4acd27be7d45bf2d491b2fa340ae81a893a"}
Jul 17 06:17:13.831246 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:13.831140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" event={"ID":"b5e27281-34df-4866-9fad-5461a6f20bb4","Type":"ContainerStarted","Data":"53cfd43ae837bd309afc3e865e61f104c69505e7ad27cc5ff95bfa37eaa49dc4"}
Jul 17 06:17:13.831330 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:13.831279    2567 scope.go:117] "RemoveContainer" containerID="df67eedcba7efe73f9d07426ec67a4acd27be7d45bf2d491b2fa340ae81a893a"
Jul 17 06:17:14.838421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:14.838331    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerID="77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54" exitCode=6
Jul 17 06:17:14.838421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:14.838368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" event={"ID":"b5e27281-34df-4866-9fad-5461a6f20bb4","Type":"ContainerDied","Data":"77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54"}
Jul 17 06:17:14.838421 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:14.838411    2567 scope.go:117] "RemoveContainer" containerID="df67eedcba7efe73f9d07426ec67a4acd27be7d45bf2d491b2fa340ae81a893a"
Jul 17 06:17:14.838964 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:14.838637    2567 scope.go:117] "RemoveContainer" containerID="77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54"
Jul 17 06:17:14.838964 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:14.838924    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9_odh-ai-gateway-infra(b5e27281-34df-4866-9fad-5461a6f20bb4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4"
Jul 17 06:17:15.844853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:15.844820    2567 scope.go:117] "RemoveContainer" containerID="77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54"
Jul 17 06:17:15.845333 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:15.845057    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9_odh-ai-gateway-infra(b5e27281-34df-4866-9fad-5461a6f20bb4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4"
Jul 17 06:17:22.018709 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:22.018666    2567 scope.go:117] "RemoveContainer" containerID="3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0"
Jul 17 06:17:22.884210 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:22.884127    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerID="e8fc21e5707db012743e3db2658b16b29841c0a281f7b1888981038a1ec6e6af" exitCode=6
Jul 17 06:17:22.884210 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:22.884194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerDied","Data":"e8fc21e5707db012743e3db2658b16b29841c0a281f7b1888981038a1ec6e6af"}
Jul 17 06:17:22.884393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:22.884264    2567 scope.go:117] "RemoveContainer" containerID="3d41aea5ee7b79002310f751ef22abef712c449d0d357adba6689393a5a6a8f0"
Jul 17 06:17:22.884605 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:22.884577    2567 scope.go:117] "RemoveContainer" containerID="e8fc21e5707db012743e3db2658b16b29841c0a281f7b1888981038a1ec6e6af"
Jul 17 06:17:22.884859 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:22.884834    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc_odh-ai-gateway-infra(4f6668c7-7cec-431a-a743-005cb2a025a8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8"
Jul 17 06:17:23.911761 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:23.911722    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:24.049422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.049396    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:24.145908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.145870    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca\") pod \"4f6668c7-7cec-431a-a743-005cb2a025a8\" (UID: \"4f6668c7-7cec-431a-a743-005cb2a025a8\") "
Jul 17 06:17:24.146237 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.146213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f6668c7-7cec-431a-a743-005cb2a025a8" (UID: "4f6668c7-7cec-431a-a743-005cb2a025a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:17:24.246843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.246809    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f6668c7-7cec-431a-a743-005cb2a025a8-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:17:24.899993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.899964    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"
Jul 17 06:17:24.899993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.899971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc" event={"ID":"4f6668c7-7cec-431a-a743-005cb2a025a8","Type":"ContainerDied","Data":"262badc9d66716727e5abde39d85eb4e93a6ea6cc4bf5f9c062fae6b6806f9c0"}
Jul 17 06:17:24.900219 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.900026    2567 scope.go:117] "RemoveContainer" containerID="e8fc21e5707db012743e3db2658b16b29841c0a281f7b1888981038a1ec6e6af"
Jul 17 06:17:24.926744 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.926710    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:24.932568 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:24.932543    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-2rvpc"]
Jul 17 06:17:26.021442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:26.021405    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" path="/var/lib/kubelet/pods/4f6668c7-7cec-431a-a743-005cb2a025a8/volumes"
Jul 17 06:17:27.823541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:27.823508    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:17:28.015146 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:28.015117    2567 scope.go:117] "RemoveContainer" containerID="77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54"
Jul 17 06:17:28.925600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:28.925512    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerID="36bf1a297998ef0a5bb8f86e2306b9447ac49a694add0851b90f6e30136085fc" exitCode=6
Jul 17 06:17:28.925600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:28.925587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" event={"ID":"b5e27281-34df-4866-9fad-5461a6f20bb4","Type":"ContainerDied","Data":"36bf1a297998ef0a5bb8f86e2306b9447ac49a694add0851b90f6e30136085fc"}
Jul 17 06:17:28.926229 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:28.925659    2567 scope.go:117] "RemoveContainer" containerID="77381d4ab0f90819559eebb6b236b49bafb100952d51933e928b697d566b6e54"
Jul 17 06:17:28.926229 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:28.925973    2567 scope.go:117] "RemoveContainer" containerID="36bf1a297998ef0a5bb8f86e2306b9447ac49a694add0851b90f6e30136085fc"
Jul 17 06:17:28.926229 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:28.926170    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9_odh-ai-gateway-infra(b5e27281-34df-4866-9fad-5461a6f20bb4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4"
Jul 17 06:17:29.960908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:29.960876    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:30.093155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.093132    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:30.198643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.198611    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca\") pod \"b5e27281-34df-4866-9fad-5461a6f20bb4\" (UID: \"b5e27281-34df-4866-9fad-5461a6f20bb4\") "
Jul 17 06:17:30.198987 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.198965    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5e27281-34df-4866-9fad-5461a6f20bb4" (UID: "b5e27281-34df-4866-9fad-5461a6f20bb4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:17:30.299924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.299838    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e27281-34df-4866-9fad-5461a6f20bb4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:17:30.946587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.946556    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"
Jul 17 06:17:30.946587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.946564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9" event={"ID":"b5e27281-34df-4866-9fad-5461a6f20bb4","Type":"ContainerDied","Data":"53cfd43ae837bd309afc3e865e61f104c69505e7ad27cc5ff95bfa37eaa49dc4"}
Jul 17 06:17:30.946853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.946658    2567 scope.go:117] "RemoveContainer" containerID="36bf1a297998ef0a5bb8f86e2306b9447ac49a694add0851b90f6e30136085fc"
Jul 17 06:17:30.970950 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.970924    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:30.982928 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:30.982897    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-x2kh9"]
Jul 17 06:17:32.021422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:32.021387    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" path="/var/lib/kubelet/pods/b5e27281-34df-4866-9fad-5461a6f20bb4/volumes"
Jul 17 06:17:40.804940 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.804902    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805253    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805264    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805273    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805278    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805285    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805291    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805305    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805311    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805324    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805329    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805337    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805343    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805400    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805408    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805415    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805423    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e27281-34df-4866-9fad-5461a6f20bb4" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805430    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.805546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.805435    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f6668c7-7cec-431a-a743-005cb2a025a8" containerName="revoke-keys"
Jul 17 06:17:40.808401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.808381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:17:40.814287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.814262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:17:40.814419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.814267    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:17:40.834881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.834846    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:17:40.889310 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.889273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-fmzml\" (UID: \"7a8fe294-781a-4ddd-a532-aa9b3b441b2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:17:40.989871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.989837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-fmzml\" (UID: \"7a8fe294-781a-4ddd-a532-aa9b3b441b2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:17:40.990494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:40.990472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-fmzml\" (UID: \"7a8fe294-781a-4ddd-a532-aa9b3b441b2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:17:41.118007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:41.117898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:17:41.477512 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:41.477484    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:17:41.478890 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:17:41.478858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8fe294_781a_4ddd_a532_aa9b3b441b2c.slice/crio-1ed0bca252c93cea035b9c33cceea6fb81ba50ac9ad9f0e7f84bd78f22cb9425 WatchSource:0}: Error finding container 1ed0bca252c93cea035b9c33cceea6fb81ba50ac9ad9f0e7f84bd78f22cb9425: Status 404 returned error can't find the container with id 1ed0bca252c93cea035b9c33cceea6fb81ba50ac9ad9f0e7f84bd78f22cb9425
Jul 17 06:17:42.008763 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:42.008724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerStarted","Data":"e747fbbbe5d0fe0f9a3edc0a5bba5b3264f063448451290fc835c177f6b0cd3e"}
Jul 17 06:17:42.009139 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:42.008786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerStarted","Data":"1ed0bca252c93cea035b9c33cceea6fb81ba50ac9ad9f0e7f84bd78f22cb9425"}
Jul 17 06:17:42.030378 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:42.030324    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" podStartSLOduration=2.030308299 podStartE2EDuration="2.030308299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:17:42.028216813 +0000 UTC m=+2680.491400917" watchObservedRunningTime="2026-07-17 06:17:42.030308299 +0000 UTC m=+2680.493492403"
Jul 17 06:17:43.016213 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:43.016169    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerID="e747fbbbe5d0fe0f9a3edc0a5bba5b3264f063448451290fc835c177f6b0cd3e" exitCode=6
Jul 17 06:17:43.016618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:43.016221    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerDied","Data":"e747fbbbe5d0fe0f9a3edc0a5bba5b3264f063448451290fc835c177f6b0cd3e"}
Jul 17 06:17:43.016618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:43.016496    2567 scope.go:117] "RemoveContainer" containerID="e747fbbbe5d0fe0f9a3edc0a5bba5b3264f063448451290fc835c177f6b0cd3e"
Jul 17 06:17:44.023576 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.023546    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerID="6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2" exitCode=6
Jul 17 06:17:44.024070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.023599    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerDied","Data":"6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2"}
Jul 17 06:17:44.024070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.023646    2567 scope.go:117] "RemoveContainer" containerID="e747fbbbe5d0fe0f9a3edc0a5bba5b3264f063448451290fc835c177f6b0cd3e"
Jul 17 06:17:44.024070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.023867    2567 scope.go:117] "RemoveContainer" containerID="6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2"
Jul 17 06:17:44.024245 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:44.024115    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-fmzml_odh-ai-gateway-infra(7a8fe294-781a-4ddd-a532-aa9b3b441b2c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c"
Jul 17 06:17:44.134891 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.134855    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:17:44.139427 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.139410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:17:44.153300 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.153274    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:17:44.218269 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.218239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xp95w\" (UID: \"1d31ab20-1801-4621-b91f-2fc35e0b14e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:17:44.319797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.319702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xp95w\" (UID: \"1d31ab20-1801-4621-b91f-2fc35e0b14e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:17:44.320349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.320329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xp95w\" (UID: \"1d31ab20-1801-4621-b91f-2fc35e0b14e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:17:44.449037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.449005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:17:44.603300 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:44.603268    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:17:44.604602 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:17:44.604567    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d31ab20_1801_4621_b91f_2fc35e0b14e7.slice/crio-477b97645c4443e0b421e56608ad23d89656230c27799c91e524db4d4cd38b6e WatchSource:0}: Error finding container 477b97645c4443e0b421e56608ad23d89656230c27799c91e524db4d4cd38b6e: Status 404 returned error can't find the container with id 477b97645c4443e0b421e56608ad23d89656230c27799c91e524db4d4cd38b6e
Jul 17 06:17:45.031115 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:45.031084    2567 scope.go:117] "RemoveContainer" containerID="6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2"
Jul 17 06:17:45.031584 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:45.031326    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-fmzml_odh-ai-gateway-infra(7a8fe294-781a-4ddd-a532-aa9b3b441b2c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c"
Jul 17 06:17:45.032414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:45.032390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerStarted","Data":"b39e7abf1bd9b4e8f4055f0bb5585d292558e47ea288ce66b71e5e040306ad7f"}
Jul 17 06:17:45.032523 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:45.032437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerStarted","Data":"477b97645c4443e0b421e56608ad23d89656230c27799c91e524db4d4cd38b6e"}
Jul 17 06:17:45.081178 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:45.081128    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" podStartSLOduration=1.081113152 podStartE2EDuration="1.081113152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:17:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:17:45.080738322 +0000 UTC m=+2683.543922425" watchObservedRunningTime="2026-07-17 06:17:45.081113152 +0000 UTC m=+2683.544297255"
Jul 17 06:17:46.039164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:46.039131    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerID="b39e7abf1bd9b4e8f4055f0bb5585d292558e47ea288ce66b71e5e040306ad7f" exitCode=6
Jul 17 06:17:46.039564 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:46.039177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerDied","Data":"b39e7abf1bd9b4e8f4055f0bb5585d292558e47ea288ce66b71e5e040306ad7f"}
Jul 17 06:17:46.039564 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:46.039363    2567 scope.go:117] "RemoveContainer" containerID="b39e7abf1bd9b4e8f4055f0bb5585d292558e47ea288ce66b71e5e040306ad7f"
Jul 17 06:17:47.046757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:47.046652    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerID="591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a" exitCode=6
Jul 17 06:17:47.046757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:47.046741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerDied","Data":"591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a"}
Jul 17 06:17:47.047216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:47.046807    2567 scope.go:117] "RemoveContainer" containerID="b39e7abf1bd9b4e8f4055f0bb5585d292558e47ea288ce66b71e5e040306ad7f"
Jul 17 06:17:47.047216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:47.047001    2567 scope.go:117] "RemoveContainer" containerID="591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a"
Jul 17 06:17:47.047299 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:47.047243    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xp95w_odh-ai-gateway-infra(1d31ab20-1801-4621-b91f-2fc35e0b14e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7"
Jul 17 06:17:48.053471 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:48.053438    2567 scope.go:117] "RemoveContainer" containerID="591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a"
Jul 17 06:17:48.053871 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:17:48.053656    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xp95w_odh-ai-gateway-infra(1d31ab20-1801-4621-b91f-2fc35e0b14e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7"
Jul 17 06:17:58.135918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.135840    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:17:58.140643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.140625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:17:58.147249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.147223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:17:58.245190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.245144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd\" (UID: \"a79cf381-8b4e-45f8-a06b-7dc1798295a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:17:58.346797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.346751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd\" (UID: \"a79cf381-8b4e-45f8-a06b-7dc1798295a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:17:58.347415 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.347386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd\" (UID: \"a79cf381-8b4e-45f8-a06b-7dc1798295a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:17:58.453120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.453086    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:17:58.592948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:58.592926    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:17:58.594298 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:17:58.594272    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79cf381_8b4e_45f8_a06b_7dc1798295a3.slice/crio-aa0839d3d55110b0a596ffede75ca1ac3ef2092b4ab20a123200226676c167ef WatchSource:0}: Error finding container aa0839d3d55110b0a596ffede75ca1ac3ef2092b4ab20a123200226676c167ef: Status 404 returned error can't find the container with id aa0839d3d55110b0a596ffede75ca1ac3ef2092b4ab20a123200226676c167ef
Jul 17 06:17:59.015254 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:59.015221    2567 scope.go:117] "RemoveContainer" containerID="591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a"
Jul 17 06:17:59.115592 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:59.115556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerStarted","Data":"626f0805a6133abba944af1c86ba5be36920fe2245b60c2c8ec1b9c586c8f906"}
Jul 17 06:17:59.115812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:59.115614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerStarted","Data":"aa0839d3d55110b0a596ffede75ca1ac3ef2092b4ab20a123200226676c167ef"}
Jul 17 06:17:59.136375 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:17:59.136322    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" podStartSLOduration=1.136305726 podStartE2EDuration="1.136305726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:17:59.133755608 +0000 UTC m=+2697.596939713" watchObservedRunningTime="2026-07-17 06:17:59.136305726 +0000 UTC m=+2697.599489884"
Jul 17 06:18:00.015431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.015393    2567 scope.go:117] "RemoveContainer" containerID="6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2"
Jul 17 06:18:00.122994 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.122964    2567 generic.go:356] "Generic (PLEG): container finished" podID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerID="626f0805a6133abba944af1c86ba5be36920fe2245b60c2c8ec1b9c586c8f906" exitCode=6
Jul 17 06:18:00.123200 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.123059    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerDied","Data":"626f0805a6133abba944af1c86ba5be36920fe2245b60c2c8ec1b9c586c8f906"}
Jul 17 06:18:00.123280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.123268    2567 scope.go:117] "RemoveContainer" containerID="626f0805a6133abba944af1c86ba5be36920fe2245b60c2c8ec1b9c586c8f906"
Jul 17 06:18:00.124962 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.124942    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerID="7ccfdf9737ef7ee17b4cad3ef00e44316f4215b7b9bbc259832115390fa0ac0d" exitCode=6
Jul 17 06:18:00.125068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.125017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerDied","Data":"7ccfdf9737ef7ee17b4cad3ef00e44316f4215b7b9bbc259832115390fa0ac0d"}
Jul 17 06:18:00.125121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.125077    2567 scope.go:117] "RemoveContainer" containerID="591da12489b21054c67d65e4b75dc77eea012b9116a86533cab19afa6381a25a"
Jul 17 06:18:00.125352 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:00.125336    2567 scope.go:117] "RemoveContainer" containerID="7ccfdf9737ef7ee17b4cad3ef00e44316f4215b7b9bbc259832115390fa0ac0d"
Jul 17 06:18:00.125620 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:00.125552    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xp95w_odh-ai-gateway-infra(1d31ab20-1801-4621-b91f-2fc35e0b14e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7"
Jul 17 06:18:01.133376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.133346    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerID="dec11d98e5d115b18ce37c37d9e55d2c228b370fb8a1b844ea7ee9f4cb3a6e94" exitCode=6
Jul 17 06:18:01.133866 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.133418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerDied","Data":"dec11d98e5d115b18ce37c37d9e55d2c228b370fb8a1b844ea7ee9f4cb3a6e94"}
Jul 17 06:18:01.133866 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.133477    2567 scope.go:117] "RemoveContainer" containerID="6704251ab0f1c59024433816ae3f2e2d30799002de7bf38a72866319eca6a6f2"
Jul 17 06:18:01.133866 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.133815    2567 scope.go:117] "RemoveContainer" containerID="dec11d98e5d115b18ce37c37d9e55d2c228b370fb8a1b844ea7ee9f4cb3a6e94"
Jul 17 06:18:01.134068 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:01.134048    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-fmzml_odh-ai-gateway-infra(7a8fe294-781a-4ddd-a532-aa9b3b441b2c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c"
Jul 17 06:18:01.135306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.135286    2567 generic.go:356] "Generic (PLEG): container finished" podID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerID="8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0" exitCode=6
Jul 17 06:18:01.135395 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.135323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerDied","Data":"8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0"}
Jul 17 06:18:01.135554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.135539    2567 scope.go:117] "RemoveContainer" containerID="8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0"
Jul 17 06:18:01.135722 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:01.135705    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd_odh-ai-gateway-infra(a79cf381-8b4e-45f8-a06b-7dc1798295a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3"
Jul 17 06:18:01.145005 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.144987    2567 scope.go:117] "RemoveContainer" containerID="626f0805a6133abba944af1c86ba5be36920fe2245b60c2c8ec1b9c586c8f906"
Jul 17 06:18:01.178060 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.178030    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:18:01.319136 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.319110    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:18:01.377462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.377431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca\") pod \"1d31ab20-1801-4621-b91f-2fc35e0b14e7\" (UID: \"1d31ab20-1801-4621-b91f-2fc35e0b14e7\") "
Jul 17 06:18:01.377797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.377774    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d31ab20-1801-4621-b91f-2fc35e0b14e7" (UID: "1d31ab20-1801-4621-b91f-2fc35e0b14e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:01.479228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:01.479191    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d31ab20-1801-4621-b91f-2fc35e0b14e7-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:02.144167 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.144137    2567 scope.go:117] "RemoveContainer" containerID="8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0"
Jul 17 06:18:02.144622 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:02.144363    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd_odh-ai-gateway-infra(a79cf381-8b4e-45f8-a06b-7dc1798295a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3"
Jul 17 06:18:02.145193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.145172    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"
Jul 17 06:18:02.145193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.145179    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w" event={"ID":"1d31ab20-1801-4621-b91f-2fc35e0b14e7","Type":"ContainerDied","Data":"477b97645c4443e0b421e56608ad23d89656230c27799c91e524db4d4cd38b6e"}
Jul 17 06:18:02.145352 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.145233    2567 scope.go:117] "RemoveContainer" containerID="7ccfdf9737ef7ee17b4cad3ef00e44316f4215b7b9bbc259832115390fa0ac0d"
Jul 17 06:18:02.199922 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.199886    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:18:02.202175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.202145    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:18:02.213752 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.213726    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xp95w"]
Jul 17 06:18:02.279393 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.279317    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:18:02.292446 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.292416    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:18:02.342990 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.342966    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:18:02.477040 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477008    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:02.477370 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477358    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477371    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477380    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477387    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477398    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477404    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477415    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.477419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477420    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.477639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477480    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477489    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.477639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477496    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:02.477639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.477502    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:02.480546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.480526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:02.485728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.485706    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca\") pod \"7a8fe294-781a-4ddd-a532-aa9b3b441b2c\" (UID: \"7a8fe294-781a-4ddd-a532-aa9b3b441b2c\") "
Jul 17 06:18:02.486102 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.486075    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a8fe294-781a-4ddd-a532-aa9b3b441b2c" (UID: "7a8fe294-781a-4ddd-a532-aa9b3b441b2c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:02.493822 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.493794    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:02.586918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.586822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv\" (UID: \"a979f50b-13f6-4dca-8a26-06427b8d3c02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:02.586918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.586889    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8fe294-781a-4ddd-a532-aa9b3b441b2c-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:02.688086 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.688042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv\" (UID: \"a979f50b-13f6-4dca-8a26-06427b8d3c02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:02.688674 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.688653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv\" (UID: \"a979f50b-13f6-4dca-8a26-06427b8d3c02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:02.791238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.791202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:02.946626 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:02.946601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:02.948440 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:18:02.948403    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda979f50b_13f6_4dca_8a26_06427b8d3c02.slice/crio-df94c46870f46390d5db5a22338d7b3f768fc599ceedf1ae8238606839e6d0e4 WatchSource:0}: Error finding container df94c46870f46390d5db5a22338d7b3f768fc599ceedf1ae8238606839e6d0e4: Status 404 returned error can't find the container with id df94c46870f46390d5db5a22338d7b3f768fc599ceedf1ae8238606839e6d0e4
Jul 17 06:18:03.152842 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.152752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerStarted","Data":"df94c46870f46390d5db5a22338d7b3f768fc599ceedf1ae8238606839e6d0e4"}
Jul 17 06:18:03.154116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.154088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml" event={"ID":"7a8fe294-781a-4ddd-a532-aa9b3b441b2c","Type":"ContainerDied","Data":"1ed0bca252c93cea035b9c33cceea6fb81ba50ac9ad9f0e7f84bd78f22cb9425"}
Jul 17 06:18:03.154116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.154106    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"
Jul 17 06:18:03.154341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.154151    2567 scope.go:117] "RemoveContainer" containerID="dec11d98e5d115b18ce37c37d9e55d2c228b370fb8a1b844ea7ee9f4cb3a6e94"
Jul 17 06:18:03.181213 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.181178    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:18:03.181423 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:03.181408    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-fmzml"]
Jul 17 06:18:04.021103 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:04.021067    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" path="/var/lib/kubelet/pods/1d31ab20-1801-4621-b91f-2fc35e0b14e7/volumes"
Jul 17 06:18:04.021404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:04.021391    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" path="/var/lib/kubelet/pods/7a8fe294-781a-4ddd-a532-aa9b3b441b2c/volumes"
Jul 17 06:18:04.161470 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:04.161436    2567 generic.go:356] "Generic (PLEG): container finished" podID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerID="148e03fca207aad2b6f68d718daa1472c5a951c86c2416b7f62fd79d07f38a81" exitCode=6
Jul 17 06:18:04.161955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:04.161528    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerDied","Data":"148e03fca207aad2b6f68d718daa1472c5a951c86c2416b7f62fd79d07f38a81"}
Jul 17 06:18:04.161955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:04.161713    2567 scope.go:117] "RemoveContainer" containerID="148e03fca207aad2b6f68d718daa1472c5a951c86c2416b7f62fd79d07f38a81"
Jul 17 06:18:05.170506 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:05.170404    2567 generic.go:356] "Generic (PLEG): container finished" podID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerID="934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c" exitCode=6
Jul 17 06:18:05.170966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:05.170509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerDied","Data":"934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c"}
Jul 17 06:18:05.170966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:05.170575    2567 scope.go:117] "RemoveContainer" containerID="148e03fca207aad2b6f68d718daa1472c5a951c86c2416b7f62fd79d07f38a81"
Jul 17 06:18:05.170966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:05.170743    2567 scope.go:117] "RemoveContainer" containerID="934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c"
Jul 17 06:18:05.171132 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:05.170976    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv_odh-ai-gateway-infra(a979f50b-13f6-4dca-8a26-06427b8d3c02)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02"
Jul 17 06:18:06.177766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:06.177725    2567 scope.go:117] "RemoveContainer" containerID="934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c"
Jul 17 06:18:06.178189 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:06.177939    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv_odh-ai-gateway-infra(a979f50b-13f6-4dca-8a26-06427b8d3c02)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02"
Jul 17 06:18:15.015724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:15.015665    2567 scope.go:117] "RemoveContainer" containerID="8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0"
Jul 17 06:18:16.237141 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:16.237099    2567 generic.go:356] "Generic (PLEG): container finished" podID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerID="5cf1425871e222c3779fc576d3efd11431b4eae41687a51edb03416ab19cb9f6" exitCode=6
Jul 17 06:18:16.237610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:16.237173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerDied","Data":"5cf1425871e222c3779fc576d3efd11431b4eae41687a51edb03416ab19cb9f6"}
Jul 17 06:18:16.237610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:16.237238    2567 scope.go:117] "RemoveContainer" containerID="8971cf5e90ed87914782cb59b729cb300f7a75fcde3e066afdb687b607c5d0f0"
Jul 17 06:18:16.237610 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:16.237535    2567 scope.go:117] "RemoveContainer" containerID="5cf1425871e222c3779fc576d3efd11431b4eae41687a51edb03416ab19cb9f6"
Jul 17 06:18:16.237841 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:16.237818    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd_odh-ai-gateway-infra(a79cf381-8b4e-45f8-a06b-7dc1798295a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3"
Jul 17 06:18:17.296919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.296883    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:18:17.434131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.434108    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:18:17.460135 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.460098    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:18:17.527019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.526993    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca\") pod \"a79cf381-8b4e-45f8-a06b-7dc1798295a3\" (UID: \"a79cf381-8b4e-45f8-a06b-7dc1798295a3\") "
Jul 17 06:18:17.527341 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.527316    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a79cf381-8b4e-45f8-a06b-7dc1798295a3" (UID: "a79cf381-8b4e-45f8-a06b-7dc1798295a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:17.628339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:17.628249    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a79cf381-8b4e-45f8-a06b-7dc1798295a3-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:18.252232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:18.252194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd" event={"ID":"a79cf381-8b4e-45f8-a06b-7dc1798295a3","Type":"ContainerDied","Data":"aa0839d3d55110b0a596ffede75ca1ac3ef2092b4ab20a123200226676c167ef"}
Jul 17 06:18:18.252232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:18.252228    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"
Jul 17 06:18:18.252489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:18.252268    2567 scope.go:117] "RemoveContainer" containerID="5cf1425871e222c3779fc576d3efd11431b4eae41687a51edb03416ab19cb9f6"
Jul 17 06:18:18.291453 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:18.291387    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:18:18.294874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:18.294851    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-sq5nd"]
Jul 17 06:18:20.021216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:20.021178    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" path="/var/lib/kubelet/pods/a79cf381-8b4e-45f8-a06b-7dc1798295a3/volumes"
Jul 17 06:18:21.015063 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:21.015035    2567 scope.go:117] "RemoveContainer" containerID="934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c"
Jul 17 06:18:21.271292 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:21.271207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerStarted","Data":"66361d23968dbd800f82c495a4b1871c45ec0a7dcb91e7f5abbc1e4b427d4182"}
Jul 17 06:18:21.301726 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:21.301653    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" podStartSLOduration=19.301639937 podStartE2EDuration="19.301639937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:21.3007158 +0000 UTC m=+2719.763899904" watchObservedRunningTime="2026-07-17 06:18:21.301639937 +0000 UTC m=+2719.764824040"
Jul 17 06:18:22.278967 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:22.278934    2567 generic.go:356] "Generic (PLEG): container finished" podID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerID="66361d23968dbd800f82c495a4b1871c45ec0a7dcb91e7f5abbc1e4b427d4182" exitCode=6
Jul 17 06:18:22.279394 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:22.278984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerDied","Data":"66361d23968dbd800f82c495a4b1871c45ec0a7dcb91e7f5abbc1e4b427d4182"}
Jul 17 06:18:22.279394 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:22.279032    2567 scope.go:117] "RemoveContainer" containerID="934b094424a243735585764219d5403bb62e75e833d389d4835486d93caf7d8c"
Jul 17 06:18:22.279394 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:22.279351    2567 scope.go:117] "RemoveContainer" containerID="66361d23968dbd800f82c495a4b1871c45ec0a7dcb91e7f5abbc1e4b427d4182"
Jul 17 06:18:22.279606 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:22.279569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv_odh-ai-gateway-infra(a979f50b-13f6-4dca-8a26-06427b8d3c02)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02"
Jul 17 06:18:22.322285 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:22.322255    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:23.421621 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:23.421592    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:23.582259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:23.582172    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca\") pod \"a979f50b-13f6-4dca-8a26-06427b8d3c02\" (UID: \"a979f50b-13f6-4dca-8a26-06427b8d3c02\") "
Jul 17 06:18:23.582544 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:23.582519    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a979f50b-13f6-4dca-8a26-06427b8d3c02" (UID: "a979f50b-13f6-4dca-8a26-06427b8d3c02"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:23.683429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:23.683394    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a979f50b-13f6-4dca-8a26-06427b8d3c02-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:24.292614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:24.292531    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"
Jul 17 06:18:24.292614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:24.292564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv" event={"ID":"a979f50b-13f6-4dca-8a26-06427b8d3c02","Type":"ContainerDied","Data":"df94c46870f46390d5db5a22338d7b3f768fc599ceedf1ae8238606839e6d0e4"}
Jul 17 06:18:24.292887 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:24.292626    2567 scope.go:117] "RemoveContainer" containerID="66361d23968dbd800f82c495a4b1871c45ec0a7dcb91e7f5abbc1e4b427d4182"
Jul 17 06:18:24.334594 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:24.334562    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:24.341577 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:24.341551    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-zk9dv"]
Jul 17 06:18:26.022196 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:26.022164    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" path="/var/lib/kubelet/pods/a979f50b-13f6-4dca-8a26-06427b8d3c02/volumes"
Jul 17 06:18:28.285905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:28.285870    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:18:34.185070 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185034    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185373    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185383    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185394    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185401    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185410    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185415    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185423    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185428    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185443    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185448    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185455    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185459    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185466    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185471    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185479    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185484    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185539    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.185536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185546    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8fe294-781a-4ddd-a532-aa9b3b441b2c" containerName="revoke-keys"
Jul 17 06:18:34.186149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185557    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d31ab20-1801-4621-b91f-2fc35e0b14e7" containerName="revoke-keys"
Jul 17 06:18:34.186149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185563    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.186149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185568    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:34.186149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185573    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.186149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.185578    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a979f50b-13f6-4dca-8a26-06427b8d3c02" containerName="revoke-keys"
Jul 17 06:18:34.188803 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.188778    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:34.191497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.191477    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:18:34.191609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.191537    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:18:34.197837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.197814    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:34.275518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.275476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj\" (UID: \"bf096809-5eb6-465a-9aff-81f713527d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:34.376628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.376593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj\" (UID: \"bf096809-5eb6-465a-9aff-81f713527d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:34.377262 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.377239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj\" (UID: \"bf096809-5eb6-465a-9aff-81f713527d90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:34.500120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.500084    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:34.649873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:34.649835    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:35.353699 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:35.353648    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerStarted","Data":"3ca9f5f687148a0c175086c4f73b279371808184cbfd2634ffbbafecdec5217b"}
Jul 17 06:18:35.354087 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:35.353713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerStarted","Data":"2a974fa48aea26df67fa9ac412277694eb5461b904b96ec67adfae0ecb7ee278"}
Jul 17 06:18:35.371919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:35.371867    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" podStartSLOduration=1.371850783 podStartE2EDuration="1.371850783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:35.369769533 +0000 UTC m=+2733.832953630" watchObservedRunningTime="2026-07-17 06:18:35.371850783 +0000 UTC m=+2733.835034886"
Jul 17 06:18:36.360962 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:36.360918    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf096809-5eb6-465a-9aff-81f713527d90" containerID="3ca9f5f687148a0c175086c4f73b279371808184cbfd2634ffbbafecdec5217b" exitCode=6
Jul 17 06:18:36.361386 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:36.361045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerDied","Data":"3ca9f5f687148a0c175086c4f73b279371808184cbfd2634ffbbafecdec5217b"}
Jul 17 06:18:36.361386 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:36.361176    2567 scope.go:117] "RemoveContainer" containerID="3ca9f5f687148a0c175086c4f73b279371808184cbfd2634ffbbafecdec5217b"
Jul 17 06:18:37.368471 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:37.368379    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf096809-5eb6-465a-9aff-81f713527d90" containerID="6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931" exitCode=6
Jul 17 06:18:37.368471 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:37.368428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerDied","Data":"6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931"}
Jul 17 06:18:37.368951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:37.368490    2567 scope.go:117] "RemoveContainer" containerID="3ca9f5f687148a0c175086c4f73b279371808184cbfd2634ffbbafecdec5217b"
Jul 17 06:18:37.368951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:37.368660    2567 scope.go:117] "RemoveContainer" containerID="6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931"
Jul 17 06:18:37.368951 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:37.368913    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj_odh-ai-gateway-infra(bf096809-5eb6-465a-9aff-81f713527d90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" podUID="bf096809-5eb6-465a-9aff-81f713527d90"
Jul 17 06:18:38.375528 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:38.375501    2567 scope.go:117] "RemoveContainer" containerID="6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931"
Jul 17 06:18:38.376032 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:38.375790    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj_odh-ai-gateway-infra(bf096809-5eb6-465a-9aff-81f713527d90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" podUID="bf096809-5eb6-465a-9aff-81f713527d90"
Jul 17 06:18:40.887237 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:40.887198    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:18:40.887631 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:40.887622    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79cf381-8b4e-45f8-a06b-7dc1798295a3" containerName="revoke-keys"
Jul 17 06:18:40.890661 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:40.890643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:40.910320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:40.910291    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:18:40.935453 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:40.935410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-49gxb\" (UID: \"3689824e-4f57-4b7f-ac05-c482bcd0c357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:41.036562 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:41.036512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-49gxb\" (UID: \"3689824e-4f57-4b7f-ac05-c482bcd0c357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:41.037257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:41.037233    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-49gxb\" (UID: \"3689824e-4f57-4b7f-ac05-c482bcd0c357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:41.200364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:41.200259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:41.432178 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:41.432149    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:18:41.543174 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:41.543149    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:18:41.544855 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:18:41.544821    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3689824e_4f57_4b7f_ac05_c482bcd0c357.slice/crio-6ebe5f69dfcb43f2b914efe6a8db8e648f686375fddf73403ce63f3e22e0a49b WatchSource:0}: Error finding container 6ebe5f69dfcb43f2b914efe6a8db8e648f686375fddf73403ce63f3e22e0a49b: Status 404 returned error can't find the container with id 6ebe5f69dfcb43f2b914efe6a8db8e648f686375fddf73403ce63f3e22e0a49b
Jul 17 06:18:42.399334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:42.399295    2567 generic.go:356] "Generic (PLEG): container finished" podID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerID="40c92eb1a31c0d3426ff2e4ea96302ff7d9408069b983b4ff0bec36e9a53cef3" exitCode=6
Jul 17 06:18:42.399758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:42.399390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerDied","Data":"40c92eb1a31c0d3426ff2e4ea96302ff7d9408069b983b4ff0bec36e9a53cef3"}
Jul 17 06:18:42.399758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:42.399452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerStarted","Data":"6ebe5f69dfcb43f2b914efe6a8db8e648f686375fddf73403ce63f3e22e0a49b"}
Jul 17 06:18:42.399758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:42.399557    2567 scope.go:117] "RemoveContainer" containerID="40c92eb1a31c0d3426ff2e4ea96302ff7d9408069b983b4ff0bec36e9a53cef3"
Jul 17 06:18:43.406965 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:43.406868    2567 generic.go:356] "Generic (PLEG): container finished" podID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerID="9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4" exitCode=6
Jul 17 06:18:43.407408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:43.406966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerDied","Data":"9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4"}
Jul 17 06:18:43.407408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:43.407027    2567 scope.go:117] "RemoveContainer" containerID="40c92eb1a31c0d3426ff2e4ea96302ff7d9408069b983b4ff0bec36e9a53cef3"
Jul 17 06:18:43.407408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:43.407192    2567 scope.go:117] "RemoveContainer" containerID="9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4"
Jul 17 06:18:43.407579 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:43.407422    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-49gxb_odh-ai-gateway-infra(3689824e-4f57-4b7f-ac05-c482bcd0c357)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357"
Jul 17 06:18:44.420715 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:44.420665    2567 scope.go:117] "RemoveContainer" containerID="9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4"
Jul 17 06:18:44.421104 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:44.420884    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-49gxb_odh-ai-gateway-infra(3689824e-4f57-4b7f-ac05-c482bcd0c357)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357"
Jul 17 06:18:51.983443 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:51.983406    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:18:53.015477 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:53.015444    2567 scope.go:117] "RemoveContainer" containerID="6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931"
Jul 17 06:18:53.477971 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:53.477937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerStarted","Data":"33de50080413d4d9bb7b1f2cd137700f4f3fa02ea2dbef56a479c700f3d84acf"}
Jul 17 06:18:54.485461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:54.485430    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf096809-5eb6-465a-9aff-81f713527d90" containerID="33de50080413d4d9bb7b1f2cd137700f4f3fa02ea2dbef56a479c700f3d84acf" exitCode=6
Jul 17 06:18:54.485917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:54.485493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerDied","Data":"33de50080413d4d9bb7b1f2cd137700f4f3fa02ea2dbef56a479c700f3d84acf"}
Jul 17 06:18:54.485917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:54.485554    2567 scope.go:117] "RemoveContainer" containerID="6420e415f4914d25f0faf523acacd7d8f3cd24873b4181ac0aca61e227431931"
Jul 17 06:18:54.485917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:54.485873    2567 scope.go:117] "RemoveContainer" containerID="33de50080413d4d9bb7b1f2cd137700f4f3fa02ea2dbef56a479c700f3d84acf"
Jul 17 06:18:54.486124 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:54.486096    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj_odh-ai-gateway-infra(bf096809-5eb6-465a-9aff-81f713527d90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" podUID="bf096809-5eb6-465a-9aff-81f713527d90"
Jul 17 06:18:54.539474 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:54.539435    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:55.630539 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:55.630511    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:55.768184 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:55.768092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca\") pod \"bf096809-5eb6-465a-9aff-81f713527d90\" (UID: \"bf096809-5eb6-465a-9aff-81f713527d90\") "
Jul 17 06:18:55.768460 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:55.768437    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf096809-5eb6-465a-9aff-81f713527d90" (UID: "bf096809-5eb6-465a-9aff-81f713527d90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:55.868854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:55.868809    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf096809-5eb6-465a-9aff-81f713527d90-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:56.015141 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.015111    2567 scope.go:117] "RemoveContainer" containerID="9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4"
Jul 17 06:18:56.499588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.499549    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"
Jul 17 06:18:56.499588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.499572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj" event={"ID":"bf096809-5eb6-465a-9aff-81f713527d90","Type":"ContainerDied","Data":"2a974fa48aea26df67fa9ac412277694eb5461b904b96ec67adfae0ecb7ee278"}
Jul 17 06:18:56.499846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.499640    2567 scope.go:117] "RemoveContainer" containerID="33de50080413d4d9bb7b1f2cd137700f4f3fa02ea2dbef56a479c700f3d84acf"
Jul 17 06:18:56.501612 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.501585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerStarted","Data":"09de749da90635341be1416f6b0b5c1edf57205b85a894045d9752fa329976c6"}
Jul 17 06:18:56.527891 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.527774    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:56.530817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.530784    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-l2xcj"]
Jul 17 06:18:56.550993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:56.550939    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" podStartSLOduration=16.550924757 podStartE2EDuration="16.550924757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:56.548039501 +0000 UTC m=+2755.011223611" watchObservedRunningTime="2026-07-17 06:18:56.550924757 +0000 UTC m=+2755.014108860"
Jul 17 06:18:57.509145 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:57.509111    2567 generic.go:356] "Generic (PLEG): container finished" podID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerID="09de749da90635341be1416f6b0b5c1edf57205b85a894045d9752fa329976c6" exitCode=6
Jul 17 06:18:57.509602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:57.509186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerDied","Data":"09de749da90635341be1416f6b0b5c1edf57205b85a894045d9752fa329976c6"}
Jul 17 06:18:57.509602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:57.509278    2567 scope.go:117] "RemoveContainer" containerID="9352f5d4fb0b17a3e9e48971d77eca67738eabad63ff7288811d0b38a11422a4"
Jul 17 06:18:57.509602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:57.509550    2567 scope.go:117] "RemoveContainer" containerID="09de749da90635341be1416f6b0b5c1edf57205b85a894045d9752fa329976c6"
Jul 17 06:18:57.509814 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:18:57.509794    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-49gxb_odh-ai-gateway-infra(3689824e-4f57-4b7f-ac05-c482bcd0c357)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357"
Jul 17 06:18:57.570149 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:57.570117    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:18:58.021053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.021019    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf096809-5eb6-465a-9aff-81f713527d90" path="/var/lib/kubelet/pods/bf096809-5eb6-465a-9aff-81f713527d90/volumes"
Jul 17 06:18:58.212566 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212530    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:18:58.212909 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212896    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.212960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212910    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.212960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212927    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.212960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212932    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.212960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212946    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.212960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.212951    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.213105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.213008    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.213105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.213015    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:18:58.217366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.217345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:18:58.227939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.227911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:18:58.291380 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.291292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln\" (UID: \"636f9b69-5716-4aaf-bb66-dbf0317dd3af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:18:58.392425 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.392381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln\" (UID: \"636f9b69-5716-4aaf-bb66-dbf0317dd3af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:18:58.393081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.393053    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln\" (UID: \"636f9b69-5716-4aaf-bb66-dbf0317dd3af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:18:58.529023 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.528992    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:18:58.678259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.678231    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:58.717325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.717297    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:18:58.728768 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:18:58.728737    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636f9b69_5716_4aaf_bb66_dbf0317dd3af.slice/crio-dced08b9d6b641d8e6b6d51782ab5d7d6ea410947064b2345abd473c70205b6e WatchSource:0}: Error finding container dced08b9d6b641d8e6b6d51782ab5d7d6ea410947064b2345abd473c70205b6e: Status 404 returned error can't find the container with id dced08b9d6b641d8e6b6d51782ab5d7d6ea410947064b2345abd473c70205b6e
Jul 17 06:18:58.796707 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.796604    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca\") pod \"3689824e-4f57-4b7f-ac05-c482bcd0c357\" (UID: \"3689824e-4f57-4b7f-ac05-c482bcd0c357\") "
Jul 17 06:18:58.797020 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.796994    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3689824e-4f57-4b7f-ac05-c482bcd0c357" (UID: "3689824e-4f57-4b7f-ac05-c482bcd0c357"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:18:58.897523 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:58.897500    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3689824e-4f57-4b7f-ac05-c482bcd0c357-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:18:59.524332 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.524302    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"
Jul 17 06:18:59.524534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.524301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb" event={"ID":"3689824e-4f57-4b7f-ac05-c482bcd0c357","Type":"ContainerDied","Data":"6ebe5f69dfcb43f2b914efe6a8db8e648f686375fddf73403ce63f3e22e0a49b"}
Jul 17 06:18:59.524534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.524441    2567 scope.go:117] "RemoveContainer" containerID="09de749da90635341be1416f6b0b5c1edf57205b85a894045d9752fa329976c6"
Jul 17 06:18:59.526027 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.525975    2567 generic.go:356] "Generic (PLEG): container finished" podID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerID="aedddcf9a3460eda34e45472e4c9d9c74b00f8c9f415a1926ce330f41bf42cf2" exitCode=6
Jul 17 06:18:59.526119 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.526052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerDied","Data":"aedddcf9a3460eda34e45472e4c9d9c74b00f8c9f415a1926ce330f41bf42cf2"}
Jul 17 06:18:59.526119 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.526096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerStarted","Data":"dced08b9d6b641d8e6b6d51782ab5d7d6ea410947064b2345abd473c70205b6e"}
Jul 17 06:18:59.526256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.526245    2567 scope.go:117] "RemoveContainer" containerID="aedddcf9a3460eda34e45472e4c9d9c74b00f8c9f415a1926ce330f41bf42cf2"
Jul 17 06:18:59.597424 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.597391    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:18:59.605571 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:18:59.605543    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-49gxb"]
Jul 17 06:19:00.020452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:00.020409    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" path="/var/lib/kubelet/pods/3689824e-4f57-4b7f-ac05-c482bcd0c357/volumes"
Jul 17 06:19:00.534084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:00.534053    2567 generic.go:356] "Generic (PLEG): container finished" podID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerID="073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49" exitCode=6
Jul 17 06:19:00.534261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:00.534139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerDied","Data":"073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49"}
Jul 17 06:19:00.534261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:00.534201    2567 scope.go:117] "RemoveContainer" containerID="aedddcf9a3460eda34e45472e4c9d9c74b00f8c9f415a1926ce330f41bf42cf2"
Jul 17 06:19:00.534413 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:00.534395    2567 scope.go:117] "RemoveContainer" containerID="073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49"
Jul 17 06:19:00.534645 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:00.534612    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln_odh-ai-gateway-infra(636f9b69-5716-4aaf-bb66-dbf0317dd3af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af"
Jul 17 06:19:01.542578 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:01.542552    2567 scope.go:117] "RemoveContainer" containerID="073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49"
Jul 17 06:19:01.542980 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:01.542768    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln_odh-ai-gateway-infra(636f9b69-5716-4aaf-bb66-dbf0317dd3af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af"
Jul 17 06:19:02.546960 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.546927    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:02.547343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547318    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547330    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547342    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547349    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547368    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547375    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547440    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547452    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547462    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3689824e-4f57-4b7f-ac05-c482bcd0c357" containerName="revoke-keys"
Jul 17 06:19:02.547518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.547473    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf096809-5eb6-465a-9aff-81f713527d90" containerName="revoke-keys"
Jul 17 06:19:02.551724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.551706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:02.562881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.562857    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:02.632121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.632082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x\" (UID: \"76579d9a-aaca-4d9b-8922-ee972d18e855\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:02.733204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.733162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x\" (UID: \"76579d9a-aaca-4d9b-8922-ee972d18e855\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:02.733908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.733880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x\" (UID: \"76579d9a-aaca-4d9b-8922-ee972d18e855\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:02.862489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.862404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:02.997324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:02.997290    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:02.998793 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:19:02.998754    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76579d9a_aaca_4d9b_8922_ee972d18e855.slice/crio-c115d4be7e61bc33d8f3ef2403d84ebd436e3bf558225ef9f7f45a19abc5c200 WatchSource:0}: Error finding container c115d4be7e61bc33d8f3ef2403d84ebd436e3bf558225ef9f7f45a19abc5c200: Status 404 returned error can't find the container with id c115d4be7e61bc33d8f3ef2403d84ebd436e3bf558225ef9f7f45a19abc5c200
Jul 17 06:19:03.555562 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:03.555527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerStarted","Data":"6abac04f0bc1eafe66902fbebeda5abd92825c8f127d8fb53afb18ffed631b60"}
Jul 17 06:19:03.556006 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:03.555574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerStarted","Data":"c115d4be7e61bc33d8f3ef2403d84ebd436e3bf558225ef9f7f45a19abc5c200"}
Jul 17 06:19:03.574559 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:03.574510    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" podStartSLOduration=1.57449487 podStartE2EDuration="1.57449487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:19:03.573313933 +0000 UTC m=+2762.036498039" watchObservedRunningTime="2026-07-17 06:19:03.57449487 +0000 UTC m=+2762.037679182"
Jul 17 06:19:04.561911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:04.561872    2567 generic.go:356] "Generic (PLEG): container finished" podID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerID="6abac04f0bc1eafe66902fbebeda5abd92825c8f127d8fb53afb18ffed631b60" exitCode=6
Jul 17 06:19:04.562331 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:04.561962    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerDied","Data":"6abac04f0bc1eafe66902fbebeda5abd92825c8f127d8fb53afb18ffed631b60"}
Jul 17 06:19:04.562331 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:04.562160    2567 scope.go:117] "RemoveContainer" containerID="6abac04f0bc1eafe66902fbebeda5abd92825c8f127d8fb53afb18ffed631b60"
Jul 17 06:19:05.569218 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:05.569126    2567 generic.go:356] "Generic (PLEG): container finished" podID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerID="a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058" exitCode=6
Jul 17 06:19:05.569704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:05.569216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerDied","Data":"a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058"}
Jul 17 06:19:05.569704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:05.569279    2567 scope.go:117] "RemoveContainer" containerID="6abac04f0bc1eafe66902fbebeda5abd92825c8f127d8fb53afb18ffed631b60"
Jul 17 06:19:05.569704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:05.569380    2567 scope.go:117] "RemoveContainer" containerID="a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058"
Jul 17 06:19:05.569704 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:05.569625    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x_odh-ai-gateway-infra(76579d9a-aaca-4d9b-8922-ee972d18e855)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855"
Jul 17 06:19:06.576978 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:06.576952    2567 scope.go:117] "RemoveContainer" containerID="a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058"
Jul 17 06:19:06.577355 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:06.577127    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x_odh-ai-gateway-infra(76579d9a-aaca-4d9b-8922-ee972d18e855)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855"
Jul 17 06:19:09.941825 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:09.941793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:19:13.015767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:13.015738    2567 scope.go:117] "RemoveContainer" containerID="073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49"
Jul 17 06:19:13.614941 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:13.614853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerStarted","Data":"346bbc05491f7a2b83d6883f591587179488ecf4c1a789f1e08273ae47e46ec3"}
Jul 17 06:19:13.639512 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:13.639460    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" podStartSLOduration=15.639444416 podStartE2EDuration="15.639444416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:19:13.639164472 +0000 UTC m=+2772.102348576" watchObservedRunningTime="2026-07-17 06:19:13.639444416 +0000 UTC m=+2772.102628567"
Jul 17 06:19:14.622230 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:14.622199    2567 generic.go:356] "Generic (PLEG): container finished" podID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerID="346bbc05491f7a2b83d6883f591587179488ecf4c1a789f1e08273ae47e46ec3" exitCode=6
Jul 17 06:19:14.622723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:14.622280    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerDied","Data":"346bbc05491f7a2b83d6883f591587179488ecf4c1a789f1e08273ae47e46ec3"}
Jul 17 06:19:14.622723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:14.622348    2567 scope.go:117] "RemoveContainer" containerID="073fb4be7a62b74cdd9c37ec141e716cd204ab519b29906bb3b31929970bef49"
Jul 17 06:19:14.622723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:14.622633    2567 scope.go:117] "RemoveContainer" containerID="346bbc05491f7a2b83d6883f591587179488ecf4c1a789f1e08273ae47e46ec3"
Jul 17 06:19:14.622885 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:14.622864    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln_odh-ai-gateway-infra(636f9b69-5716-4aaf-bb66-dbf0317dd3af)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af"
Jul 17 06:19:14.668606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:14.668573    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:19:15.767127 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:15.767100    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:19:15.856548 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:15.856513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca\") pod \"636f9b69-5716-4aaf-bb66-dbf0317dd3af\" (UID: \"636f9b69-5716-4aaf-bb66-dbf0317dd3af\") "
Jul 17 06:19:15.856903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:15.856879    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "636f9b69-5716-4aaf-bb66-dbf0317dd3af" (UID: "636f9b69-5716-4aaf-bb66-dbf0317dd3af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:15.957203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:15.957174    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/636f9b69-5716-4aaf-bb66-dbf0317dd3af-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:19:16.636058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:16.636029    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"
Jul 17 06:19:16.636238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:16.636063    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln" event={"ID":"636f9b69-5716-4aaf-bb66-dbf0317dd3af","Type":"ContainerDied","Data":"dced08b9d6b641d8e6b6d51782ab5d7d6ea410947064b2345abd473c70205b6e"}
Jul 17 06:19:16.636238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:16.636147    2567 scope.go:117] "RemoveContainer" containerID="346bbc05491f7a2b83d6883f591587179488ecf4c1a789f1e08273ae47e46ec3"
Jul 17 06:19:16.662876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:16.662850    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:19:16.671128 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:16.671105    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-7wjln"]
Jul 17 06:19:18.020472 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:18.020439    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" path="/var/lib/kubelet/pods/636f9b69-5716-4aaf-bb66-dbf0317dd3af/volumes"
Jul 17 06:19:20.015542 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:20.015512    2567 scope.go:117] "RemoveContainer" containerID="a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058"
Jul 17 06:19:20.661951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:20.661862    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerStarted","Data":"404171c2b2d7ef31d5e67018a900253ab7c6afbdd87f55a57a749722a246da2a"}
Jul 17 06:19:21.669134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:21.669103    2567 generic.go:356] "Generic (PLEG): container finished" podID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerID="404171c2b2d7ef31d5e67018a900253ab7c6afbdd87f55a57a749722a246da2a" exitCode=6
Jul 17 06:19:21.669524 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:21.669174    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerDied","Data":"404171c2b2d7ef31d5e67018a900253ab7c6afbdd87f55a57a749722a246da2a"}
Jul 17 06:19:21.669524 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:21.669257    2567 scope.go:117] "RemoveContainer" containerID="a8b3a7d5765f3b4ac2d84db2f0890e630325e86c5d5803ec0a24febcae4f3058"
Jul 17 06:19:21.669635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:21.669531    2567 scope.go:117] "RemoveContainer" containerID="404171c2b2d7ef31d5e67018a900253ab7c6afbdd87f55a57a749722a246da2a"
Jul 17 06:19:21.669789 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:21.669766    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x_odh-ai-gateway-infra(76579d9a-aaca-4d9b-8922-ee972d18e855)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855"
Jul 17 06:19:21.758882 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:21.758846    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:22.813846 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:22.813823    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:22.906324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:22.906284    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca\") pod \"76579d9a-aaca-4d9b-8922-ee972d18e855\" (UID: \"76579d9a-aaca-4d9b-8922-ee972d18e855\") "
Jul 17 06:19:22.906658 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:22.906634    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76579d9a-aaca-4d9b-8922-ee972d18e855" (UID: "76579d9a-aaca-4d9b-8922-ee972d18e855"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:23.007753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.007722    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76579d9a-aaca-4d9b-8922-ee972d18e855-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:19:23.682746 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.682716    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"
Jul 17 06:19:23.682898 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.682715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x" event={"ID":"76579d9a-aaca-4d9b-8922-ee972d18e855","Type":"ContainerDied","Data":"c115d4be7e61bc33d8f3ef2403d84ebd436e3bf558225ef9f7f45a19abc5c200"}
Jul 17 06:19:23.682898 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.682852    2567 scope.go:117] "RemoveContainer" containerID="404171c2b2d7ef31d5e67018a900253ab7c6afbdd87f55a57a749722a246da2a"
Jul 17 06:19:23.732589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.732558    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:23.753727 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:23.753697    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-4gn8x"]
Jul 17 06:19:24.021008 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:24.020980    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" path="/var/lib/kubelet/pods/76579d9a-aaca-4d9b-8922-ee972d18e855/volumes"
Jul 17 06:19:30.949756 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.949717    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950098    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950113    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950126    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950131    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950138    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950144    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950159    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950178    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950235    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950242    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950249    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950255    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.950383 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.950261    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:30.954653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.954636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:30.957478 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.957459    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:19:30.957478 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.957468    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:19:30.965524 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.965498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:30.972642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:30.972616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-swshr\" (UID: \"9290f685-a20d-46f7-9deb-0d25f5838f0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:31.073197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.073161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-swshr\" (UID: \"9290f685-a20d-46f7-9deb-0d25f5838f0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:31.073829 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.073804    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-swshr\" (UID: \"9290f685-a20d-46f7-9deb-0d25f5838f0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:31.265626 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.265525    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:31.411594 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.411566    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:31.413015 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:19:31.412988    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9290f685_a20d_46f7_9deb_0d25f5838f0c.slice/crio-e398d7f312d9a1e040c7d7d937cc46da0266c31cd8a31cffaecd5786de5c05d6 WatchSource:0}: Error finding container e398d7f312d9a1e040c7d7d937cc46da0266c31cd8a31cffaecd5786de5c05d6: Status 404 returned error can't find the container with id e398d7f312d9a1e040c7d7d937cc46da0266c31cd8a31cffaecd5786de5c05d6
Jul 17 06:19:31.733815 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.733774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerStarted","Data":"52072c033b5b8c80e27bcb2611fca66e35dae7ce58c80bf45eb29fb39b78dd97"}
Jul 17 06:19:31.733997 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.733832    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerStarted","Data":"e398d7f312d9a1e040c7d7d937cc46da0266c31cd8a31cffaecd5786de5c05d6"}
Jul 17 06:19:31.756262 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:31.756206    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" podStartSLOduration=1.7561890999999998 podStartE2EDuration="1.7561891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:19:31.754818618 +0000 UTC m=+2790.218002713" watchObservedRunningTime="2026-07-17 06:19:31.7561891 +0000 UTC m=+2790.219373233"
Jul 17 06:19:32.750316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:32.750277    2567 generic.go:356] "Generic (PLEG): container finished" podID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerID="52072c033b5b8c80e27bcb2611fca66e35dae7ce58c80bf45eb29fb39b78dd97" exitCode=6
Jul 17 06:19:32.750831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:32.750367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerDied","Data":"52072c033b5b8c80e27bcb2611fca66e35dae7ce58c80bf45eb29fb39b78dd97"}
Jul 17 06:19:32.750831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:32.750583    2567 scope.go:117] "RemoveContainer" containerID="52072c033b5b8c80e27bcb2611fca66e35dae7ce58c80bf45eb29fb39b78dd97"
Jul 17 06:19:33.758545 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.758509    2567 generic.go:356] "Generic (PLEG): container finished" podID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerID="f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e" exitCode=6
Jul 17 06:19:33.758955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.758596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerDied","Data":"f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e"}
Jul 17 06:19:33.758955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.758652    2567 scope.go:117] "RemoveContainer" containerID="52072c033b5b8c80e27bcb2611fca66e35dae7ce58c80bf45eb29fb39b78dd97"
Jul 17 06:19:33.758955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.758801    2567 scope.go:117] "RemoveContainer" containerID="f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e"
Jul 17 06:19:33.759167 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:33.759041    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-swshr_odh-ai-gateway-infra(9290f685-a20d-46f7-9deb-0d25f5838f0c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c"
Jul 17 06:19:33.848910 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.848873    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"]
Jul 17 06:19:33.849257 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.849245    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:33.849305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.849258    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="76579d9a-aaca-4d9b-8922-ee972d18e855" containerName="revoke-keys"
Jul 17 06:19:33.849340 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.849322    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="636f9b69-5716-4aaf-bb66-dbf0317dd3af" containerName="revoke-keys"
Jul 17 06:19:33.853622 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.853602    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:33.868278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.868256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"]
Jul 17 06:19:33.900374 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:33.900345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp\" (UID: \"4a228003-8f3a-447b-9924-8361a68b2734\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:34.001796 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.001751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp\" (UID: \"4a228003-8f3a-447b-9924-8361a68b2734\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:34.002390 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.002369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp\" (UID: \"4a228003-8f3a-447b-9924-8361a68b2734\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:34.162867 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.162770    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:34.275173 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.275140    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:34.279735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.279710    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:34.299717 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.299670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:34.304516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.304494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs\" (UID: \"f86043d4-3181-4aed-8fb3-617399d5df92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:34.321357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.321331    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"]
Jul 17 06:19:34.322389 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:19:34.322364    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a228003_8f3a_447b_9924_8361a68b2734.slice/crio-b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0 WatchSource:0}: Error finding container b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0: Status 404 returned error can't find the container with id b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0
Jul 17 06:19:34.405739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.405706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs\" (UID: \"f86043d4-3181-4aed-8fb3-617399d5df92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:34.406335 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.406314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs\" (UID: \"f86043d4-3181-4aed-8fb3-617399d5df92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:34.590138 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.590114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:34.759066 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.758454    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:34.761474 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:19:34.761441    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86043d4_3181_4aed_8fb3_617399d5df92.slice/crio-e6fed5af7398d5bc7440568781db42ba7cb8b6fc3406be92b722cadeac8f8b95 WatchSource:0}: Error finding container e6fed5af7398d5bc7440568781db42ba7cb8b6fc3406be92b722cadeac8f8b95: Status 404 returned error can't find the container with id e6fed5af7398d5bc7440568781db42ba7cb8b6fc3406be92b722cadeac8f8b95
Jul 17 06:19:34.767403 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.767383    2567 scope.go:117] "RemoveContainer" containerID="f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e"
Jul 17 06:19:34.767571 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:34.767547    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-swshr_odh-ai-gateway-infra(9290f685-a20d-46f7-9deb-0d25f5838f0c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c"
Jul 17 06:19:34.768811 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.768787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp" event={"ID":"4a228003-8f3a-447b-9924-8361a68b2734","Type":"ContainerStarted","Data":"9bdbb67f70f29330d4c84f2d9f43095ae05132d95d82701153285a29fd6060f7"}
Jul 17 06:19:34.768919 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.768834    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp" event={"ID":"4a228003-8f3a-447b-9924-8361a68b2734","Type":"ContainerStarted","Data":"b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0"}
Jul 17 06:19:34.823184 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:34.823134    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp" podStartSLOduration=1.823118762 podStartE2EDuration="1.823118762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:19:34.819202243 +0000 UTC m=+2793.282386348" watchObservedRunningTime="2026-07-17 06:19:34.823118762 +0000 UTC m=+2793.286302901"
Jul 17 06:19:35.775512 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.775471    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a228003-8f3a-447b-9924-8361a68b2734" containerID="9bdbb67f70f29330d4c84f2d9f43095ae05132d95d82701153285a29fd6060f7" exitCode=0
Jul 17 06:19:35.776002 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.775560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp" event={"ID":"4a228003-8f3a-447b-9924-8361a68b2734","Type":"ContainerDied","Data":"9bdbb67f70f29330d4c84f2d9f43095ae05132d95d82701153285a29fd6060f7"}
Jul 17 06:19:35.777172 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.777146    2567 generic.go:356] "Generic (PLEG): container finished" podID="f86043d4-3181-4aed-8fb3-617399d5df92" containerID="48b7d65429c803a2f260a031e6f60bd02c73ed587999219cade1c6704e8aae95" exitCode=6
Jul 17 06:19:35.777304 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.777170    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" event={"ID":"f86043d4-3181-4aed-8fb3-617399d5df92","Type":"ContainerDied","Data":"48b7d65429c803a2f260a031e6f60bd02c73ed587999219cade1c6704e8aae95"}
Jul 17 06:19:35.777304 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.777213    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" event={"ID":"f86043d4-3181-4aed-8fb3-617399d5df92","Type":"ContainerStarted","Data":"e6fed5af7398d5bc7440568781db42ba7cb8b6fc3406be92b722cadeac8f8b95"}
Jul 17 06:19:35.777441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:35.777423    2567 scope.go:117] "RemoveContainer" containerID="48b7d65429c803a2f260a031e6f60bd02c73ed587999219cade1c6704e8aae95"
Jul 17 06:19:36.785289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:36.785199    2567 generic.go:356] "Generic (PLEG): container finished" podID="f86043d4-3181-4aed-8fb3-617399d5df92" containerID="2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6" exitCode=6
Jul 17 06:19:36.785819 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:36.785297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" event={"ID":"f86043d4-3181-4aed-8fb3-617399d5df92","Type":"ContainerDied","Data":"2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6"}
Jul 17 06:19:36.785819 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:36.785371    2567 scope.go:117] "RemoveContainer" containerID="48b7d65429c803a2f260a031e6f60bd02c73ed587999219cade1c6704e8aae95"
Jul 17 06:19:36.785819 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:36.785562    2567 scope.go:117] "RemoveContainer" containerID="2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6"
Jul 17 06:19:36.786013 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:36.785830    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs_odh-ai-gateway-infra(f86043d4-3181-4aed-8fb3-617399d5df92)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" podUID="f86043d4-3181-4aed-8fb3-617399d5df92"
Jul 17 06:19:36.916414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:36.916385    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:37.032262 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.032225    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca\") pod \"4a228003-8f3a-447b-9924-8361a68b2734\" (UID: \"4a228003-8f3a-447b-9924-8361a68b2734\") "
Jul 17 06:19:37.032627 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.032606    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a228003-8f3a-447b-9924-8361a68b2734" (UID: "4a228003-8f3a-447b-9924-8361a68b2734"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:37.133608 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.133525    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a228003-8f3a-447b-9924-8361a68b2734-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:19:37.792884 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.792843    2567 scope.go:117] "RemoveContainer" containerID="2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6"
Jul 17 06:19:37.793341 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:37.793059    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs_odh-ai-gateway-infra(f86043d4-3181-4aed-8fb3-617399d5df92)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" podUID="f86043d4-3181-4aed-8fb3-617399d5df92"
Jul 17 06:19:37.793998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.793975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp" event={"ID":"4a228003-8f3a-447b-9924-8361a68b2734","Type":"ContainerDied","Data":"b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0"}
Jul 17 06:19:37.794080 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.793996    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp"
Jul 17 06:19:37.794080 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.794018    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5606abc025f2842aaa9831913ad52f08848eb5a49bdc1f97abdadaadd938ad0"
Jul 17 06:19:37.973775 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:37.973740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:19:46.019225 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:46.019194    2567 scope.go:117] "RemoveContainer" containerID="f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e"
Jul 17 06:19:46.845543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:46.845454    2567 generic.go:356] "Generic (PLEG): container finished" podID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerID="2a5c8b3b73f4eba90e126df89c2e1f3c967fcedb0246cd71b1ecc2e43317f81c" exitCode=6
Jul 17 06:19:46.845543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:46.845532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerDied","Data":"2a5c8b3b73f4eba90e126df89c2e1f3c967fcedb0246cd71b1ecc2e43317f81c"}
Jul 17 06:19:46.845813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:46.845592    2567 scope.go:117] "RemoveContainer" containerID="f1b24dd79b3ab95bb1bc20d24fdebd4b81767bc0ecd13fe7ebba53752515290e"
Jul 17 06:19:46.845925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:46.845909    2567 scope.go:117] "RemoveContainer" containerID="2a5c8b3b73f4eba90e126df89c2e1f3c967fcedb0246cd71b1ecc2e43317f81c"
Jul 17 06:19:46.846150 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:46.846128    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-swshr_odh-ai-gateway-infra(9290f685-a20d-46f7-9deb-0d25f5838f0c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c"
Jul 17 06:19:47.898195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:47.898167    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:48.053535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.053508    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:48.132313 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.132281    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca\") pod \"9290f685-a20d-46f7-9deb-0d25f5838f0c\" (UID: \"9290f685-a20d-46f7-9deb-0d25f5838f0c\") "
Jul 17 06:19:48.132645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.132623    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9290f685-a20d-46f7-9deb-0d25f5838f0c" (UID: "9290f685-a20d-46f7-9deb-0d25f5838f0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:48.233495 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.233450    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9290f685-a20d-46f7-9deb-0d25f5838f0c-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:19:48.321284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321246    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:19:48.321618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321606    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.321663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321620    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.321663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321629    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.321663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321635    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.321663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321643    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a228003-8f3a-447b-9924-8361a68b2734" containerName="revoke-keys"
Jul 17 06:19:48.321663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321649    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a228003-8f3a-447b-9924-8361a68b2734" containerName="revoke-keys"
Jul 17 06:19:48.321850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321724    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a228003-8f3a-447b-9924-8361a68b2734" containerName="revoke-keys"
Jul 17 06:19:48.321850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321732    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.321850 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.321739    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:48.324874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.324857    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:19:48.333609 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.333576    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:19:48.435135 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.435095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff\" (UID: \"f693caa8-67ea-4b46-9301-af7de2b9c12e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:19:48.536221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.536130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff\" (UID: \"f693caa8-67ea-4b46-9301-af7de2b9c12e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:19:48.536868 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.536849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff\" (UID: \"f693caa8-67ea-4b46-9301-af7de2b9c12e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:19:48.636554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.636520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:19:48.772787 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.772754    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:19:48.773554 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:19:48.773532    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf693caa8_67ea_4b46_9301_af7de2b9c12e.slice/crio-1d09919aa51abcd72ed90175765d30c4854cb73dd9e09b74797df11b570fbdca WatchSource:0}: Error finding container 1d09919aa51abcd72ed90175765d30c4854cb73dd9e09b74797df11b570fbdca: Status 404 returned error can't find the container with id 1d09919aa51abcd72ed90175765d30c4854cb73dd9e09b74797df11b570fbdca
Jul 17 06:19:48.859103 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.859076    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"
Jul 17 06:19:48.859295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.859117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr" event={"ID":"9290f685-a20d-46f7-9deb-0d25f5838f0c","Type":"ContainerDied","Data":"e398d7f312d9a1e040c7d7d937cc46da0266c31cd8a31cffaecd5786de5c05d6"}
Jul 17 06:19:48.859295 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.859182    2567 scope.go:117] "RemoveContainer" containerID="2a5c8b3b73f4eba90e126df89c2e1f3c967fcedb0246cd71b1ecc2e43317f81c"
Jul 17 06:19:48.860489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.860456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" event={"ID":"f693caa8-67ea-4b46-9301-af7de2b9c12e","Type":"ContainerStarted","Data":"1d09919aa51abcd72ed90175765d30c4854cb73dd9e09b74797df11b570fbdca"}
Jul 17 06:19:48.884671 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.884641    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:48.888924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:48.888900    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-swshr"]
Jul 17 06:19:49.868201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:49.868159    2567 generic.go:356] "Generic (PLEG): container finished" podID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerID="b5ca37a487fe937cf19b5835993e2cdcc8d464a9ceb2cce3bc5eea10ee6ca3ed" exitCode=6
Jul 17 06:19:49.868629 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:49.868245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" event={"ID":"f693caa8-67ea-4b46-9301-af7de2b9c12e","Type":"ContainerDied","Data":"b5ca37a487fe937cf19b5835993e2cdcc8d464a9ceb2cce3bc5eea10ee6ca3ed"}
Jul 17 06:19:49.868629 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:49.868398    2567 scope.go:117] "RemoveContainer" containerID="b5ca37a487fe937cf19b5835993e2cdcc8d464a9ceb2cce3bc5eea10ee6ca3ed"
Jul 17 06:19:50.014879 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.014849    2567 scope.go:117] "RemoveContainer" containerID="2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6"
Jul 17 06:19:50.021395 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.021367    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" path="/var/lib/kubelet/pods/9290f685-a20d-46f7-9deb-0d25f5838f0c/volumes"
Jul 17 06:19:50.875984 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.875900    2567 generic.go:356] "Generic (PLEG): container finished" podID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerID="00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f" exitCode=6
Jul 17 06:19:50.876431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.875984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" event={"ID":"f693caa8-67ea-4b46-9301-af7de2b9c12e","Type":"ContainerDied","Data":"00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f"}
Jul 17 06:19:50.876431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.876042    2567 scope.go:117] "RemoveContainer" containerID="b5ca37a487fe937cf19b5835993e2cdcc8d464a9ceb2cce3bc5eea10ee6ca3ed"
Jul 17 06:19:50.876431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.876205    2567 scope.go:117] "RemoveContainer" containerID="00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f"
Jul 17 06:19:50.876632 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:50.876429    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff_odh-ai-gateway-infra(f693caa8-67ea-4b46-9301-af7de2b9c12e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e"
Jul 17 06:19:50.878075 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.878054    2567 generic.go:356] "Generic (PLEG): container finished" podID="f86043d4-3181-4aed-8fb3-617399d5df92" containerID="f6d5a192981009e8f66ecd7ffbfbe4f1bea4bc3d3afe6cedff34fe165f0b473f" exitCode=6
Jul 17 06:19:50.878181 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.878107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" event={"ID":"f86043d4-3181-4aed-8fb3-617399d5df92","Type":"ContainerDied","Data":"f6d5a192981009e8f66ecd7ffbfbe4f1bea4bc3d3afe6cedff34fe165f0b473f"}
Jul 17 06:19:50.878382 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.878370    2567 scope.go:117] "RemoveContainer" containerID="f6d5a192981009e8f66ecd7ffbfbe4f1bea4bc3d3afe6cedff34fe165f0b473f"
Jul 17 06:19:50.878546 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:50.878531    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs_odh-ai-gateway-infra(f86043d4-3181-4aed-8fb3-617399d5df92)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" podUID="f86043d4-3181-4aed-8fb3-617399d5df92"
Jul 17 06:19:50.887775 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:50.887755    2567 scope.go:117] "RemoveContainer" containerID="2c1495983c85341ef011136c1151e50e5427254a63d838b812a8049e591adfc6"
Jul 17 06:19:51.885006 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:51.884974    2567 scope.go:117] "RemoveContainer" containerID="00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f"
Jul 17 06:19:51.885423 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:19:51.885196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff_odh-ai-gateway-infra(f693caa8-67ea-4b46-9301-af7de2b9c12e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e"
Jul 17 06:19:51.935305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:51.935271    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:52.072394 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.072368    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:52.169776 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.169670    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca\") pod \"f86043d4-3181-4aed-8fb3-617399d5df92\" (UID: \"f86043d4-3181-4aed-8fb3-617399d5df92\") "
Jul 17 06:19:52.170007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.169980    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f86043d4-3181-4aed-8fb3-617399d5df92" (UID: "f86043d4-3181-4aed-8fb3-617399d5df92"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:52.270485 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.270452    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f86043d4-3181-4aed-8fb3-617399d5df92-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:19:52.892881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.892851    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"
Jul 17 06:19:52.892881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.892869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs" event={"ID":"f86043d4-3181-4aed-8fb3-617399d5df92","Type":"ContainerDied","Data":"e6fed5af7398d5bc7440568781db42ba7cb8b6fc3406be92b722cadeac8f8b95"}
Jul 17 06:19:52.893358 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.892922    2567 scope.go:117] "RemoveContainer" containerID="f6d5a192981009e8f66ecd7ffbfbe4f1bea4bc3d3afe6cedff34fe165f0b473f"
Jul 17 06:19:52.918438 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.918412    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:52.926005 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:52.925975    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-7zdfs"]
Jul 17 06:19:53.635527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:53.635486    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:19:54.020657 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:54.020621    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" path="/var/lib/kubelet/pods/f86043d4-3181-4aed-8fb3-617399d5df92/volumes"
Jul 17 06:19:59.980402 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980366    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"]
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980766    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980779    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980794    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980799    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980809    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980814    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980823    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.980854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980828    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.981151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980886    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9290f685-a20d-46f7-9deb-0d25f5838f0c" containerName="revoke-keys"
Jul 17 06:19:59.981151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980897    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.981151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.980903    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:19:59.985347 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.985324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:19:59.995202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:19:59.995157    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"]
Jul 17 06:20:00.143072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.143032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf\" (UID: \"8fe6be9e-21e0-4396-a886-a9f8dd23bf79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:00.243842 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.243740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf\" (UID: \"8fe6be9e-21e0-4396-a886-a9f8dd23bf79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:00.244411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.244383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf\" (UID: \"8fe6be9e-21e0-4396-a886-a9f8dd23bf79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:00.297775 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.297738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:00.435772 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.435747    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"]
Jul 17 06:20:00.437312 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:00.437285    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe6be9e_21e0_4396_a886_a9f8dd23bf79.slice/crio-8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63 WatchSource:0}: Error finding container 8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63: Status 404 returned error can't find the container with id 8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63
Jul 17 06:20:00.939499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.939459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf" event={"ID":"8fe6be9e-21e0-4396-a886-a9f8dd23bf79","Type":"ContainerStarted","Data":"d484f7863b792241008c9d9277bb5ddd69fa3b3f5ee59d58f07c74b2906a2364"}
Jul 17 06:20:00.939708 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.939523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf" event={"ID":"8fe6be9e-21e0-4396-a886-a9f8dd23bf79","Type":"ContainerStarted","Data":"8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63"}
Jul 17 06:20:00.961815 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:00.961712    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf" podStartSLOduration=1.961693963 podStartE2EDuration="1.961693963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:00.960636013 +0000 UTC m=+2819.423820135" watchObservedRunningTime="2026-07-17 06:20:00.961693963 +0000 UTC m=+2819.424878061"
Jul 17 06:20:01.946389 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:01.946350    2567 generic.go:356] "Generic (PLEG): container finished" podID="8fe6be9e-21e0-4396-a886-a9f8dd23bf79" containerID="d484f7863b792241008c9d9277bb5ddd69fa3b3f5ee59d58f07c74b2906a2364" exitCode=0
Jul 17 06:20:01.946845 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:01.946435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf" event={"ID":"8fe6be9e-21e0-4396-a886-a9f8dd23bf79","Type":"ContainerDied","Data":"d484f7863b792241008c9d9277bb5ddd69fa3b3f5ee59d58f07c74b2906a2364"}
Jul 17 06:20:02.607615 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.607580    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:02.608039 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.608025    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86043d4-3181-4aed-8fb3-617399d5df92" containerName="revoke-keys"
Jul 17 06:20:02.611187 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.611170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:02.623116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.623087    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:02.766657 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.766619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv\" (UID: \"f5b06faa-b888-4698-a40c-bf7fccf20a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:02.867304 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.867210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv\" (UID: \"f5b06faa-b888-4698-a40c-bf7fccf20a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:02.867951 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.867932    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv\" (UID: \"f5b06faa-b888-4698-a40c-bf7fccf20a17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:02.921900 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:02.921854    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:03.116334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.116310    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:03.270197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.270168    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca\") pod \"8fe6be9e-21e0-4396-a886-a9f8dd23bf79\" (UID: \"8fe6be9e-21e0-4396-a886-a9f8dd23bf79\") "
Jul 17 06:20:03.270587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.270532    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8fe6be9e-21e0-4396-a886-a9f8dd23bf79" (UID: "8fe6be9e-21e0-4396-a886-a9f8dd23bf79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:03.272116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.272092    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:03.273587 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:03.273564    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b06faa_b888_4698_a40c_bf7fccf20a17.slice/crio-b99376c247273f6ca0ae730b3d1a4d5a9a42d5b8621e3d7f0ad9fdad469cbaef WatchSource:0}: Error finding container b99376c247273f6ca0ae730b3d1a4d5a9a42d5b8621e3d7f0ad9fdad469cbaef: Status 404 returned error can't find the container with id b99376c247273f6ca0ae730b3d1a4d5a9a42d5b8621e3d7f0ad9fdad469cbaef
Jul 17 06:20:03.371116 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.371081    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fe6be9e-21e0-4396-a886-a9f8dd23bf79-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:03.961803 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.961768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerStarted","Data":"fba66620452ace06746a4aa0cdd8e9ab1845ca8155a2fa2beca37126ed6a47d4"}
Jul 17 06:20:03.961992 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.961824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerStarted","Data":"b99376c247273f6ca0ae730b3d1a4d5a9a42d5b8621e3d7f0ad9fdad469cbaef"}
Jul 17 06:20:03.963057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.963037    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf"
Jul 17 06:20:03.963189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.963089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf" event={"ID":"8fe6be9e-21e0-4396-a886-a9f8dd23bf79","Type":"ContainerDied","Data":"8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63"}
Jul 17 06:20:03.963189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.963131    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8adab73ecd8da537f717a9c6e1f7edde9fe163b0f43a758fb278ac8c90b1cf63"
Jul 17 06:20:03.998618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:03.993477    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" podStartSLOduration=1.9934585089999999 podStartE2EDuration="1.993458509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:03.990338679 +0000 UTC m=+2822.453522783" watchObservedRunningTime="2026-07-17 06:20:03.993458509 +0000 UTC m=+2822.456642617"
Jul 17 06:20:04.970441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:04.970408    2567 generic.go:356] "Generic (PLEG): container finished" podID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerID="fba66620452ace06746a4aa0cdd8e9ab1845ca8155a2fa2beca37126ed6a47d4" exitCode=6
Jul 17 06:20:04.970876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:04.970490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerDied","Data":"fba66620452ace06746a4aa0cdd8e9ab1845ca8155a2fa2beca37126ed6a47d4"}
Jul 17 06:20:04.970876 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:04.970732    2567 scope.go:117] "RemoveContainer" containerID="fba66620452ace06746a4aa0cdd8e9ab1845ca8155a2fa2beca37126ed6a47d4"
Jul 17 06:20:05.015830 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.015799    2567 scope.go:117] "RemoveContainer" containerID="00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f"
Jul 17 06:20:05.978551 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.978520    2567 generic.go:356] "Generic (PLEG): container finished" podID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerID="c1f52b3448840a69115896f2aa1622c44e646940f65d45a92645ea183200083e" exitCode=6
Jul 17 06:20:05.979035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.978596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" event={"ID":"f693caa8-67ea-4b46-9301-af7de2b9c12e","Type":"ContainerDied","Data":"c1f52b3448840a69115896f2aa1622c44e646940f65d45a92645ea183200083e"}
Jul 17 06:20:05.979035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.978660    2567 scope.go:117] "RemoveContainer" containerID="00c63ab25d18c32d2711d5c93aa7496c195d705a653aa840e9462fa82b25c95f"
Jul 17 06:20:05.979035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.979021    2567 scope.go:117] "RemoveContainer" containerID="c1f52b3448840a69115896f2aa1622c44e646940f65d45a92645ea183200083e"
Jul 17 06:20:05.979262 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:05.979241    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff_odh-ai-gateway-infra(f693caa8-67ea-4b46-9301-af7de2b9c12e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e"
Jul 17 06:20:05.980572 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.980551    2567 generic.go:356] "Generic (PLEG): container finished" podID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerID="177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef" exitCode=6
Jul 17 06:20:05.980660 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.980584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerDied","Data":"177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef"}
Jul 17 06:20:05.980843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.980829    2567 scope.go:117] "RemoveContainer" containerID="177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef"
Jul 17 06:20:05.981000 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:05.980984    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv_odh-ai-gateway-infra(f5b06faa-b888-4698-a40c-bf7fccf20a17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17"
Jul 17 06:20:05.994050 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:05.994020    2567 scope.go:117] "RemoveContainer" containerID="fba66620452ace06746a4aa0cdd8e9ab1845ca8155a2fa2beca37126ed6a47d4"
Jul 17 06:20:06.989751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:06.989726    2567 scope.go:117] "RemoveContainer" containerID="177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef"
Jul 17 06:20:06.990249 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:06.989979    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv_odh-ai-gateway-infra(f5b06faa-b888-4698-a40c-bf7fccf20a17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17"
Jul 17 06:20:07.006091 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.006056    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:20:07.144616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.144594    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:20:07.308234 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.308150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca\") pod \"f693caa8-67ea-4b46-9301-af7de2b9c12e\" (UID: \"f693caa8-67ea-4b46-9301-af7de2b9c12e\") "
Jul 17 06:20:07.308473 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.308449    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f693caa8-67ea-4b46-9301-af7de2b9c12e" (UID: "f693caa8-67ea-4b46-9301-af7de2b9c12e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:07.409325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.409284    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f693caa8-67ea-4b46-9301-af7de2b9c12e-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:07.996905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.996875    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"
Jul 17 06:20:07.996905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.996894    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff" event={"ID":"f693caa8-67ea-4b46-9301-af7de2b9c12e","Type":"ContainerDied","Data":"1d09919aa51abcd72ed90175765d30c4854cb73dd9e09b74797df11b570fbdca"}
Jul 17 06:20:07.997481 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:07.996955    2567 scope.go:117] "RemoveContainer" containerID="c1f52b3448840a69115896f2aa1622c44e646940f65d45a92645ea183200083e"
Jul 17 06:20:08.026527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:08.026494    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:20:08.030771 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:08.030749    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-x5pff"]
Jul 17 06:20:10.020228 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:10.020192    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" path="/var/lib/kubelet/pods/f693caa8-67ea-4b46-9301-af7de2b9c12e/volumes"
Jul 17 06:20:13.915964 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:13.915928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:20:19.015635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:19.015595    2567 scope.go:117] "RemoveContainer" containerID="177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef"
Jul 17 06:20:20.067817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:20.067777    2567 generic.go:356] "Generic (PLEG): container finished" podID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerID="4bd0137fcc7a18ffda8f48a437a32faeff4b6599776e61e1d898bfcc808b99df" exitCode=6
Jul 17 06:20:20.068305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:20.067847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerDied","Data":"4bd0137fcc7a18ffda8f48a437a32faeff4b6599776e61e1d898bfcc808b99df"}
Jul 17 06:20:20.068305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:20.067905    2567 scope.go:117] "RemoveContainer" containerID="177d7eabcff2f156d014ec94279bdc417557037a82e33877d4b94b5e6742e1ef"
Jul 17 06:20:20.068305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:20.068246    2567 scope.go:117] "RemoveContainer" containerID="4bd0137fcc7a18ffda8f48a437a32faeff4b6599776e61e1d898bfcc808b99df"
Jul 17 06:20:20.068506 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:20.068484    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv_odh-ai-gateway-infra(f5b06faa-b888-4698-a40c-bf7fccf20a17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17"
Jul 17 06:20:20.999829 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:20.999788    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:21.000190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000176    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe6be9e-21e0-4396-a886-a9f8dd23bf79" containerName="revoke-keys"
Jul 17 06:20:21.000190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe6be9e-21e0-4396-a886-a9f8dd23bf79" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000202    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000209    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000220    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000226    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000235    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000240    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000298    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.000489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000304    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe6be9e-21e0-4396-a886-a9f8dd23bf79" containerName="revoke-keys"
Jul 17 06:20:21.000489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.000313    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:21.004766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.004747    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:21.012723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.012673    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:21.021144 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.021117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5dgnq\" (UID: \"515a00bb-2af6-4a0b-8d91-397807ba9eaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:21.098702 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.098652    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:21.122522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.122490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5dgnq\" (UID: \"515a00bb-2af6-4a0b-8d91-397807ba9eaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:21.123140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.123116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-5dgnq\" (UID: \"515a00bb-2af6-4a0b-8d91-397807ba9eaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:21.238750 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.238724    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:21.316757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.316651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:21.324812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.324785    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca\") pod \"f5b06faa-b888-4698-a40c-bf7fccf20a17\" (UID: \"f5b06faa-b888-4698-a40c-bf7fccf20a17\") "
Jul 17 06:20:21.325155 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.325130    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5b06faa-b888-4698-a40c-bf7fccf20a17" (UID: "f5b06faa-b888-4698-a40c-bf7fccf20a17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:21.425593 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.425558    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b06faa-b888-4698-a40c-bf7fccf20a17-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:21.463345 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:21.463318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:21.465488 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:21.465463    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515a00bb_2af6_4a0b_8d91_397807ba9eaa.slice/crio-fb31401509b14b6a3ea67f4da421085019848504dabc74136cb988a17b661c0e WatchSource:0}: Error finding container fb31401509b14b6a3ea67f4da421085019848504dabc74136cb988a17b661c0e: Status 404 returned error can't find the container with id fb31401509b14b6a3ea67f4da421085019848504dabc74136cb988a17b661c0e
Jul 17 06:20:22.082911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.082877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerStarted","Data":"ce85537581c8c7aadf01760b66427de36ecee1244f5164f19c72004739ee39b5"}
Jul 17 06:20:22.083053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.082944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerStarted","Data":"fb31401509b14b6a3ea67f4da421085019848504dabc74136cb988a17b661c0e"}
Jul 17 06:20:22.084264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.084243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv" event={"ID":"f5b06faa-b888-4698-a40c-bf7fccf20a17","Type":"ContainerDied","Data":"b99376c247273f6ca0ae730b3d1a4d5a9a42d5b8621e3d7f0ad9fdad469cbaef"}
Jul 17 06:20:22.084264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.084259    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"
Jul 17 06:20:22.084392 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.084289    2567 scope.go:117] "RemoveContainer" containerID="4bd0137fcc7a18ffda8f48a437a32faeff4b6599776e61e1d898bfcc808b99df"
Jul 17 06:20:22.100536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.100487    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" podStartSLOduration=2.10047047 podStartE2EDuration="2.10047047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:22.098983648 +0000 UTC m=+2840.562167754" watchObservedRunningTime="2026-07-17 06:20:22.10047047 +0000 UTC m=+2840.563654574"
Jul 17 06:20:22.144740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.144713    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:22.148881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:22.148858    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8fnnv"]
Jul 17 06:20:23.091583 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:23.091551    2567 generic.go:356] "Generic (PLEG): container finished" podID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerID="ce85537581c8c7aadf01760b66427de36ecee1244f5164f19c72004739ee39b5" exitCode=6
Jul 17 06:20:23.091818 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:23.091653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerDied","Data":"ce85537581c8c7aadf01760b66427de36ecee1244f5164f19c72004739ee39b5"}
Jul 17 06:20:23.091901 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:23.091827    2567 scope.go:117] "RemoveContainer" containerID="ce85537581c8c7aadf01760b66427de36ecee1244f5164f19c72004739ee39b5"
Jul 17 06:20:24.020499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.020465    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" path="/var/lib/kubelet/pods/f5b06faa-b888-4698-a40c-bf7fccf20a17/volumes"
Jul 17 06:20:24.100389 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.100353    2567 generic.go:356] "Generic (PLEG): container finished" podID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerID="c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51" exitCode=6
Jul 17 06:20:24.100568 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.100444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerDied","Data":"c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51"}
Jul 17 06:20:24.100568 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.100508    2567 scope.go:117] "RemoveContainer" containerID="ce85537581c8c7aadf01760b66427de36ecee1244f5164f19c72004739ee39b5"
Jul 17 06:20:24.100730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.100711    2567 scope.go:117] "RemoveContainer" containerID="c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51"
Jul 17 06:20:24.100952 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:24.100932    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5dgnq_odh-ai-gateway-infra(515a00bb-2af6-4a0b-8d91-397807ba9eaa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa"
Jul 17 06:20:24.311207 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311124    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:24.311597 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311579    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.311649 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311600    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.311649 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311609    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.311649 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311615    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.311770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311701    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.311770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311710    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f693caa8-67ea-4b46-9301-af7de2b9c12e" containerName="revoke-keys"
Jul 17 06:20:24.311770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.311718    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:24.315858 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.315842    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:24.323540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.323233    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:24.352345 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.352306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qvldj\" (UID: \"f61dde7e-2517-4af0-9795-448300e75fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:24.453411 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.453364    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qvldj\" (UID: \"f61dde7e-2517-4af0-9795-448300e75fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:24.454057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.454033    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-qvldj\" (UID: \"f61dde7e-2517-4af0-9795-448300e75fc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:24.628460 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.628373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:24.969132 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:24.969106    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:24.970637 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:24.970606    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61dde7e_2517_4af0_9795_448300e75fc8.slice/crio-fba7d398600eeac83c9506bd13183d17d7a8ee84e97f309c01918b82af583a87 WatchSource:0}: Error finding container fba7d398600eeac83c9506bd13183d17d7a8ee84e97f309c01918b82af583a87: Status 404 returned error can't find the container with id fba7d398600eeac83c9506bd13183d17d7a8ee84e97f309c01918b82af583a87
Jul 17 06:20:25.107818 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:25.107792    2567 scope.go:117] "RemoveContainer" containerID="c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51"
Jul 17 06:20:25.108262 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:25.108017    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5dgnq_odh-ai-gateway-infra(515a00bb-2af6-4a0b-8d91-397807ba9eaa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa"
Jul 17 06:20:25.108806 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:25.108782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" event={"ID":"f61dde7e-2517-4af0-9795-448300e75fc8","Type":"ContainerStarted","Data":"fba7d398600eeac83c9506bd13183d17d7a8ee84e97f309c01918b82af583a87"}
Jul 17 06:20:26.115525 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:26.115485    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61dde7e-2517-4af0-9795-448300e75fc8" containerID="12b2e258795f39e8e55e234f895e5880c730d4b9917cf7832a16f3564c3eee36" exitCode=6
Jul 17 06:20:26.115947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:26.115572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" event={"ID":"f61dde7e-2517-4af0-9795-448300e75fc8","Type":"ContainerDied","Data":"12b2e258795f39e8e55e234f895e5880c730d4b9917cf7832a16f3564c3eee36"}
Jul 17 06:20:26.115947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:26.115728    2567 scope.go:117] "RemoveContainer" containerID="12b2e258795f39e8e55e234f895e5880c730d4b9917cf7832a16f3564c3eee36"
Jul 17 06:20:27.123289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:27.123252    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61dde7e-2517-4af0-9795-448300e75fc8" containerID="e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3" exitCode=6
Jul 17 06:20:27.123770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:27.123301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" event={"ID":"f61dde7e-2517-4af0-9795-448300e75fc8","Type":"ContainerDied","Data":"e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3"}
Jul 17 06:20:27.123770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:27.123352    2567 scope.go:117] "RemoveContainer" containerID="12b2e258795f39e8e55e234f895e5880c730d4b9917cf7832a16f3564c3eee36"
Jul 17 06:20:27.123770 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:27.123542    2567 scope.go:117] "RemoveContainer" containerID="e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3"
Jul 17 06:20:27.123921 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:27.123796    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qvldj_odh-ai-gateway-infra(f61dde7e-2517-4af0-9795-448300e75fc8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" podUID="f61dde7e-2517-4af0-9795-448300e75fc8"
Jul 17 06:20:28.130349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:28.130323    2567 scope.go:117] "RemoveContainer" containerID="e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3"
Jul 17 06:20:28.130772 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:28.130509    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qvldj_odh-ai-gateway-infra(f61dde7e-2517-4af0-9795-448300e75fc8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" podUID="f61dde7e-2517-4af0-9795-448300e75fc8"
Jul 17 06:20:29.615042 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.615011    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:20:29.615410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.615379    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:29.615410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.615390    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:29.615489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.615483    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b06faa-b888-4698-a40c-bf7fccf20a17" containerName="revoke-keys"
Jul 17 06:20:29.619667 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.619649    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.622729 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.622670    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cggjx\""
Jul 17 06:20:29.623009 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.622993    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 06:20:29.623536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.623523    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1615b7-serving-cert\""
Jul 17 06:20:29.636773 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.636753    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:20:29.703508 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.703478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmdg\" (UniqueName: \"kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.703672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.703527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.703672 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.703585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.804474 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.804430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.804720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.804517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmdg\" (UniqueName: \"kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.804720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.804554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.805203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.805177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.807191 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.807172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.815351 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.815325    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmdg\" (UniqueName: \"kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg\") pod \"maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:29.929405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:29.929305    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:30.091932 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:30.091902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:20:30.094720 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:30.094648    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b8df49_f06a_4cbf_a97b_9a1dd588925b.slice/crio-0904b6017685d9429b6fa60b097bd6faf674e5114f6fbfd5b52c97d371c34897 WatchSource:0}: Error finding container 0904b6017685d9429b6fa60b097bd6faf674e5114f6fbfd5b52c97d371c34897: Status 404 returned error can't find the container with id 0904b6017685d9429b6fa60b097bd6faf674e5114f6fbfd5b52c97d371c34897
Jul 17 06:20:30.096665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:30.096642    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:20:30.142267 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:30.142227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" event={"ID":"22b8df49-f06a-4cbf-a97b-9a1dd588925b","Type":"ContainerStarted","Data":"0904b6017685d9429b6fa60b097bd6faf674e5114f6fbfd5b52c97d371c34897"}
Jul 17 06:20:33.163268 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:33.163231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" event={"ID":"22b8df49-f06a-4cbf-a97b-9a1dd588925b","Type":"ContainerStarted","Data":"7c989e2351f18d0e95db7a1b6a85072e9c826e221afec7efce50cec9af675d66"}
Jul 17 06:20:33.163634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:33.163357    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:33.180889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:33.180834    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" podStartSLOduration=1.89000322 podStartE2EDuration="4.180818925s" totalImagesPullingTime="2.290815705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:33.179147854 +0000 UTC m=+2851.642331960" watchObservedRunningTime="2026-07-17 06:20:33.180818925 +0000 UTC m=+2851.644003460"
Jul 17 06:20:34.727758 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:34.727718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:20:36.020810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:36.020782    2567 scope.go:117] "RemoveContainer" containerID="c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51"
Jul 17 06:20:37.188604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.188569    2567 generic.go:356] "Generic (PLEG): container finished" podID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerID="53be4b9af03fd5357056dfb6928389085ecb4169d2c056ac9966ec5e50ce2ccf" exitCode=6
Jul 17 06:20:37.188604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.188612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerDied","Data":"53be4b9af03fd5357056dfb6928389085ecb4169d2c056ac9966ec5e50ce2ccf"}
Jul 17 06:20:37.189090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.188705    2567 scope.go:117] "RemoveContainer" containerID="c8e8747092f3366c9b5e6e7ae303e519bf14b528e0eca130774e5f13d5ab6c51"
Jul 17 06:20:37.189090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.188968    2567 scope.go:117] "RemoveContainer" containerID="53be4b9af03fd5357056dfb6928389085ecb4169d2c056ac9966ec5e50ce2ccf"
Jul 17 06:20:37.189230 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:37.189203    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-5dgnq_odh-ai-gateway-infra(515a00bb-2af6-4a0b-8d91-397807ba9eaa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa"
Jul 17 06:20:37.696069 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.696035    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:20:37.700802 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.700780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.704366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.704348    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6c5dba-serving-cert\""
Jul 17 06:20:37.718716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.718672    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:20:37.783551 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.783510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97fz\" (UniqueName: \"kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.783551 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.783549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.783802 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.783645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.884889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.884852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.885084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.884922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97fz\" (UniqueName: \"kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.885084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.884942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.885084 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:37.885010    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-serving-cert: secret "maas-api-e2e-api-b-6c5dba-serving-cert" not found
Jul 17 06:20:37.885084 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:37.885083    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls podName:3c45bc47-8c7b-43af-aa68-c31ed8afa83e nodeName:}" failed. No retries permitted until 2026-07-17 06:20:38.385063037 +0000 UTC m=+2856.848247120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls") pod "maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" (UID: "3c45bc47-8c7b-43af-aa68-c31ed8afa83e") : secret "maas-api-e2e-api-b-6c5dba-serving-cert" not found
Jul 17 06:20:37.885563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.885545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:37.908483 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:37.908453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97fz\" (UniqueName: \"kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:38.216795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.216763    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:38.355258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.355233    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:38.389089 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.389051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:38.391836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.391799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") pod \"maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:38.489925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.489841    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca\") pod \"515a00bb-2af6-4a0b-8d91-397807ba9eaa\" (UID: \"515a00bb-2af6-4a0b-8d91-397807ba9eaa\") "
Jul 17 06:20:38.490220 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.490178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "515a00bb-2af6-4a0b-8d91-397807ba9eaa" (UID: "515a00bb-2af6-4a0b-8d91-397807ba9eaa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:38.591204 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.591170    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/515a00bb-2af6-4a0b-8d91-397807ba9eaa-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:38.611276 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.611241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:38.754697 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:38.754653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:20:38.755434 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:38.755404    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c45bc47_8c7b_43af_aa68_c31ed8afa83e.slice/crio-c35cb4d8c2d23dea72c819a72714fe1d75c786c73ae355298f1f8a8393cfcaa7 WatchSource:0}: Error finding container c35cb4d8c2d23dea72c819a72714fe1d75c786c73ae355298f1f8a8393cfcaa7: Status 404 returned error can't find the container with id c35cb4d8c2d23dea72c819a72714fe1d75c786c73ae355298f1f8a8393cfcaa7
Jul 17 06:20:39.174569 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.174542    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:20:39.203753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.203716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" event={"ID":"3c45bc47-8c7b-43af-aa68-c31ed8afa83e","Type":"ContainerStarted","Data":"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"}
Jul 17 06:20:39.203947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.203777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" event={"ID":"3c45bc47-8c7b-43af-aa68-c31ed8afa83e","Type":"ContainerStarted","Data":"c35cb4d8c2d23dea72c819a72714fe1d75c786c73ae355298f1f8a8393cfcaa7"}
Jul 17 06:20:39.203947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.203830    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:39.205455 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.205433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq" event={"ID":"515a00bb-2af6-4a0b-8d91-397807ba9eaa","Type":"ContainerDied","Data":"fb31401509b14b6a3ea67f4da421085019848504dabc74136cb988a17b661c0e"}
Jul 17 06:20:39.205455 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.205445    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"
Jul 17 06:20:39.205632 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.205487    2567 scope.go:117] "RemoveContainer" containerID="53be4b9af03fd5357056dfb6928389085ecb4169d2c056ac9966ec5e50ce2ccf"
Jul 17 06:20:39.221784 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.221745    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" podStartSLOduration=1.887575028 podStartE2EDuration="2.221731645s" totalImagesPullingTime="334.156617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:39.219234043 +0000 UTC m=+2857.682418149" watchObservedRunningTime="2026-07-17 06:20:39.221731645 +0000 UTC m=+2857.684915778"
Jul 17 06:20:39.236131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.236101    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:39.242373 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:39.242352    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-5dgnq"]
Jul 17 06:20:40.021110 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:40.021075    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" path="/var/lib/kubelet/pods/515a00bb-2af6-4a0b-8d91-397807ba9eaa/volumes"
Jul 17 06:20:42.018071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:42.018041    2567 scope.go:117] "RemoveContainer" containerID="e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3"
Jul 17 06:20:43.231433 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:43.231402    2567 generic.go:356] "Generic (PLEG): container finished" podID="f61dde7e-2517-4af0-9795-448300e75fc8" containerID="99e781ddc56651850b3d451b9a24feb41194425e832c1ff16f3b91e8cf8bc801" exitCode=6
Jul 17 06:20:43.231905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:43.231484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" event={"ID":"f61dde7e-2517-4af0-9795-448300e75fc8","Type":"ContainerDied","Data":"99e781ddc56651850b3d451b9a24feb41194425e832c1ff16f3b91e8cf8bc801"}
Jul 17 06:20:43.231905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:43.231545    2567 scope.go:117] "RemoveContainer" containerID="e619de367e709ab8a4a75e7b4d1efa8f3ad44074b632a989d588373c5544dba3"
Jul 17 06:20:43.231905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:43.231830    2567 scope.go:117] "RemoveContainer" containerID="99e781ddc56651850b3d451b9a24feb41194425e832c1ff16f3b91e8cf8bc801"
Jul 17 06:20:43.232058 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:20:43.232037    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-qvldj_odh-ai-gateway-infra(f61dde7e-2517-4af0-9795-448300e75fc8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" podUID="f61dde7e-2517-4af0-9795-448300e75fc8"
Jul 17 06:20:44.257707 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:44.257657    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:44.393414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:44.393390    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:44.545547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:44.545451    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca\") pod \"f61dde7e-2517-4af0-9795-448300e75fc8\" (UID: \"f61dde7e-2517-4af0-9795-448300e75fc8\") "
Jul 17 06:20:44.545890 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:44.545865    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f61dde7e-2517-4af0-9795-448300e75fc8" (UID: "f61dde7e-2517-4af0-9795-448300e75fc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:44.646900 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:44.646859    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f61dde7e-2517-4af0-9795-448300e75fc8-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:45.219404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.219375    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:20:45.247011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.246974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj" event={"ID":"f61dde7e-2517-4af0-9795-448300e75fc8","Type":"ContainerDied","Data":"fba7d398600eeac83c9506bd13183d17d7a8ee84e97f309c01918b82af583a87"}
Jul 17 06:20:45.247011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.247016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"
Jul 17 06:20:45.247276 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.247049    2567 scope.go:117] "RemoveContainer" containerID="99e781ddc56651850b3d451b9a24feb41194425e832c1ff16f3b91e8cf8bc801"
Jul 17 06:20:45.269958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.269933    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:45.274832 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:45.274804    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-qvldj"]
Jul 17 06:20:46.021331 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:46.021284    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" path="/var/lib/kubelet/pods/f61dde7e-2517-4af0-9795-448300e75fc8/volumes"
Jul 17 06:20:46.033486 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:46.033455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:20:50.078516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078475    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"]
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078859    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078871    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078883    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078889    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078905    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078910    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078920    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078925    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078929    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.078945 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078935    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.079258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.078993    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.079258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.079001    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.079258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.079006    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="515a00bb-2af6-4a0b-8d91-397807ba9eaa" containerName="revoke-keys"
Jul 17 06:20:50.079258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.079012    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.079258 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.079020    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:20:50.083094 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.083077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:50.086167 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.086147    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:20:50.091643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.091136    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"]
Jul 17 06:20:50.198506 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.198476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1615b7-wxktr\" (UID: \"898bab71-5de0-4763-a18b-d4c1bfb835fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:50.299363 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.299317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1615b7-wxktr\" (UID: \"898bab71-5de0-4763-a18b-d4c1bfb835fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:50.300048 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.300027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1615b7-wxktr\" (UID: \"898bab71-5de0-4763-a18b-d4c1bfb835fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:50.395998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.395903    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:50.530003 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:50.529973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"]
Jul 17 06:20:50.531619 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:20:50.531597    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898bab71_5de0_4763_a18b_d4c1bfb835fc.slice/crio-a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508 WatchSource:0}: Error finding container a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508: Status 404 returned error can't find the container with id a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508
Jul 17 06:20:51.290260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:51.290212    2567 generic.go:356] "Generic (PLEG): container finished" podID="898bab71-5de0-4763-a18b-d4c1bfb835fc" containerID="60243ac3b2885304d87a0ebd6cfc20b17bf6e26e790ce9d80fadd386af5f7639" exitCode=0
Jul 17 06:20:51.290653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:51.290294    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr" event={"ID":"898bab71-5de0-4763-a18b-d4c1bfb835fc","Type":"ContainerDied","Data":"60243ac3b2885304d87a0ebd6cfc20b17bf6e26e790ce9d80fadd386af5f7639"}
Jul 17 06:20:51.290653 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:51.290376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr" event={"ID":"898bab71-5de0-4763-a18b-d4c1bfb835fc","Type":"ContainerStarted","Data":"a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508"}
Jul 17 06:20:52.434405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:52.434379    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:52.620979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:52.620888    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca\") pod \"898bab71-5de0-4763-a18b-d4c1bfb835fc\" (UID: \"898bab71-5de0-4763-a18b-d4c1bfb835fc\") "
Jul 17 06:20:52.621311 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:52.621290    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "898bab71-5de0-4763-a18b-d4c1bfb835fc" (UID: "898bab71-5de0-4763-a18b-d4c1bfb835fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:52.722466 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:52.722419    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/898bab71-5de0-4763-a18b-d4c1bfb835fc-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:20:53.303264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:53.303228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr" event={"ID":"898bab71-5de0-4763-a18b-d4c1bfb835fc","Type":"ContainerDied","Data":"a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508"}
Jul 17 06:20:53.303264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:53.303262    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1615b7-wxktr"
Jul 17 06:20:53.303481 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:20:53.303284    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5fc007692d1b64be5fe069f5b8629f4d4444d0e026df37a18fb90386cd50508"
Jul 17 06:21:00.182821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.182784    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:21:00.183289 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.182987    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" podUID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" containerName="maas-api" containerID="cri-o://7c989e2351f18d0e95db7a1b6a85072e9c826e221afec7efce50cec9af675d66" gracePeriod=30
Jul 17 06:21:00.344402 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.344364    2567 generic.go:356] "Generic (PLEG): container finished" podID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" containerID="7c989e2351f18d0e95db7a1b6a85072e9c826e221afec7efce50cec9af675d66" exitCode=0
Jul 17 06:21:00.344552 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.344429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" event={"ID":"22b8df49-f06a-4cbf-a97b-9a1dd588925b","Type":"ContainerDied","Data":"7c989e2351f18d0e95db7a1b6a85072e9c826e221afec7efce50cec9af675d66"}
Jul 17 06:21:00.432974 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.432921    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:21:00.491095 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.491063    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls\") pod \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") "
Jul 17 06:21:00.491294 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.491116    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvmdg\" (UniqueName: \"kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg\") pod \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") "
Jul 17 06:21:00.491294 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.491150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca\") pod \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\" (UID: \"22b8df49-f06a-4cbf-a97b-9a1dd588925b\") "
Jul 17 06:21:00.491571 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.491544    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22b8df49-f06a-4cbf-a97b-9a1dd588925b" (UID: "22b8df49-f06a-4cbf-a97b-9a1dd588925b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:21:00.493410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.493377    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22b8df49-f06a-4cbf-a97b-9a1dd588925b" (UID: "22b8df49-f06a-4cbf-a97b-9a1dd588925b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:21:00.493503 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.493413    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg" (OuterVolumeSpecName: "kube-api-access-hvmdg") pod "22b8df49-f06a-4cbf-a97b-9a1dd588925b" (UID: "22b8df49-f06a-4cbf-a97b-9a1dd588925b"). InnerVolumeSpecName "kube-api-access-hvmdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:00.592071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.592034    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b8df49-f06a-4cbf-a97b-9a1dd588925b-maas-api-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:00.592071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.592066    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvmdg\" (UniqueName: \"kubernetes.io/projected/22b8df49-f06a-4cbf-a97b-9a1dd588925b-kube-api-access-hvmdg\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:00.592071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:00.592075    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8df49-f06a-4cbf-a97b-9a1dd588925b-openshift-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:01.352588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:01.352558    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"
Jul 17 06:21:01.352588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:01.352577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw" event={"ID":"22b8df49-f06a-4cbf-a97b-9a1dd588925b","Type":"ContainerDied","Data":"0904b6017685d9429b6fa60b097bd6faf674e5114f6fbfd5b52c97d371c34897"}
Jul 17 06:21:01.353092 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:01.352637    2567 scope.go:117] "RemoveContainer" containerID="7c989e2351f18d0e95db7a1b6a85072e9c826e221afec7efce50cec9af675d66"
Jul 17 06:21:01.374500 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:01.374476    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:21:01.376759 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:01.376738    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1615b7-7d6765d997-bnnlw"]
Jul 17 06:21:02.020388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:02.020355    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" path="/var/lib/kubelet/pods/22b8df49-f06a-4cbf-a97b-9a1dd588925b/volumes"
Jul 17 06:21:04.020562 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:04.020535    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:21:26.939635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:26.939593    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:21:26.940250 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:26.939866    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" podUID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" containerName="maas-api" containerID="cri-o://49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346" gracePeriod=30
Jul 17 06:21:27.194283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.194251    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:21:27.314456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.314413    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k97fz\" (UniqueName: \"kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz\") pod \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") "
Jul 17 06:21:27.314642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.314485    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") pod \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") "
Jul 17 06:21:27.314642 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.314608    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca\") pod \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\" (UID: \"3c45bc47-8c7b-43af-aa68-c31ed8afa83e\") "
Jul 17 06:21:27.314934 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.314907    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c45bc47-8c7b-43af-aa68-c31ed8afa83e" (UID: "3c45bc47-8c7b-43af-aa68-c31ed8afa83e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:21:27.316644 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.316622    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz" (OuterVolumeSpecName: "kube-api-access-k97fz") pod "3c45bc47-8c7b-43af-aa68-c31ed8afa83e" (UID: "3c45bc47-8c7b-43af-aa68-c31ed8afa83e"). InnerVolumeSpecName "kube-api-access-k97fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:27.316735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.316713    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c45bc47-8c7b-43af-aa68-c31ed8afa83e" (UID: "3c45bc47-8c7b-43af-aa68-c31ed8afa83e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:21:27.416223 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.416183    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-openshift-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:27.416223 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.416213    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k97fz\" (UniqueName: \"kubernetes.io/projected/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-kube-api-access-k97fz\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:27.416223 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.416224    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c45bc47-8c7b-43af-aa68-c31ed8afa83e-maas-api-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:27.498058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.497967    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" containerID="49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346" exitCode=0
Jul 17 06:21:27.498058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.498016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"
Jul 17 06:21:27.498058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.498038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" event={"ID":"3c45bc47-8c7b-43af-aa68-c31ed8afa83e","Type":"ContainerDied","Data":"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"}
Jul 17 06:21:27.498343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.498078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb" event={"ID":"3c45bc47-8c7b-43af-aa68-c31ed8afa83e","Type":"ContainerDied","Data":"c35cb4d8c2d23dea72c819a72714fe1d75c786c73ae355298f1f8a8393cfcaa7"}
Jul 17 06:21:27.498343 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.498100    2567 scope.go:117] "RemoveContainer" containerID="49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"
Jul 17 06:21:27.507589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.507572    2567 scope.go:117] "RemoveContainer" containerID="49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"
Jul 17 06:21:27.507898 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:27.507879    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346\": container with ID starting with 49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346 not found: ID does not exist" containerID="49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"
Jul 17 06:21:27.507948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.507906    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346"} err="failed to get container status \"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346\": rpc error: code = NotFound desc = could not find container \"49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346\": container with ID starting with 49286efee28a0a63c5a488593e0e525f5f797d6ec14e458879fcc20060c30346 not found: ID does not exist"
Jul 17 06:21:27.520753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.520728    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:21:27.524279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:27.524255    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6c5dba-7854858c4c-fntbb"]
Jul 17 06:21:28.022162 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:28.022129    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" path="/var/lib/kubelet/pods/3c45bc47-8c7b-43af-aa68-c31ed8afa83e/volumes"
Jul 17 06:21:30.316202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:30.316165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:21:38.412088 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412053    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412414    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898bab71-5de0-4763-a18b-d4c1bfb835fc" containerName="revoke-keys"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412424    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="898bab71-5de0-4763-a18b-d4c1bfb835fc" containerName="revoke-keys"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412436    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412441    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412449    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" containerName="maas-api"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412455    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" containerName="maas-api"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412461    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" containerName="maas-api"
Jul 17 06:21:38.412476 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412466    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" containerName="maas-api"
Jul 17 06:21:38.412781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412521    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c45bc47-8c7b-43af-aa68-c31ed8afa83e" containerName="maas-api"
Jul 17 06:21:38.412781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412529    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61dde7e-2517-4af0-9795-448300e75fc8" containerName="revoke-keys"
Jul 17 06:21:38.412781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412534    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b8df49-f06a-4cbf-a97b-9a1dd588925b" containerName="maas-api"
Jul 17 06:21:38.412781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.412540    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="898bab71-5de0-4763-a18b-d4c1bfb835fc" containerName="revoke-keys"
Jul 17 06:21:38.417013 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.416993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:38.419974 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.419954    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:21:38.419974 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.419967    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:21:38.428152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.428123    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:21:38.517589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.517549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf\" (UID: \"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:38.618271 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.618225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf\" (UID: \"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:38.618925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.618901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf\" (UID: \"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:38.729516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.729484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:38.864418 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:38.864387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:21:38.865531 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:21:38.865503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea6e935_9aaf_4cb9_84c6_1e2cc7971b17.slice/crio-30da3c13f8ebca641a65a21cec015fceb332651bf085e76415e8fa31ded04541 WatchSource:0}: Error finding container 30da3c13f8ebca641a65a21cec015fceb332651bf085e76415e8fa31ded04541: Status 404 returned error can't find the container with id 30da3c13f8ebca641a65a21cec015fceb332651bf085e76415e8fa31ded04541
Jul 17 06:21:39.568697 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:39.568640    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerStarted","Data":"e642ddeae7622319b2478217d2055443a9080b90751bee59a3de4af9d2e85bc4"}
Jul 17 06:21:39.569232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:39.568717    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerStarted","Data":"30da3c13f8ebca641a65a21cec015fceb332651bf085e76415e8fa31ded04541"}
Jul 17 06:21:39.586296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:39.586240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" podStartSLOduration=1.586221427 podStartE2EDuration="1.586221427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:39.584836181 +0000 UTC m=+2918.048020286" watchObservedRunningTime="2026-07-17 06:21:39.586221427 +0000 UTC m=+2918.049405571"
Jul 17 06:21:40.575161 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:40.575125    2567 generic.go:356] "Generic (PLEG): container finished" podID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerID="e642ddeae7622319b2478217d2055443a9080b90751bee59a3de4af9d2e85bc4" exitCode=6
Jul 17 06:21:40.575578 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:40.575214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerDied","Data":"e642ddeae7622319b2478217d2055443a9080b90751bee59a3de4af9d2e85bc4"}
Jul 17 06:21:40.575578 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:40.575394    2567 scope.go:117] "RemoveContainer" containerID="e642ddeae7622319b2478217d2055443a9080b90751bee59a3de4af9d2e85bc4"
Jul 17 06:21:41.582338 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:41.582304    2567 generic.go:356] "Generic (PLEG): container finished" podID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerID="9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361" exitCode=6
Jul 17 06:21:41.582810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:41.582362    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerDied","Data":"9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361"}
Jul 17 06:21:41.582810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:41.582417    2567 scope.go:117] "RemoveContainer" containerID="e642ddeae7622319b2478217d2055443a9080b90751bee59a3de4af9d2e85bc4"
Jul 17 06:21:41.582810 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:41.582587    2567 scope.go:117] "RemoveContainer" containerID="9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361"
Jul 17 06:21:41.582978 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:41.582853    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf_odh-ai-gateway-infra(9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17"
Jul 17 06:21:42.589862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.589830    2567 scope.go:117] "RemoveContainer" containerID="9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361"
Jul 17 06:21:42.590263 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:42.590043    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf_odh-ai-gateway-infra(9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17"
Jul 17 06:21:42.698264 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.698230    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:21:42.702899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.702880    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:21:42.710427 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.710346    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:21:42.857466 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.857384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv\" (UID: \"31251de5-8967-473c-b7bf-eee891f09e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:21:42.958721 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.958668    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv\" (UID: \"31251de5-8967-473c-b7bf-eee891f09e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:21:42.959269 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:42.959251    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv\" (UID: \"31251de5-8967-473c-b7bf-eee891f09e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:21:43.015636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:43.015602    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:21:43.148871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:43.148815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:21:43.150999 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:21:43.150969    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31251de5_8967_473c_b7bf_eee891f09e20.slice/crio-206496cc8f62dec68bb5aa34f848db84c494c7013b3371874644276e57962257 WatchSource:0}: Error finding container 206496cc8f62dec68bb5aa34f848db84c494c7013b3371874644276e57962257: Status 404 returned error can't find the container with id 206496cc8f62dec68bb5aa34f848db84c494c7013b3371874644276e57962257
Jul 17 06:21:43.596510 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:43.596471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerStarted","Data":"47661508511b0bfa4e13a600fffa1196d8c4f6bb2bc9de5c4955de322329937a"}
Jul 17 06:21:43.596896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:43.596527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerStarted","Data":"206496cc8f62dec68bb5aa34f848db84c494c7013b3371874644276e57962257"}
Jul 17 06:21:43.615588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:43.615535    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" podStartSLOduration=1.6155190240000001 podStartE2EDuration="1.615519024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:43.613833314 +0000 UTC m=+2922.077017431" watchObservedRunningTime="2026-07-17 06:21:43.615519024 +0000 UTC m=+2922.078703127"
Jul 17 06:21:44.604303 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:44.604256    2567 generic.go:356] "Generic (PLEG): container finished" podID="31251de5-8967-473c-b7bf-eee891f09e20" containerID="47661508511b0bfa4e13a600fffa1196d8c4f6bb2bc9de5c4955de322329937a" exitCode=6
Jul 17 06:21:44.604733 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:44.604396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerDied","Data":"47661508511b0bfa4e13a600fffa1196d8c4f6bb2bc9de5c4955de322329937a"}
Jul 17 06:21:44.604733 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:44.604567    2567 scope.go:117] "RemoveContainer" containerID="47661508511b0bfa4e13a600fffa1196d8c4f6bb2bc9de5c4955de322329937a"
Jul 17 06:21:45.611635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.611595    2567 generic.go:356] "Generic (PLEG): container finished" podID="31251de5-8967-473c-b7bf-eee891f09e20" containerID="a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6" exitCode=6
Jul 17 06:21:45.612121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.611707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerDied","Data":"a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6"}
Jul 17 06:21:45.612121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.611772    2567 scope.go:117] "RemoveContainer" containerID="47661508511b0bfa4e13a600fffa1196d8c4f6bb2bc9de5c4955de322329937a"
Jul 17 06:21:45.612121 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.611906    2567 scope.go:117] "RemoveContainer" containerID="a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6"
Jul 17 06:21:45.612264 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:45.612168    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv_odh-ai-gateway-infra(31251de5-8967-473c-b7bf-eee891f09e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" podUID="31251de5-8967-473c-b7bf-eee891f09e20"
Jul 17 06:21:45.878582 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.878494    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:21:45.883532 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.883508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:45.886613 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.886589    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cggjx\""
Jul 17 06:21:45.886778 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.886591    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e9bcaa-serving-cert\""
Jul 17 06:21:45.887599 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.887581    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 06:21:45.894356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.894327    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:21:45.986842 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.986802    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5l58\" (UniqueName: \"kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:45.987021 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.986928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:45.987021 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:45.986959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.088436 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.088403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.088436 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.088446    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.088766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.088487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5l58\" (UniqueName: \"kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.089092 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.089072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.091078 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.091056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.097570 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.097533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5l58\" (UniqueName: \"kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58\") pod \"maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.195863 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.195815    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:46.351095 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.351063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:21:46.352799 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:21:46.352765    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbbe99d_2e55_4ee7_8b15_6a03744b54f0.slice/crio-16bffc8384d52b087b878657c06fc18968ccaccdf1289f9d6adc1b22c567b37b WatchSource:0}: Error finding container 16bffc8384d52b087b878657c06fc18968ccaccdf1289f9d6adc1b22c567b37b: Status 404 returned error can't find the container with id 16bffc8384d52b087b878657c06fc18968ccaccdf1289f9d6adc1b22c567b37b
Jul 17 06:21:46.619981 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.619900    2567 scope.go:117] "RemoveContainer" containerID="a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6"
Jul 17 06:21:46.620399 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:46.620129    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv_odh-ai-gateway-infra(31251de5-8967-473c-b7bf-eee891f09e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" podUID="31251de5-8967-473c-b7bf-eee891f09e20"
Jul 17 06:21:46.620852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:46.620824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" event={"ID":"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0","Type":"ContainerStarted","Data":"16bffc8384d52b087b878657c06fc18968ccaccdf1289f9d6adc1b22c567b37b"}
Jul 17 06:21:47.628305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:47.628265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" event={"ID":"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0","Type":"ContainerStarted","Data":"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"}
Jul 17 06:21:47.628771 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:47.628338    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:47.649096 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:47.649035    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" podStartSLOduration=2.261537957 podStartE2EDuration="2.649019602s" totalImagesPullingTime="387.481645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:47.646169 +0000 UTC m=+2926.109353104" watchObservedRunningTime="2026-07-17 06:21:47.649019602 +0000 UTC m=+2926.112203705"
Jul 17 06:21:50.823236 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:50.823196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:21:53.641349 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:53.641320    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:21:53.938255 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:53.938182    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:21:53.941856 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:53.941836    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:53.944334 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:53.944314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-efbd92-serving-cert\""
Jul 17 06:21:53.951484 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:53.951461    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:21:54.063507 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.063466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.063724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.063581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.063724 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.063645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rdv\" (UniqueName: \"kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.164812 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.164771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.165007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.164849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rdv\" (UniqueName: \"kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.165007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.164910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.165570 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.165544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.167504 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.167482    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.176117 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.176095    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rdv\" (UniqueName: \"kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv\") pod \"maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.253979 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.253949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:54.393885 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:21:54.393854    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6ffdd8_bbac_4a4a_b7b1_878b537d2061.slice/crio-25d43d93a8411a11635047f97bc8d46dd8e9c1b6454074ecb5b3cb30a50e5598 WatchSource:0}: Error finding container 25d43d93a8411a11635047f97bc8d46dd8e9c1b6454074ecb5b3cb30a50e5598: Status 404 returned error can't find the container with id 25d43d93a8411a11635047f97bc8d46dd8e9c1b6454074ecb5b3cb30a50e5598
Jul 17 06:21:54.394053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.394032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:21:54.671614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:54.671524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" event={"ID":"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061","Type":"ContainerStarted","Data":"25d43d93a8411a11635047f97bc8d46dd8e9c1b6454074ecb5b3cb30a50e5598"}
Jul 17 06:21:55.678177 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:55.678142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" event={"ID":"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061","Type":"ContainerStarted","Data":"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"}
Jul 17 06:21:55.678605 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:55.678258    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:21:55.695969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:55.695910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" podStartSLOduration=2.323288882 podStartE2EDuration="2.695894466s" totalImagesPullingTime="372.605584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:55.693586465 +0000 UTC m=+2934.156770574" watchObservedRunningTime="2026-07-17 06:21:55.695894466 +0000 UTC m=+2934.159078569"
Jul 17 06:21:57.015212 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:57.015178    2567 scope.go:117] "RemoveContainer" containerID="9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361"
Jul 17 06:21:57.691143 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:57.691111    2567 generic.go:356] "Generic (PLEG): container finished" podID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerID="4de95f62c85f8755500173b720ce4f5de51f449abd967f1654564ac4a4db9e8c" exitCode=6
Jul 17 06:21:57.691292 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:57.691189    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerDied","Data":"4de95f62c85f8755500173b720ce4f5de51f449abd967f1654564ac4a4db9e8c"}
Jul 17 06:21:57.691292 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:57.691255    2567 scope.go:117] "RemoveContainer" containerID="9d5283bdca0f0c42d5f82130aa86705fecafef23c8832e6cb515befc92e56361"
Jul 17 06:21:57.691599 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:57.691582    2567 scope.go:117] "RemoveContainer" containerID="4de95f62c85f8755500173b720ce4f5de51f449abd967f1654564ac4a4db9e8c"
Jul 17 06:21:57.691851 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:21:57.691832    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf_odh-ai-gateway-infra(9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17"
Jul 17 06:21:58.717499 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:58.717464    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:21:58.857388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:58.857358    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:58.907156 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:58.907118    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca\") pod \"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17\" (UID: \"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17\") "
Jul 17 06:21:58.907436 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:58.907415    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" (UID: "9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:21:59.008843 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.008762    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:21:59.705775 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.705739    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"
Jul 17 06:21:59.705775 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.705750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf" event={"ID":"9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17","Type":"ContainerDied","Data":"30da3c13f8ebca641a65a21cec015fceb332651bf085e76415e8fa31ded04541"}
Jul 17 06:21:59.706038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.705823    2567 scope.go:117] "RemoveContainer" containerID="4de95f62c85f8755500173b720ce4f5de51f449abd967f1654564ac4a4db9e8c"
Jul 17 06:21:59.729356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.729324    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:21:59.736492 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:21:59.736468    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-lgndf"]
Jul 17 06:22:00.021120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.021039    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" path="/var/lib/kubelet/pods/9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17/volumes"
Jul 17 06:22:00.021665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.021650    2567 scope.go:117] "RemoveContainer" containerID="a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6"
Jul 17 06:22:00.715419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.715390    2567 generic.go:356] "Generic (PLEG): container finished" podID="31251de5-8967-473c-b7bf-eee891f09e20" containerID="ba0fea37bb1ea79570e6cdd707f7de4ef354c5e06c1f233872374ff931ca8ac9" exitCode=6
Jul 17 06:22:00.715582 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.715464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerDied","Data":"ba0fea37bb1ea79570e6cdd707f7de4ef354c5e06c1f233872374ff931ca8ac9"}
Jul 17 06:22:00.715582 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.715523    2567 scope.go:117] "RemoveContainer" containerID="a7d25f53c28332982603582224563f681abf75351e16923871b329234e4b89f6"
Jul 17 06:22:00.715797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:00.715784    2567 scope.go:117] "RemoveContainer" containerID="ba0fea37bb1ea79570e6cdd707f7de4ef354c5e06c1f233872374ff931ca8ac9"
Jul 17 06:22:00.716041 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:22:00.716017    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv_odh-ai-gateway-infra(31251de5-8967-473c-b7bf-eee891f09e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" podUID="31251de5-8967-473c-b7bf-eee891f09e20"
Jul 17 06:22:01.689845 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:01.689811    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:22:01.747848 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:01.747816    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:22:01.882881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:01.882855    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:22:01.937739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:01.937703    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca\") pod \"31251de5-8967-473c-b7bf-eee891f09e20\" (UID: \"31251de5-8967-473c-b7bf-eee891f09e20\") "
Jul 17 06:22:01.938038 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:01.938015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31251de5-8967-473c-b7bf-eee891f09e20" (UID: "31251de5-8967-473c-b7bf-eee891f09e20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:22:02.038650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.038622    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31251de5-8967-473c-b7bf-eee891f09e20-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:22:02.332001 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.331912    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:22:02.740467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.740432    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv" event={"ID":"31251de5-8967-473c-b7bf-eee891f09e20","Type":"ContainerDied","Data":"206496cc8f62dec68bb5aa34f848db84c494c7013b3371874644276e57962257"}
Jul 17 06:22:02.740988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.740481    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"
Jul 17 06:22:02.740988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.740495    2567 scope.go:117] "RemoveContainer" containerID="ba0fea37bb1ea79570e6cdd707f7de4ef354c5e06c1f233872374ff931ca8ac9"
Jul 17 06:22:02.767560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.767531    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:22:02.769915 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:02.769894    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-fbjlv"]
Jul 17 06:22:04.021836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:04.021795    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31251de5-8967-473c-b7bf-eee891f09e20" path="/var/lib/kubelet/pods/31251de5-8967-473c-b7bf-eee891f09e20/volumes"
Jul 17 06:22:17.637664 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:17.637629    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:22:38.453630 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.453591    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:38.454213 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454191    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454216    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454227    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454235    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454275    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454284    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454293    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454300    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454310    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454319    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454441    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454453    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454462    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454477    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:22:38.454762 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.454486    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:22:38.458964 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.458942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:38.461745 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.461721    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:22:38.465024 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.464987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:38.574822 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.574787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv\" (UID: \"790182b0-e1b2-4889-9d5d-1671a5bdf3ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:38.675543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.675498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv\" (UID: \"790182b0-e1b2-4889-9d5d-1671a5bdf3ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:38.676164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.676140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv\" (UID: \"790182b0-e1b2-4889-9d5d-1671a5bdf3ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:38.771719 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.771619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:38.907470 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.907445    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:38.908930 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:22:38.908898    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790182b0_e1b2_4889_9d5d_1671a5bdf3ab.slice/crio-d2d78f8afc32255e1234fc86344d08739001c7662effab010d2221ddd8f2647b WatchSource:0}: Error finding container d2d78f8afc32255e1234fc86344d08739001c7662effab010d2221ddd8f2647b: Status 404 returned error can't find the container with id d2d78f8afc32255e1234fc86344d08739001c7662effab010d2221ddd8f2647b
Jul 17 06:22:38.939492 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:38.939458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" event={"ID":"790182b0-e1b2-4889-9d5d-1671a5bdf3ab","Type":"ContainerStarted","Data":"d2d78f8afc32255e1234fc86344d08739001c7662effab010d2221ddd8f2647b"}
Jul 17 06:22:39.946894 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:39.946855    2567 generic.go:356] "Generic (PLEG): container finished" podID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerID="ce75fc1870ddebb3061f67389b32995b72408854344217e120e2061b892c7ed4" exitCode=6
Jul 17 06:22:39.947279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:39.946945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" event={"ID":"790182b0-e1b2-4889-9d5d-1671a5bdf3ab","Type":"ContainerDied","Data":"ce75fc1870ddebb3061f67389b32995b72408854344217e120e2061b892c7ed4"}
Jul 17 06:22:39.947279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:39.947178    2567 scope.go:117] "RemoveContainer" containerID="ce75fc1870ddebb3061f67389b32995b72408854344217e120e2061b892c7ed4"
Jul 17 06:22:40.954099 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:40.954059    2567 generic.go:356] "Generic (PLEG): container finished" podID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerID="3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8" exitCode=6
Jul 17 06:22:40.954560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:40.954141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" event={"ID":"790182b0-e1b2-4889-9d5d-1671a5bdf3ab","Type":"ContainerDied","Data":"3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8"}
Jul 17 06:22:40.954560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:40.954202    2567 scope.go:117] "RemoveContainer" containerID="ce75fc1870ddebb3061f67389b32995b72408854344217e120e2061b892c7ed4"
Jul 17 06:22:40.954560 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:40.954344    2567 scope.go:117] "RemoveContainer" containerID="3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8"
Jul 17 06:22:40.954777 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:22:40.954594    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv_odh-ai-gateway-infra(790182b0-e1b2-4889-9d5d-1671a5bdf3ab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab"
Jul 17 06:22:41.961541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:41.961505    2567 scope.go:117] "RemoveContainer" containerID="3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8"
Jul 17 06:22:41.961974 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:22:41.961723    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv_odh-ai-gateway-infra(790182b0-e1b2-4889-9d5d-1671a5bdf3ab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab"
Jul 17 06:22:53.014759 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:53.014726    2567 scope.go:117] "RemoveContainer" containerID="3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8"
Jul 17 06:22:54.030072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:54.030035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:22:54.033467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:54.033442    2567 generic.go:356] "Generic (PLEG): container finished" podID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerID="8f413b2988a654785f912a928294df6f6495fdd4dd127b9c33a2fbaa22e624df" exitCode=6
Jul 17 06:22:54.033598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:54.033508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" event={"ID":"790182b0-e1b2-4889-9d5d-1671a5bdf3ab","Type":"ContainerDied","Data":"8f413b2988a654785f912a928294df6f6495fdd4dd127b9c33a2fbaa22e624df"}
Jul 17 06:22:54.033598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:54.033559    2567 scope.go:117] "RemoveContainer" containerID="3465ee84a55423c41c0889fe63f8e1ed8fb2d63698ad1335d6be973a0cc07de8"
Jul 17 06:22:54.033835 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:54.033819    2567 scope.go:117] "RemoveContainer" containerID="8f413b2988a654785f912a928294df6f6495fdd4dd127b9c33a2fbaa22e624df"
Jul 17 06:22:54.034039 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:22:54.034019    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv_odh-ai-gateway-infra(790182b0-e1b2-4889-9d5d-1671a5bdf3ab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab"
Jul 17 06:22:55.059261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:55.059224    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:55.194140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:55.194108    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:55.221760 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:55.221731    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca\") pod \"790182b0-e1b2-4889-9d5d-1671a5bdf3ab\" (UID: \"790182b0-e1b2-4889-9d5d-1671a5bdf3ab\") "
Jul 17 06:22:55.222064 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:55.222037    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "790182b0-e1b2-4889-9d5d-1671a5bdf3ab" (UID: "790182b0-e1b2-4889-9d5d-1671a5bdf3ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:22:55.322829 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:55.322742    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790182b0-e1b2-4889-9d5d-1671a5bdf3ab-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:22:56.047730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:56.047700    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"
Jul 17 06:22:56.047907 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:56.047699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv" event={"ID":"790182b0-e1b2-4889-9d5d-1671a5bdf3ab","Type":"ContainerDied","Data":"d2d78f8afc32255e1234fc86344d08739001c7662effab010d2221ddd8f2647b"}
Jul 17 06:22:56.047907 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:56.047844    2567 scope.go:117] "RemoveContainer" containerID="8f413b2988a654785f912a928294df6f6495fdd4dd127b9c33a2fbaa22e624df"
Jul 17 06:22:56.064561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:56.064535    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:56.070260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:56.070236    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-rfnbv"]
Jul 17 06:22:58.020565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:22:58.020522    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" path="/var/lib/kubelet/pods/790182b0-e1b2-4889-9d5d-1671a5bdf3ab/volumes"
Jul 17 06:23:02.318606 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:02.318575    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:23:02.333409 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:02.333385    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:23:04.449379 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449343    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449743    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449757    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449776    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449793    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:23:04.449800 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449800    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31251de5-8967-473c-b7bf-eee891f09e20" containerName="revoke-keys"
Jul 17 06:23:04.450001 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449866    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.450001 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449873    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:04.450001 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.449883    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea6e935-9aaf-4cb9-84c6-1e2cc7971b17" containerName="revoke-keys"
Jul 17 06:23:04.454425 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.454406    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:04.457092 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.457066    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:23:04.460600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.460575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:04.504516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.504486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn\" (UID: \"7e4f8a19-7700-43ee-a72d-29997d3fb5c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:04.605490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.605455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn\" (UID: \"7e4f8a19-7700-43ee-a72d-29997d3fb5c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:04.606106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.606086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn\" (UID: \"7e4f8a19-7700-43ee-a72d-29997d3fb5c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:04.766110 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.766012    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:04.900917 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:04.900887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:04.902315 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:23:04.902289    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f8a19_7700_43ee_a72d_29997d3fb5c9.slice/crio-c2220cb3a2fdd719a6a7229a6b458f69227683f1097cf8d95c0f0124fed8818f WatchSource:0}: Error finding container c2220cb3a2fdd719a6a7229a6b458f69227683f1097cf8d95c0f0124fed8818f: Status 404 returned error can't find the container with id c2220cb3a2fdd719a6a7229a6b458f69227683f1097cf8d95c0f0124fed8818f
Jul 17 06:23:05.098445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:05.098397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerStarted","Data":"c2220cb3a2fdd719a6a7229a6b458f69227683f1097cf8d95c0f0124fed8818f"}
Jul 17 06:23:06.105902 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:06.105859    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerID="b55c3d5d7b0c3bdeee9447574b771e8d58dbfaebbcc8650b8b8dedd717de35af" exitCode=6
Jul 17 06:23:06.106320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:06.105938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerDied","Data":"b55c3d5d7b0c3bdeee9447574b771e8d58dbfaebbcc8650b8b8dedd717de35af"}
Jul 17 06:23:06.106320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:06.106126    2567 scope.go:117] "RemoveContainer" containerID="b55c3d5d7b0c3bdeee9447574b771e8d58dbfaebbcc8650b8b8dedd717de35af"
Jul 17 06:23:07.114007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:07.113917    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerID="9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe" exitCode=6
Jul 17 06:23:07.114400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:07.114003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerDied","Data":"9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe"}
Jul 17 06:23:07.114400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:07.114074    2567 scope.go:117] "RemoveContainer" containerID="b55c3d5d7b0c3bdeee9447574b771e8d58dbfaebbcc8650b8b8dedd717de35af"
Jul 17 06:23:07.114400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:07.114279    2567 scope.go:117] "RemoveContainer" containerID="9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe"
Jul 17 06:23:07.114554 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:07.114490    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn_odh-ai-gateway-infra(7e4f8a19-7700-43ee-a72d-29997d3fb5c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9"
Jul 17 06:23:08.121170 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:08.121144    2567 scope.go:117] "RemoveContainer" containerID="9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe"
Jul 17 06:23:08.121628 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:08.121329    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn_odh-ai-gateway-infra(7e4f8a19-7700-43ee-a72d-29997d3fb5c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9"
Jul 17 06:23:11.157539 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.157500    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:11.157952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.157921    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:11.157952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.157933    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:11.158033 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.157991    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="790182b0-e1b2-4889-9d5d-1671a5bdf3ab" containerName="revoke-keys"
Jul 17 06:23:11.162367 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.162348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:11.169137 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.169110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:11.269841 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.269807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vh8sg\" (UID: \"d4b09c54-4192-4ded-935c-003a608bc019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:11.370651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.370609    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vh8sg\" (UID: \"d4b09c54-4192-4ded-935c-003a608bc019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:11.371296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.371273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-vh8sg\" (UID: \"d4b09c54-4192-4ded-935c-003a608bc019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:11.474839 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.474808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:11.621426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.621400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:11.623165 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:23:11.623136    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b09c54_4192_4ded_935c_003a608bc019.slice/crio-cc7ab4f5477c53404b889584bfd9e990474a96f29d964a759faf9e041a8d8e94 WatchSource:0}: Error finding container cc7ab4f5477c53404b889584bfd9e990474a96f29d964a759faf9e041a8d8e94: Status 404 returned error can't find the container with id cc7ab4f5477c53404b889584bfd9e990474a96f29d964a759faf9e041a8d8e94
Jul 17 06:23:11.726315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:11.726224    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:23:12.144259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:12.144174    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerStarted","Data":"3b6241bf6b1825c2546adbb4b2f9ad9b194b6193ca648aa619e70ec16348107f"}
Jul 17 06:23:12.144259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:12.144225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerStarted","Data":"cc7ab4f5477c53404b889584bfd9e990474a96f29d964a759faf9e041a8d8e94"}
Jul 17 06:23:12.166924 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:12.166871    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" podStartSLOduration=1.166856601 podStartE2EDuration="1.166856601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:23:12.163359391 +0000 UTC m=+3010.626543495" watchObservedRunningTime="2026-07-17 06:23:12.166856601 +0000 UTC m=+3010.630040704"
Jul 17 06:23:13.151556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:13.151521    2567 generic.go:356] "Generic (PLEG): container finished" podID="d4b09c54-4192-4ded-935c-003a608bc019" containerID="3b6241bf6b1825c2546adbb4b2f9ad9b194b6193ca648aa619e70ec16348107f" exitCode=6
Jul 17 06:23:13.151786 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:13.151614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerDied","Data":"3b6241bf6b1825c2546adbb4b2f9ad9b194b6193ca648aa619e70ec16348107f"}
Jul 17 06:23:13.151840 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:13.151785    2567 scope.go:117] "RemoveContainer" containerID="3b6241bf6b1825c2546adbb4b2f9ad9b194b6193ca648aa619e70ec16348107f"
Jul 17 06:23:14.159379 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:14.159344    2567 generic.go:356] "Generic (PLEG): container finished" podID="d4b09c54-4192-4ded-935c-003a608bc019" containerID="da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74" exitCode=6
Jul 17 06:23:14.159831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:14.159421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerDied","Data":"da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74"}
Jul 17 06:23:14.159831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:14.159482    2567 scope.go:117] "RemoveContainer" containerID="3b6241bf6b1825c2546adbb4b2f9ad9b194b6193ca648aa619e70ec16348107f"
Jul 17 06:23:14.159831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:14.159755    2567 scope.go:117] "RemoveContainer" containerID="da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74"
Jul 17 06:23:14.160005 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:14.159984    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vh8sg_odh-ai-gateway-infra(d4b09c54-4192-4ded-935c-003a608bc019)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" podUID="d4b09c54-4192-4ded-935c-003a608bc019"
Jul 17 06:23:15.166362 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:15.166338    2567 scope.go:117] "RemoveContainer" containerID="da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74"
Jul 17 06:23:15.166760 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:15.166544    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vh8sg_odh-ai-gateway-infra(d4b09c54-4192-4ded-935c-003a608bc019)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" podUID="d4b09c54-4192-4ded-935c-003a608bc019"
Jul 17 06:23:20.015318 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:20.015265    2567 scope.go:117] "RemoveContainer" containerID="9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe"
Jul 17 06:23:20.199869 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:20.199838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerStarted","Data":"421c2ebc653bd0200cfab4ca1623550fd805d0b118b2db07948b0b90280b3925"}
Jul 17 06:23:20.217026 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:20.216967    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" podStartSLOduration=16.216951315 podStartE2EDuration="16.216951315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:23:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:23:20.216044929 +0000 UTC m=+3018.679229033" watchObservedRunningTime="2026-07-17 06:23:20.216951315 +0000 UTC m=+3018.680135418"
Jul 17 06:23:21.208106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:21.208076    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerID="421c2ebc653bd0200cfab4ca1623550fd805d0b118b2db07948b0b90280b3925" exitCode=6
Jul 17 06:23:21.208558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:21.208130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerDied","Data":"421c2ebc653bd0200cfab4ca1623550fd805d0b118b2db07948b0b90280b3925"}
Jul 17 06:23:21.208558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:21.208178    2567 scope.go:117] "RemoveContainer" containerID="9a9f9cd47d97d63edbb29379303eb679d068aee8732834341b738cfc8ab9a7fe"
Jul 17 06:23:21.208558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:21.208460    2567 scope.go:117] "RemoveContainer" containerID="421c2ebc653bd0200cfab4ca1623550fd805d0b118b2db07948b0b90280b3925"
Jul 17 06:23:21.208777 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:21.208752    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn_odh-ai-gateway-infra(7e4f8a19-7700-43ee-a72d-29997d3fb5c9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9"
Jul 17 06:23:21.228396 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:21.228370    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:22.357277 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:22.357245    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:22.472575 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:22.472493    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca\") pod \"7e4f8a19-7700-43ee-a72d-29997d3fb5c9\" (UID: \"7e4f8a19-7700-43ee-a72d-29997d3fb5c9\") "
Jul 17 06:23:22.472871 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:22.472849    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e4f8a19-7700-43ee-a72d-29997d3fb5c9" (UID: "7e4f8a19-7700-43ee-a72d-29997d3fb5c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:23:22.573665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:22.573620    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e4f8a19-7700-43ee-a72d-29997d3fb5c9-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:23:23.222263 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:23.222232    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"
Jul 17 06:23:23.222494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:23.222234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn" event={"ID":"7e4f8a19-7700-43ee-a72d-29997d3fb5c9","Type":"ContainerDied","Data":"c2220cb3a2fdd719a6a7229a6b458f69227683f1097cf8d95c0f0124fed8818f"}
Jul 17 06:23:23.222494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:23.222378    2567 scope.go:117] "RemoveContainer" containerID="421c2ebc653bd0200cfab4ca1623550fd805d0b118b2db07948b0b90280b3925"
Jul 17 06:23:23.245897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:23.245869    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:23.251403 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:23.251378    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-fcjhn"]
Jul 17 06:23:24.020655 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:24.020620    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" path="/var/lib/kubelet/pods/7e4f8a19-7700-43ee-a72d-29997d3fb5c9/volumes"
Jul 17 06:23:28.496947 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.496905    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497304    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497315    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497323    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497328    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497336    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497341    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497420    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.499320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.497428    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:28.500529 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.500513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:28.509737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.509709    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:28.638188 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.638141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h\" (UID: \"4c0736ce-f9d2-4425-b395-4112308b2fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:28.739613 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.739576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h\" (UID: \"4c0736ce-f9d2-4425-b395-4112308b2fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:28.740231 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.740209    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h\" (UID: \"4c0736ce-f9d2-4425-b395-4112308b2fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:28.812431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.812359    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:28.952238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:28.952209    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:28.953675 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:23:28.953643    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0736ce_f9d2_4425_b395_4112308b2fd0.slice/crio-264ffbe6c14cd7918bf16afdee956c8a3634be0becaec24f5e13afabab76dce8 WatchSource:0}: Error finding container 264ffbe6c14cd7918bf16afdee956c8a3634be0becaec24f5e13afabab76dce8: Status 404 returned error can't find the container with id 264ffbe6c14cd7918bf16afdee956c8a3634be0becaec24f5e13afabab76dce8
Jul 17 06:23:29.015365 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:29.015342    2567 scope.go:117] "RemoveContainer" containerID="da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74"
Jul 17 06:23:29.257536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:29.257502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerStarted","Data":"264ffbe6c14cd7918bf16afdee956c8a3634be0becaec24f5e13afabab76dce8"}
Jul 17 06:23:30.264437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.264402    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerID="dd110484b46550495f4ed433277005290e6de9b6aedf6e5cf9734492a794e40c" exitCode=6
Jul 17 06:23:30.264955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.264483    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerDied","Data":"dd110484b46550495f4ed433277005290e6de9b6aedf6e5cf9734492a794e40c"}
Jul 17 06:23:30.264955 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.264713    2567 scope.go:117] "RemoveContainer" containerID="dd110484b46550495f4ed433277005290e6de9b6aedf6e5cf9734492a794e40c"
Jul 17 06:23:30.266573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.266554    2567 generic.go:356] "Generic (PLEG): container finished" podID="d4b09c54-4192-4ded-935c-003a608bc019" containerID="d0a892ad16f14805ffe29b8b37a1a8d9c98c5a3b8c5a955e2b86d3b31b4a3737" exitCode=6
Jul 17 06:23:30.266665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.266576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerDied","Data":"d0a892ad16f14805ffe29b8b37a1a8d9c98c5a3b8c5a955e2b86d3b31b4a3737"}
Jul 17 06:23:30.266665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.266618    2567 scope.go:117] "RemoveContainer" containerID="da25c6bd56aa8ad3343c63502a1aa642c150605b8f3540bd80cdc475c718ee74"
Jul 17 06:23:30.266944 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:30.266924    2567 scope.go:117] "RemoveContainer" containerID="d0a892ad16f14805ffe29b8b37a1a8d9c98c5a3b8c5a955e2b86d3b31b4a3737"
Jul 17 06:23:30.267418 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:30.267389    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-vh8sg_odh-ai-gateway-infra(d4b09c54-4192-4ded-935c-003a608bc019)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" podUID="d4b09c54-4192-4ded-935c-003a608bc019"
Jul 17 06:23:31.032856 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.032818    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:23:31.273971 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.273933    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerID="4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e" exitCode=6
Jul 17 06:23:31.274454 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.274016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerDied","Data":"4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e"}
Jul 17 06:23:31.274454 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.274079    2567 scope.go:117] "RemoveContainer" containerID="dd110484b46550495f4ed433277005290e6de9b6aedf6e5cf9734492a794e40c"
Jul 17 06:23:31.274454 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.274293    2567 scope.go:117] "RemoveContainer" containerID="4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e"
Jul 17 06:23:31.274602 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:31.274533    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h_odh-ai-gateway-infra(4c0736ce-f9d2-4425-b395-4112308b2fd0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0"
Jul 17 06:23:31.314197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.314163    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:31.456229 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.456205    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:31.460841 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.460823    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca\") pod \"d4b09c54-4192-4ded-935c-003a608bc019\" (UID: \"d4b09c54-4192-4ded-935c-003a608bc019\") "
Jul 17 06:23:31.461171 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.461152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4b09c54-4192-4ded-935c-003a608bc019" (UID: "d4b09c54-4192-4ded-935c-003a608bc019"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:23:31.562106 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:31.562026    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4b09c54-4192-4ded-935c-003a608bc019-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:23:32.288930 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.288824    2567 scope.go:117] "RemoveContainer" containerID="4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e"
Jul 17 06:23:32.289352 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:32.289023    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h_odh-ai-gateway-infra(4c0736ce-f9d2-4425-b395-4112308b2fd0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0"
Jul 17 06:23:32.289970 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.289952    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"
Jul 17 06:23:32.290057 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.289955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg" event={"ID":"d4b09c54-4192-4ded-935c-003a608bc019","Type":"ContainerDied","Data":"cc7ab4f5477c53404b889584bfd9e990474a96f29d964a759faf9e041a8d8e94"}
Jul 17 06:23:32.290152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.290136    2567 scope.go:117] "RemoveContainer" containerID="d0a892ad16f14805ffe29b8b37a1a8d9c98c5a3b8c5a955e2b86d3b31b4a3737"
Jul 17 06:23:32.320044 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.319995    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:32.327307 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:32.327279    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-vh8sg"]
Jul 17 06:23:34.021370 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:34.021337    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b09c54-4192-4ded-935c-003a608bc019" path="/var/lib/kubelet/pods/d4b09c54-4192-4ded-935c-003a608bc019/volumes"
Jul 17 06:23:42.798406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798368    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798767    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798778    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798796    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798801    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798863    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798870    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4f8a19-7700-43ee-a72d-29997d3fb5c9" containerName="revoke-keys"
Jul 17 06:23:42.798899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.798877    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:42.802010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.801994    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:23:42.811459 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.811424    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:23:42.856890 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.856854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc\" (UID: \"61c21d79-8062-4f73-a79c-1f06a97ceead\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:23:42.958107 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.958073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc\" (UID: \"61c21d79-8062-4f73-a79c-1f06a97ceead\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:23:42.958725 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:42.958705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc\" (UID: \"61c21d79-8062-4f73-a79c-1f06a97ceead\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:23:43.114735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:43.114616    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:23:43.257075 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:43.257037    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:23:43.258056 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:23:43.258028    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c21d79_8062_4f73_a79c_1f06a97ceead.slice/crio-a7148a3d7870520d895229c1ee71fb30efcfa5b03df198683b306f38b86a308b WatchSource:0}: Error finding container a7148a3d7870520d895229c1ee71fb30efcfa5b03df198683b306f38b86a308b: Status 404 returned error can't find the container with id a7148a3d7870520d895229c1ee71fb30efcfa5b03df198683b306f38b86a308b
Jul 17 06:23:43.362015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:43.361982    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerStarted","Data":"a7148a3d7870520d895229c1ee71fb30efcfa5b03df198683b306f38b86a308b"}
Jul 17 06:23:44.368862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:44.368825    2567 generic.go:356] "Generic (PLEG): container finished" podID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerID="0537bcf3db7c3b20f773c0edafe95e14d0969f209f00298142a5d67cbcc8bee6" exitCode=6
Jul 17 06:23:44.369249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:44.368894    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerDied","Data":"0537bcf3db7c3b20f773c0edafe95e14d0969f209f00298142a5d67cbcc8bee6"}
Jul 17 06:23:44.369249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:44.369065    2567 scope.go:117] "RemoveContainer" containerID="0537bcf3db7c3b20f773c0edafe95e14d0969f209f00298142a5d67cbcc8bee6"
Jul 17 06:23:45.380604 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:45.380517    2567 generic.go:356] "Generic (PLEG): container finished" podID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerID="866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374" exitCode=6
Jul 17 06:23:45.381029 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:45.380602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerDied","Data":"866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374"}
Jul 17 06:23:45.381029 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:45.380662    2567 scope.go:117] "RemoveContainer" containerID="0537bcf3db7c3b20f773c0edafe95e14d0969f209f00298142a5d67cbcc8bee6"
Jul 17 06:23:45.381029 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:45.380869    2567 scope.go:117] "RemoveContainer" containerID="866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374"
Jul 17 06:23:45.381158 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:45.381100    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc_odh-ai-gateway-infra(61c21d79-8062-4f73-a79c-1f06a97ceead)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead"
Jul 17 06:23:46.387723 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:46.387671    2567 scope.go:117] "RemoveContainer" containerID="866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374"
Jul 17 06:23:46.388153 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:46.387870    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc_odh-ai-gateway-infra(61c21d79-8062-4f73-a79c-1f06a97ceead)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead"
Jul 17 06:23:46.719831 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:46.719791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:23:47.015909 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:47.015819    2567 scope.go:117] "RemoveContainer" containerID="4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e"
Jul 17 06:23:47.395360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:47.395325    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerStarted","Data":"3d6a663e4704d011f8aa96741f689b9f10afacdc837b68778ae1be57707341d1"}
Jul 17 06:23:47.415445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:47.415393    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" podStartSLOduration=19.415377355 podStartE2EDuration="19.415377355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:23:47.412033614 +0000 UTC m=+3045.875217720" watchObservedRunningTime="2026-07-17 06:23:47.415377355 +0000 UTC m=+3045.878561460"
Jul 17 06:23:48.403716 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:48.403658    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerID="3d6a663e4704d011f8aa96741f689b9f10afacdc837b68778ae1be57707341d1" exitCode=6
Jul 17 06:23:48.404130 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:48.403732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerDied","Data":"3d6a663e4704d011f8aa96741f689b9f10afacdc837b68778ae1be57707341d1"}
Jul 17 06:23:48.404130 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:48.403798    2567 scope.go:117] "RemoveContainer" containerID="4fffb6309c3364ea52ab5750e0aca8b6d8b9d4f0e9a89fe852a5c04fc899d84e"
Jul 17 06:23:48.404222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:48.404150    2567 scope.go:117] "RemoveContainer" containerID="3d6a663e4704d011f8aa96741f689b9f10afacdc837b68778ae1be57707341d1"
Jul 17 06:23:48.404409 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:48.404385    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h_odh-ai-gateway-infra(4c0736ce-f9d2-4425-b395-4112308b2fd0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0"
Jul 17 06:23:48.424728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:48.424703    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:49.547348 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:49.547321    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:49.619084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:49.619051    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca\") pod \"4c0736ce-f9d2-4425-b395-4112308b2fd0\" (UID: \"4c0736ce-f9d2-4425-b395-4112308b2fd0\") "
Jul 17 06:23:49.619445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:49.619426    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c0736ce-f9d2-4425-b395-4112308b2fd0" (UID: "4c0736ce-f9d2-4425-b395-4112308b2fd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:23:49.720633 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:49.720589    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0736ce-f9d2-4425-b395-4112308b2fd0-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:23:50.419462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:50.419375    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"
Jul 17 06:23:50.419462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:50.419377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h" event={"ID":"4c0736ce-f9d2-4425-b395-4112308b2fd0","Type":"ContainerDied","Data":"264ffbe6c14cd7918bf16afdee956c8a3634be0becaec24f5e13afabab76dce8"}
Jul 17 06:23:50.419728 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:50.419506    2567 scope.go:117] "RemoveContainer" containerID="3d6a663e4704d011f8aa96741f689b9f10afacdc837b68778ae1be57707341d1"
Jul 17 06:23:50.440829 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:50.440800    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:50.446002 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:50.445978    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-gpd7h"]
Jul 17 06:23:52.021398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:52.021365    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" path="/var/lib/kubelet/pods/4c0736ce-f9d2-4425-b395-4112308b2fd0/volumes"
Jul 17 06:23:54.506273 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506193    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506571    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506583    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506592    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506597    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506608    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506613    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506698    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b09c54-4192-4ded-935c-003a608bc019" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506706    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.506732 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.506712    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:23:54.511175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.511160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:23:54.522545 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.522519    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:23:54.562887 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.562841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-d65fq\" (UID: \"af42dbdb-7627-425d-903e-c1e9a1a7164a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:23:54.664281 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.664244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-d65fq\" (UID: \"af42dbdb-7627-425d-903e-c1e9a1a7164a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:23:54.664933 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.664911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-d65fq\" (UID: \"af42dbdb-7627-425d-903e-c1e9a1a7164a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:23:54.821988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.821892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:23:54.958414 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:54.958385    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:23:54.960296 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:23:54.960269    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf42dbdb_7627_425d_903e_c1e9a1a7164a.slice/crio-ff2f5914c108b8ab068fd031f63b4064c994ae06644bc6b6ab7d56b7563ae6b7 WatchSource:0}: Error finding container ff2f5914c108b8ab068fd031f63b4064c994ae06644bc6b6ab7d56b7563ae6b7: Status 404 returned error can't find the container with id ff2f5914c108b8ab068fd031f63b4064c994ae06644bc6b6ab7d56b7563ae6b7
Jul 17 06:23:55.451041 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:55.451001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerStarted","Data":"77e0b2f1b7e90f34ddcfe7c9d78a586ada9506efffe0c26b4ac887b0e5bc09fb"}
Jul 17 06:23:55.451249 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:55.451099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerStarted","Data":"ff2f5914c108b8ab068fd031f63b4064c994ae06644bc6b6ab7d56b7563ae6b7"}
Jul 17 06:23:55.468773 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:55.468714    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" podStartSLOduration=1.468674757 podStartE2EDuration="1.468674757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:23:55.467339153 +0000 UTC m=+3053.930523259" watchObservedRunningTime="2026-07-17 06:23:55.468674757 +0000 UTC m=+3053.931858860"
Jul 17 06:23:56.460766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:56.460727    2567 generic.go:356] "Generic (PLEG): container finished" podID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerID="77e0b2f1b7e90f34ddcfe7c9d78a586ada9506efffe0c26b4ac887b0e5bc09fb" exitCode=6
Jul 17 06:23:56.461175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:56.460783    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerDied","Data":"77e0b2f1b7e90f34ddcfe7c9d78a586ada9506efffe0c26b4ac887b0e5bc09fb"}
Jul 17 06:23:56.461175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:56.460980    2567 scope.go:117] "RemoveContainer" containerID="77e0b2f1b7e90f34ddcfe7c9d78a586ada9506efffe0c26b4ac887b0e5bc09fb"
Jul 17 06:23:57.468815 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:57.468784    2567 generic.go:356] "Generic (PLEG): container finished" podID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerID="41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99" exitCode=6
Jul 17 06:23:57.469252 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:57.468876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerDied","Data":"41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99"}
Jul 17 06:23:57.469252 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:57.468931    2567 scope.go:117] "RemoveContainer" containerID="77e0b2f1b7e90f34ddcfe7c9d78a586ada9506efffe0c26b4ac887b0e5bc09fb"
Jul 17 06:23:57.469252 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:57.469066    2567 scope.go:117] "RemoveContainer" containerID="41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99"
Jul 17 06:23:57.469394 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:57.469312    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-d65fq_odh-ai-gateway-infra(af42dbdb-7627-425d-903e-c1e9a1a7164a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a"
Jul 17 06:23:58.015665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:58.015636    2567 scope.go:117] "RemoveContainer" containerID="866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374"
Jul 17 06:23:58.477152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:58.477118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerStarted","Data":"d2674b582ad18163c187a4c7c0fd224ce0110e09b6546c84e24ad07d589ac245"}
Jul 17 06:23:58.478833 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:58.478811    2567 scope.go:117] "RemoveContainer" containerID="41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99"
Jul 17 06:23:58.479031 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:58.479009    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-d65fq_odh-ai-gateway-infra(af42dbdb-7627-425d-903e-c1e9a1a7164a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a"
Jul 17 06:23:58.495185 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:58.495139    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" podStartSLOduration=16.495124875 podStartE2EDuration="16.495124875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:23:58.493095239 +0000 UTC m=+3056.956279341" watchObservedRunningTime="2026-07-17 06:23:58.495124875 +0000 UTC m=+3056.958308978"
Jul 17 06:23:59.486077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:59.486039    2567 generic.go:356] "Generic (PLEG): container finished" podID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerID="d2674b582ad18163c187a4c7c0fd224ce0110e09b6546c84e24ad07d589ac245" exitCode=6
Jul 17 06:23:59.486543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:59.486086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerDied","Data":"d2674b582ad18163c187a4c7c0fd224ce0110e09b6546c84e24ad07d589ac245"}
Jul 17 06:23:59.486543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:59.486136    2567 scope.go:117] "RemoveContainer" containerID="866aefe47e7ac760a596206d50fd363356528d15ae49f5bab624b0f6fedf2374"
Jul 17 06:23:59.486543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:59.486364    2567 scope.go:117] "RemoveContainer" containerID="d2674b582ad18163c187a4c7c0fd224ce0110e09b6546c84e24ad07d589ac245"
Jul 17 06:23:59.486706 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:23:59.486665    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc_odh-ai-gateway-infra(61c21d79-8062-4f73-a79c-1f06a97ceead)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead"
Jul 17 06:23:59.503720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:23:59.503694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:24:00.441647 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:00.441605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:24:00.629899 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:00.629873    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:24:00.720073 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:00.719983    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca\") pod \"61c21d79-8062-4f73-a79c-1f06a97ceead\" (UID: \"61c21d79-8062-4f73-a79c-1f06a97ceead\") "
Jul 17 06:24:00.720320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:00.720299    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61c21d79-8062-4f73-a79c-1f06a97ceead" (UID: "61c21d79-8062-4f73-a79c-1f06a97ceead"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:24:00.821654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:00.821614    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c21d79-8062-4f73-a79c-1f06a97ceead-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:01.500364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:01.500337    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"
Jul 17 06:24:01.500567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:01.500367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc" event={"ID":"61c21d79-8062-4f73-a79c-1f06a97ceead","Type":"ContainerDied","Data":"a7148a3d7870520d895229c1ee71fb30efcfa5b03df198683b306f38b86a308b"}
Jul 17 06:24:01.500567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:01.500439    2567 scope.go:117] "RemoveContainer" containerID="d2674b582ad18163c187a4c7c0fd224ce0110e09b6546c84e24ad07d589ac245"
Jul 17 06:24:01.523279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:01.523252    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:24:01.529501 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:01.529480    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-d8gbc"]
Jul 17 06:24:02.021944 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:02.021914    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" path="/var/lib/kubelet/pods/61c21d79-8062-4f73-a79c-1f06a97ceead/volumes"
Jul 17 06:24:11.015174 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.015135    2567 scope.go:117] "RemoveContainer" containerID="41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99"
Jul 17 06:24:11.205845 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.205809    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:11.206233 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206219    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206235    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206255    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:24:11.206278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206261    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:24:11.206278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206271    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206278 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206277    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206289    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206294    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206359    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206370    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:11.206442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.206379    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0736ce-f9d2-4425-b395-4112308b2fd0" containerName="revoke-keys"
Jul 17 06:24:11.210780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.210764    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:11.217976 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.217926    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:11.317897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.317847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ktrzw\" (UID: \"286d98a9-444a-48b8-82ff-f89080acbea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:11.419316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.419275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ktrzw\" (UID: \"286d98a9-444a-48b8-82ff-f89080acbea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:11.419977 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.419956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-ktrzw\" (UID: \"286d98a9-444a-48b8-82ff-f89080acbea1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:11.525019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.524988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:11.560542 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.560506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerStarted","Data":"ae5b5bffceef4d8b439e36ea145eed94cf1d0e19d690f21e155bc6ca07773e07"}
Jul 17 06:24:11.666332 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:11.666306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:11.668509 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:24:11.668479    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286d98a9_444a_48b8_82ff_f89080acbea1.slice/crio-22ec1a3e4bf148c479b12b43f28aa7fe67220c76048ab1f96118189488b280d5 WatchSource:0}: Error finding container 22ec1a3e4bf148c479b12b43f28aa7fe67220c76048ab1f96118189488b280d5: Status 404 returned error can't find the container with id 22ec1a3e4bf148c479b12b43f28aa7fe67220c76048ab1f96118189488b280d5
Jul 17 06:24:12.567739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.567634    2567 generic.go:356] "Generic (PLEG): container finished" podID="286d98a9-444a-48b8-82ff-f89080acbea1" containerID="9162d6e951c67ee1cfc22e07df4363c6702f882cd4fd6e9e2967172c8d08f65a" exitCode=6
Jul 17 06:24:12.568118 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.567733    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" event={"ID":"286d98a9-444a-48b8-82ff-f89080acbea1","Type":"ContainerDied","Data":"9162d6e951c67ee1cfc22e07df4363c6702f882cd4fd6e9e2967172c8d08f65a"}
Jul 17 06:24:12.568118 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.567787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" event={"ID":"286d98a9-444a-48b8-82ff-f89080acbea1","Type":"ContainerStarted","Data":"22ec1a3e4bf148c479b12b43f28aa7fe67220c76048ab1f96118189488b280d5"}
Jul 17 06:24:12.568118 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.567918    2567 scope.go:117] "RemoveContainer" containerID="9162d6e951c67ee1cfc22e07df4363c6702f882cd4fd6e9e2967172c8d08f65a"
Jul 17 06:24:12.569779 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.569756    2567 generic.go:356] "Generic (PLEG): container finished" podID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerID="ae5b5bffceef4d8b439e36ea145eed94cf1d0e19d690f21e155bc6ca07773e07" exitCode=6
Jul 17 06:24:12.569896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.569806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerDied","Data":"ae5b5bffceef4d8b439e36ea145eed94cf1d0e19d690f21e155bc6ca07773e07"}
Jul 17 06:24:12.569896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.569858    2567 scope.go:117] "RemoveContainer" containerID="41e5eeff673fbe1b33e4e231834799b16f5fbf29b947b657e854d880d0f1ea99"
Jul 17 06:24:12.570079 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.570062    2567 scope.go:117] "RemoveContainer" containerID="ae5b5bffceef4d8b439e36ea145eed94cf1d0e19d690f21e155bc6ca07773e07"
Jul 17 06:24:12.570295 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:12.570273    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-d65fq_odh-ai-gateway-infra(af42dbdb-7627-425d-903e-c1e9a1a7164a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a"
Jul 17 06:24:12.593740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:12.593715    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:24:13.577867 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.577835    2567 generic.go:356] "Generic (PLEG): container finished" podID="286d98a9-444a-48b8-82ff-f89080acbea1" containerID="645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01" exitCode=6
Jul 17 06:24:13.578369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.577924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" event={"ID":"286d98a9-444a-48b8-82ff-f89080acbea1","Type":"ContainerDied","Data":"645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01"}
Jul 17 06:24:13.578369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.578003    2567 scope.go:117] "RemoveContainer" containerID="9162d6e951c67ee1cfc22e07df4363c6702f882cd4fd6e9e2967172c8d08f65a"
Jul 17 06:24:13.578369 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.578226    2567 scope.go:117] "RemoveContainer" containerID="645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01"
Jul 17 06:24:13.578544 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:13.578495    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ktrzw_odh-ai-gateway-infra(286d98a9-444a-48b8-82ff-f89080acbea1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" podUID="286d98a9-444a-48b8-82ff-f89080acbea1"
Jul 17 06:24:13.716879 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.716856    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:24:13.843751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.843622    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca\") pod \"af42dbdb-7627-425d-903e-c1e9a1a7164a\" (UID: \"af42dbdb-7627-425d-903e-c1e9a1a7164a\") "
Jul 17 06:24:13.843995 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.843980    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af42dbdb-7627-425d-903e-c1e9a1a7164a" (UID: "af42dbdb-7627-425d-903e-c1e9a1a7164a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:24:13.918464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918408    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:13.918839 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918826    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.918892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918841    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.918892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918861    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.918892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918868    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.918892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918876    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.918892 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918881    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.919053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918943    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c21d79-8062-4f73-a79c-1f06a97ceead" containerName="revoke-keys"
Jul 17 06:24:13.919053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918952    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.919053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918960    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.919053 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.918965    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" containerName="revoke-keys"
Jul 17 06:24:13.922287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.922270    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:13.924854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.924835    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zkl9f\""
Jul 17 06:24:13.930543 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.930524    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:13.944615 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:13.944588    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af42dbdb-7627-425d-903e-c1e9a1a7164a-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:14.045090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.045054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5z2q\" (UniqueName: \"kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q\") pod \"kuadrant-operator-catalog-qxp6g\" (UID: \"372294a8-6436-4745-b405-467016d454c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:14.145997 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.145914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5z2q\" (UniqueName: \"kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q\") pod \"kuadrant-operator-catalog-qxp6g\" (UID: \"372294a8-6436-4745-b405-467016d454c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:14.154809 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.154787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5z2q\" (UniqueName: \"kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q\") pod \"kuadrant-operator-catalog-qxp6g\" (UID: \"372294a8-6436-4745-b405-467016d454c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:14.232596 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.232546    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:14.364366 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.364339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:14.365937 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:24:14.365906    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372294a8_6436_4745_b405_467016d454c7.slice/crio-961750162acb297ca79919231541523d36b6d69e81016c49d70528760b3eff5a WatchSource:0}: Error finding container 961750162acb297ca79919231541523d36b6d69e81016c49d70528760b3eff5a: Status 404 returned error can't find the container with id 961750162acb297ca79919231541523d36b6d69e81016c49d70528760b3eff5a
Jul 17 06:24:14.586242 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.586207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" event={"ID":"372294a8-6436-4745-b405-467016d454c7","Type":"ContainerStarted","Data":"961750162acb297ca79919231541523d36b6d69e81016c49d70528760b3eff5a"}
Jul 17 06:24:14.587481 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.587461    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"
Jul 17 06:24:14.587635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.587494    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq" event={"ID":"af42dbdb-7627-425d-903e-c1e9a1a7164a","Type":"ContainerDied","Data":"ff2f5914c108b8ab068fd031f63b4064c994ae06644bc6b6ab7d56b7563ae6b7"}
Jul 17 06:24:14.587635 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.587556    2567 scope.go:117] "RemoveContainer" containerID="ae5b5bffceef4d8b439e36ea145eed94cf1d0e19d690f21e155bc6ca07773e07"
Jul 17 06:24:14.589503 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.589480    2567 scope.go:117] "RemoveContainer" containerID="645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01"
Jul 17 06:24:14.589786 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:14.589754    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ktrzw_odh-ai-gateway-infra(286d98a9-444a-48b8-82ff-f89080acbea1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" podUID="286d98a9-444a-48b8-82ff-f89080acbea1"
Jul 17 06:24:14.620639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.620605    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:24:14.629240 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:14.629207    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-d65fq"]
Jul 17 06:24:16.021625 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:16.021590    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af42dbdb-7627-425d-903e-c1e9a1a7164a" path="/var/lib/kubelet/pods/af42dbdb-7627-425d-903e-c1e9a1a7164a/volumes"
Jul 17 06:24:17.609148 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:17.609107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" event={"ID":"372294a8-6436-4745-b405-467016d454c7","Type":"ContainerStarted","Data":"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"}
Jul 17 06:24:17.631110 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:17.631053    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" podStartSLOduration=2.431982839 podStartE2EDuration="4.631039183s" totalImagesPullingTime="2.199056344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:24:17.628957371 +0000 UTC m=+3076.092141475" watchObservedRunningTime="2026-07-17 06:24:17.631039183 +0000 UTC m=+3076.094223462"
Jul 17 06:24:20.132573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:20.132536    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:24:24.233400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:24.233361    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:24.233862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:24.233437    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:24.258727 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:24.258671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:24.672614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:24.672539    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:24.720169 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:24.720131    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:26.660936 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:26.660872    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" podUID="372294a8-6436-4745-b405-467016d454c7" containerName="registry-server" containerID="cri-o://3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b" gracePeriod=2
Jul 17 06:24:26.907101 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:26.907077    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:26.958557 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:26.958526    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5z2q\" (UniqueName: \"kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q\") pod \"372294a8-6436-4745-b405-467016d454c7\" (UID: \"372294a8-6436-4745-b405-467016d454c7\") "
Jul 17 06:24:26.960836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:26.960801    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q" (OuterVolumeSpecName: "kube-api-access-q5z2q") pod "372294a8-6436-4745-b405-467016d454c7" (UID: "372294a8-6436-4745-b405-467016d454c7"). InnerVolumeSpecName "kube-api-access-q5z2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:24:27.060107 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.060068    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5z2q\" (UniqueName: \"kubernetes.io/projected/372294a8-6436-4745-b405-467016d454c7-kube-api-access-q5z2q\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:27.667025 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.666993    2567 generic.go:356] "Generic (PLEG): container finished" podID="372294a8-6436-4745-b405-467016d454c7" containerID="3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b" exitCode=0
Jul 17 06:24:27.667514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.667047    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g"
Jul 17 06:24:27.667514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.667076    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" event={"ID":"372294a8-6436-4745-b405-467016d454c7","Type":"ContainerDied","Data":"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"}
Jul 17 06:24:27.667514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.667132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qxp6g" event={"ID":"372294a8-6436-4745-b405-467016d454c7","Type":"ContainerDied","Data":"961750162acb297ca79919231541523d36b6d69e81016c49d70528760b3eff5a"}
Jul 17 06:24:27.667514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.667152    2567 scope.go:117] "RemoveContainer" containerID="3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"
Jul 17 06:24:27.676887 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.676866    2567 scope.go:117] "RemoveContainer" containerID="3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"
Jul 17 06:24:27.677172 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:27.677155    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b\": container with ID starting with 3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b not found: ID does not exist" containerID="3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"
Jul 17 06:24:27.677260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.677179    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b"} err="failed to get container status \"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b\": rpc error: code = NotFound desc = could not find container \"3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b\": container with ID starting with 3693d877ea91b581a3d8bff5cc7d2535f8d1832b1c79a24fcbaacaafaa81899b not found: ID does not exist"
Jul 17 06:24:27.691140 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.691115    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:27.695058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:27.695033    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qxp6g"]
Jul 17 06:24:28.015403 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.015374    2567 scope.go:117] "RemoveContainer" containerID="645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01"
Jul 17 06:24:28.021068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.021040    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372294a8-6436-4745-b405-467016d454c7" path="/var/lib/kubelet/pods/372294a8-6436-4745-b405-467016d454c7/volumes"
Jul 17 06:24:28.560439 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.560402    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:28.560816 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.560802    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372294a8-6436-4745-b405-467016d454c7" containerName="registry-server"
Jul 17 06:24:28.560872 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.560817    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="372294a8-6436-4745-b405-467016d454c7" containerName="registry-server"
Jul 17 06:24:28.560908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.560892    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="372294a8-6436-4745-b405-467016d454c7" containerName="registry-server"
Jul 17 06:24:28.564003 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.563972    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:28.571874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.571842    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:28.576286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.575962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl\" (UID: \"99d60d39-5b17-41e0-adbc-68765a74039b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:28.675125 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.675094    2567 generic.go:356] "Generic (PLEG): container finished" podID="286d98a9-444a-48b8-82ff-f89080acbea1" containerID="952e342cc1390d88d1434285e0f308f6df09b8b930b8aae077c62765aafee13b" exitCode=6
Jul 17 06:24:28.675579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.675154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" event={"ID":"286d98a9-444a-48b8-82ff-f89080acbea1","Type":"ContainerDied","Data":"952e342cc1390d88d1434285e0f308f6df09b8b930b8aae077c62765aafee13b"}
Jul 17 06:24:28.675579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.675211    2567 scope.go:117] "RemoveContainer" containerID="645601c2fdcfa6a74b81dbf7cd812e21fbb1f584980c8fc24cebfe3a4db47d01"
Jul 17 06:24:28.675579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.675460    2567 scope.go:117] "RemoveContainer" containerID="952e342cc1390d88d1434285e0f308f6df09b8b930b8aae077c62765aafee13b"
Jul 17 06:24:28.675729 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:28.675707    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-ktrzw_odh-ai-gateway-infra(286d98a9-444a-48b8-82ff-f89080acbea1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" podUID="286d98a9-444a-48b8-82ff-f89080acbea1"
Jul 17 06:24:28.676405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.676358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl\" (UID: \"99d60d39-5b17-41e0-adbc-68765a74039b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:28.676956 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.676939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl\" (UID: \"99d60d39-5b17-41e0-adbc-68765a74039b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:28.877565 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:28.877457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:29.016010 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.015976    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:29.016664 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:24:29.016637    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d60d39_5b17_41e0_adbc_68765a74039b.slice/crio-0a0a38f9fee4546189793ef403027946f237ad5ae37ea4f6a7c71b84ae9315d6 WatchSource:0}: Error finding container 0a0a38f9fee4546189793ef403027946f237ad5ae37ea4f6a7c71b84ae9315d6: Status 404 returned error can't find the container with id 0a0a38f9fee4546189793ef403027946f237ad5ae37ea4f6a7c71b84ae9315d6
Jul 17 06:24:29.683505 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.683473    2567 generic.go:356] "Generic (PLEG): container finished" podID="99d60d39-5b17-41e0-adbc-68765a74039b" containerID="edeab19912e610b34081508d5769a37a4dc3e8f1f13ec30cec2cb46099efa53d" exitCode=6
Jul 17 06:24:29.684035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.683550    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" event={"ID":"99d60d39-5b17-41e0-adbc-68765a74039b","Type":"ContainerDied","Data":"edeab19912e610b34081508d5769a37a4dc3e8f1f13ec30cec2cb46099efa53d"}
Jul 17 06:24:29.684035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.683590    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" event={"ID":"99d60d39-5b17-41e0-adbc-68765a74039b","Type":"ContainerStarted","Data":"0a0a38f9fee4546189793ef403027946f237ad5ae37ea4f6a7c71b84ae9315d6"}
Jul 17 06:24:29.684035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.683817    2567 scope.go:117] "RemoveContainer" containerID="edeab19912e610b34081508d5769a37a4dc3e8f1f13ec30cec2cb46099efa53d"
Jul 17 06:24:29.703410 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.703385    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:29.844965 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.844899    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:29.886863 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.886830    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca\") pod \"286d98a9-444a-48b8-82ff-f89080acbea1\" (UID: \"286d98a9-444a-48b8-82ff-f89080acbea1\") "
Jul 17 06:24:29.887203 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.887183    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "286d98a9-444a-48b8-82ff-f89080acbea1" (UID: "286d98a9-444a-48b8-82ff-f89080acbea1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:24:29.987735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:29.987709    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/286d98a9-444a-48b8-82ff-f89080acbea1-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:30.416258 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:30.416220    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d60d39_5b17_41e0_adbc_68765a74039b.slice/crio-conmon-24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731.scope\": RecentStats: unable to find data in memory cache]"
Jul 17 06:24:30.691256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.691167    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"
Jul 17 06:24:30.691256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.691168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw" event={"ID":"286d98a9-444a-48b8-82ff-f89080acbea1","Type":"ContainerDied","Data":"22ec1a3e4bf148c479b12b43f28aa7fe67220c76048ab1f96118189488b280d5"}
Jul 17 06:24:30.691777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.691338    2567 scope.go:117] "RemoveContainer" containerID="952e342cc1390d88d1434285e0f308f6df09b8b930b8aae077c62765aafee13b"
Jul 17 06:24:30.693358 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.693319    2567 generic.go:356] "Generic (PLEG): container finished" podID="99d60d39-5b17-41e0-adbc-68765a74039b" containerID="24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731" exitCode=6
Jul 17 06:24:30.693503 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.693483    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" event={"ID":"99d60d39-5b17-41e0-adbc-68765a74039b","Type":"ContainerDied","Data":"24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731"}
Jul 17 06:24:30.693777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.693752    2567 scope.go:117] "RemoveContainer" containerID="24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731"
Jul 17 06:24:30.693977 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:30.693956    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl_odh-ai-gateway-infra(99d60d39-5b17-41e0-adbc-68765a74039b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" podUID="99d60d39-5b17-41e0-adbc-68765a74039b"
Jul 17 06:24:30.700519 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.700503    2567 scope.go:117] "RemoveContainer" containerID="edeab19912e610b34081508d5769a37a4dc3e8f1f13ec30cec2cb46099efa53d"
Jul 17 06:24:30.710074 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.710050    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:30.725773 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:30.725749    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-ktrzw"]
Jul 17 06:24:31.702202 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:31.702175    2567 scope.go:117] "RemoveContainer" containerID="24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731"
Jul 17 06:24:31.702605 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:31.702337    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl_odh-ai-gateway-infra(99d60d39-5b17-41e0-adbc-68765a74039b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" podUID="99d60d39-5b17-41e0-adbc-68765a74039b"
Jul 17 06:24:32.020783 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.020706    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" path="/var/lib/kubelet/pods/286d98a9-444a-48b8-82ff-f89080acbea1/volumes"
Jul 17 06:24:32.880197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880162    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:32.880579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880541    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880552    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880579 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880577    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880582    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880635    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880644    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.880718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.880650    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:32.885216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.885200    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:32.892037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.892009    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:32.912986 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:32.912954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6\" (UID: \"f809cd80-7b3c-40dd-988c-14e6a2eec1d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:33.014262 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.014228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6\" (UID: \"f809cd80-7b3c-40dd-988c-14e6a2eec1d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:33.014948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.014928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6\" (UID: \"f809cd80-7b3c-40dd-988c-14e6a2eec1d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:33.197805 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.197775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:33.338728 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:24:33.338696    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf809cd80_7b3c_40dd_988c_14e6a2eec1d2.slice/crio-315e43e556c9b51aacf86d81d492b4e2cc1805963cebd2592bb69292208bf356 WatchSource:0}: Error finding container 315e43e556c9b51aacf86d81d492b4e2cc1805963cebd2592bb69292208bf356: Status 404 returned error can't find the container with id 315e43e556c9b51aacf86d81d492b4e2cc1805963cebd2592bb69292208bf356
Jul 17 06:24:33.338856 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.338741    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:33.714380 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.714339    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerStarted","Data":"162f00693838b4115f87a627959f06ce2ce5afc7c5117c4738743424cdee44f8"}
Jul 17 06:24:33.714614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.714403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerStarted","Data":"315e43e556c9b51aacf86d81d492b4e2cc1805963cebd2592bb69292208bf356"}
Jul 17 06:24:33.732031 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:33.731976    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" podStartSLOduration=1.7319587159999998 podStartE2EDuration="1.731958716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:24:33.730433618 +0000 UTC m=+3092.193617711" watchObservedRunningTime="2026-07-17 06:24:33.731958716 +0000 UTC m=+3092.195142819"
Jul 17 06:24:34.721326 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:34.721289    2567 generic.go:356] "Generic (PLEG): container finished" podID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerID="162f00693838b4115f87a627959f06ce2ce5afc7c5117c4738743424cdee44f8" exitCode=6
Jul 17 06:24:34.721777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:34.721376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerDied","Data":"162f00693838b4115f87a627959f06ce2ce5afc7c5117c4738743424cdee44f8"}
Jul 17 06:24:34.721777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:34.721556    2567 scope.go:117] "RemoveContainer" containerID="162f00693838b4115f87a627959f06ce2ce5afc7c5117c4738743424cdee44f8"
Jul 17 06:24:35.731970 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:35.731937    2567 generic.go:356] "Generic (PLEG): container finished" podID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerID="0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16" exitCode=6
Jul 17 06:24:35.732456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:35.732024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerDied","Data":"0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16"}
Jul 17 06:24:35.732456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:35.732123    2567 scope.go:117] "RemoveContainer" containerID="162f00693838b4115f87a627959f06ce2ce5afc7c5117c4738743424cdee44f8"
Jul 17 06:24:35.732456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:35.732348    2567 scope.go:117] "RemoveContainer" containerID="0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16"
Jul 17 06:24:35.732623 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:35.732598    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6_odh-ai-gateway-infra(f809cd80-7b3c-40dd-988c-14e6a2eec1d2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2"
Jul 17 06:24:36.740526 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:36.740497    2567 scope.go:117] "RemoveContainer" containerID="0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16"
Jul 17 06:24:36.741109 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:36.740795    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6_odh-ai-gateway-infra(f809cd80-7b3c-40dd-988c-14e6a2eec1d2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2"
Jul 17 06:24:39.524420 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:39.524386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:24:43.015137 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:43.015101    2567 scope.go:117] "RemoveContainer" containerID="24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731"
Jul 17 06:24:43.781932 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:43.781897    2567 generic.go:356] "Generic (PLEG): container finished" podID="99d60d39-5b17-41e0-adbc-68765a74039b" containerID="d857f32c2887d02448811f3bb5bc47958dcc31335195aa6e3649d576e8d7a728" exitCode=6
Jul 17 06:24:43.782120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:43.781969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" event={"ID":"99d60d39-5b17-41e0-adbc-68765a74039b","Type":"ContainerDied","Data":"d857f32c2887d02448811f3bb5bc47958dcc31335195aa6e3649d576e8d7a728"}
Jul 17 06:24:43.782120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:43.782029    2567 scope.go:117] "RemoveContainer" containerID="24fa20dc71c526b12e2788ce8f803bae9d51cc5b8399c165b5bd77707d7de731"
Jul 17 06:24:43.782365 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:43.782345    2567 scope.go:117] "RemoveContainer" containerID="d857f32c2887d02448811f3bb5bc47958dcc31335195aa6e3649d576e8d7a728"
Jul 17 06:24:43.782627 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:43.782605    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl_odh-ai-gateway-infra(99d60d39-5b17-41e0-adbc-68765a74039b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" podUID="99d60d39-5b17-41e0-adbc-68765a74039b"
Jul 17 06:24:44.811739 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:44.811696    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:44.945290 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:44.945260    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:45.026163 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.026121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca\") pod \"99d60d39-5b17-41e0-adbc-68765a74039b\" (UID: \"99d60d39-5b17-41e0-adbc-68765a74039b\") "
Jul 17 06:24:45.026516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.026496    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99d60d39-5b17-41e0-adbc-68765a74039b" (UID: "99d60d39-5b17-41e0-adbc-68765a74039b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:24:45.128022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.127948    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99d60d39-5b17-41e0-adbc-68765a74039b-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:45.796389 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.796348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl" event={"ID":"99d60d39-5b17-41e0-adbc-68765a74039b","Type":"ContainerDied","Data":"0a0a38f9fee4546189793ef403027946f237ad5ae37ea4f6a7c71b84ae9315d6"}
Jul 17 06:24:45.796389 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.796380    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"
Jul 17 06:24:45.796650 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.796421    2567 scope.go:117] "RemoveContainer" containerID="d857f32c2887d02448811f3bb5bc47958dcc31335195aa6e3649d576e8d7a728"
Jul 17 06:24:45.817658 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.817634    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:45.821323 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:45.821298    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-ngbwl"]
Jul 17 06:24:46.021068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:46.021036    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" path="/var/lib/kubelet/pods/99d60d39-5b17-41e0-adbc-68765a74039b/volumes"
Jul 17 06:24:48.015345 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:48.015307    2567 scope.go:117] "RemoveContainer" containerID="0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16"
Jul 17 06:24:48.817514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:48.817474    2567 generic.go:356] "Generic (PLEG): container finished" podID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerID="8d3def8222ef8596d975bdc60070bcca42c1b107c74f89aeeaaa5a925e81ce35" exitCode=6
Jul 17 06:24:48.817514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:48.817514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerDied","Data":"8d3def8222ef8596d975bdc60070bcca42c1b107c74f89aeeaaa5a925e81ce35"}
Jul 17 06:24:48.817819 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:48.817573    2567 scope.go:117] "RemoveContainer" containerID="0dd7272aa4e83d20d04c6432a9bfb779968fa03b31aa96b733bd7facca930d16"
Jul 17 06:24:48.817898 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:48.817879    2567 scope.go:117] "RemoveContainer" containerID="8d3def8222ef8596d975bdc60070bcca42c1b107c74f89aeeaaa5a925e81ce35"
Jul 17 06:24:48.818128 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:48.818104    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6_odh-ai-gateway-infra(f809cd80-7b3c-40dd-988c-14e6a2eec1d2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2"
Jul 17 06:24:49.844054 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:49.844015    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:49.980890 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:49.980867    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:50.072378 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.072345    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca\") pod \"f809cd80-7b3c-40dd-988c-14e6a2eec1d2\" (UID: \"f809cd80-7b3c-40dd-988c-14e6a2eec1d2\") "
Jul 17 06:24:50.072757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.072734    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f809cd80-7b3c-40dd-988c-14e6a2eec1d2" (UID: "f809cd80-7b3c-40dd-988c-14e6a2eec1d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:24:50.173292 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.173209    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f809cd80-7b3c-40dd-988c-14e6a2eec1d2-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:24:50.831465 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.831429    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"
Jul 17 06:24:50.831668 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.831470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6" event={"ID":"f809cd80-7b3c-40dd-988c-14e6a2eec1d2","Type":"ContainerDied","Data":"315e43e556c9b51aacf86d81d492b4e2cc1805963cebd2592bb69292208bf356"}
Jul 17 06:24:50.831668 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.831543    2567 scope.go:117] "RemoveContainer" containerID="8d3def8222ef8596d975bdc60070bcca42c1b107c74f89aeeaaa5a925e81ce35"
Jul 17 06:24:50.855280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.855246    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:50.861491 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:50.861465    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-jqjx6"]
Jul 17 06:24:52.021408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:52.021374    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" path="/var/lib/kubelet/pods/f809cd80-7b3c-40dd-988c-14e6a2eec1d2/volumes"
Jul 17 06:24:54.579894 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.579860    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580222    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580233    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580249    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580254    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="286d98a9-444a-48b8-82ff-f89080acbea1" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580267    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580272    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580280    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580280 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580285    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580296    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580302    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580309    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580314    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580363    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580370    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580377    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580383    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.580535 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.580391    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:24:54.585201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.585184    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:24:54.588629 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.588605    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:24:54.598043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.598016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:24:54.713174 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.713137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-bwqps\" (UID: \"ac6b893b-689f-459c-b89a-a728d727dde4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:24:54.813910 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.813871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-bwqps\" (UID: \"ac6b893b-689f-459c-b89a-a728d727dde4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:24:54.814506 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.814486    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-bwqps\" (UID: \"ac6b893b-689f-459c-b89a-a728d727dde4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:24:54.895490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:54.895411    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:24:55.029546 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:55.029514    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:24:55.031376 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:24:55.031352    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6b893b_689f_459c_b89a_a728d727dde4.slice/crio-88612a86ba682fd9068cab8cfbddab5cfb1d9e2e342a4ae94f8f906043062145 WatchSource:0}: Error finding container 88612a86ba682fd9068cab8cfbddab5cfb1d9e2e342a4ae94f8f906043062145: Status 404 returned error can't find the container with id 88612a86ba682fd9068cab8cfbddab5cfb1d9e2e342a4ae94f8f906043062145
Jul 17 06:24:55.873193 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:55.873154    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac6b893b-689f-459c-b89a-a728d727dde4" containerID="d61da0c471e585aad8277016aef5e3ee73b9366493441661c9c689dfa6c825e4" exitCode=6
Jul 17 06:24:55.873615 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:55.873256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" event={"ID":"ac6b893b-689f-459c-b89a-a728d727dde4","Type":"ContainerDied","Data":"d61da0c471e585aad8277016aef5e3ee73b9366493441661c9c689dfa6c825e4"}
Jul 17 06:24:55.873615 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:55.873350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" event={"ID":"ac6b893b-689f-459c-b89a-a728d727dde4","Type":"ContainerStarted","Data":"88612a86ba682fd9068cab8cfbddab5cfb1d9e2e342a4ae94f8f906043062145"}
Jul 17 06:24:55.873615 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:55.873437    2567 scope.go:117] "RemoveContainer" containerID="d61da0c471e585aad8277016aef5e3ee73b9366493441661c9c689dfa6c825e4"
Jul 17 06:24:56.881845 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:56.881763    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac6b893b-689f-459c-b89a-a728d727dde4" containerID="8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1" exitCode=6
Jul 17 06:24:56.882216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:56.881857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" event={"ID":"ac6b893b-689f-459c-b89a-a728d727dde4","Type":"ContainerDied","Data":"8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1"}
Jul 17 06:24:56.882216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:56.881920    2567 scope.go:117] "RemoveContainer" containerID="d61da0c471e585aad8277016aef5e3ee73b9366493441661c9c689dfa6c825e4"
Jul 17 06:24:56.882216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:56.882145    2567 scope.go:117] "RemoveContainer" containerID="8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1"
Jul 17 06:24:56.882402 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:56.882382    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-bwqps_odh-ai-gateway-infra(ac6b893b-689f-459c-b89a-a728d727dde4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" podUID="ac6b893b-689f-459c-b89a-a728d727dde4"
Jul 17 06:24:57.121084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:57.121041    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:24:57.889633 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:24:57.889604    2567 scope.go:117] "RemoveContainer" containerID="8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1"
Jul 17 06:24:57.890028 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:24:57.889811    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-bwqps_odh-ai-gateway-infra(ac6b893b-689f-459c-b89a-a728d727dde4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" podUID="ac6b893b-689f-459c-b89a-a728d727dde4"
Jul 17 06:25:01.259704 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.259641    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:01.260096 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.260084    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:25:01.260139 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.260101    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f809cd80-7b3c-40dd-988c-14e6a2eec1d2" containerName="revoke-keys"
Jul 17 06:25:01.260190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.260177    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d60d39-5b17-41e0-adbc-68765a74039b" containerName="revoke-keys"
Jul 17 06:25:01.264574 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.264556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:01.270376 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.270343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:01.374737 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.374663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-4fd9v\" (UID: \"bc160966-4ada-4ef6-b509-7ae22e08f299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:01.475897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.475853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-4fd9v\" (UID: \"bc160966-4ada-4ef6-b509-7ae22e08f299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:01.476563 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.476537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-4fd9v\" (UID: \"bc160966-4ada-4ef6-b509-7ae22e08f299\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:01.576793 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.576652    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:01.719087 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.719058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:01.720830 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:25:01.720802    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc160966_4ada_4ef6_b509_7ae22e08f299.slice/crio-66ee515b34d4b0de60982253e2a356d9a2960174767efaa4ae46663892503a0a WatchSource:0}: Error finding container 66ee515b34d4b0de60982253e2a356d9a2960174767efaa4ae46663892503a0a: Status 404 returned error can't find the container with id 66ee515b34d4b0de60982253e2a356d9a2960174767efaa4ae46663892503a0a
Jul 17 06:25:01.917419 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.917386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerStarted","Data":"3460aaf4d00af8c8257cc02aec680fb37e4ccf10309cad474fa2b38c570ea3b0"}
Jul 17 06:25:01.917595 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.917447    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerStarted","Data":"66ee515b34d4b0de60982253e2a356d9a2960174767efaa4ae46663892503a0a"}
Jul 17 06:25:01.936574 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:01.936523    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" podStartSLOduration=0.936506403 podStartE2EDuration="936.506403ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:25:01.934494801 +0000 UTC m=+3120.397678906" watchObservedRunningTime="2026-07-17 06:25:01.936506403 +0000 UTC m=+3120.399690508"
Jul 17 06:25:02.925422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:02.925382    2567 generic.go:356] "Generic (PLEG): container finished" podID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerID="3460aaf4d00af8c8257cc02aec680fb37e4ccf10309cad474fa2b38c570ea3b0" exitCode=6
Jul 17 06:25:02.925852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:02.925471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerDied","Data":"3460aaf4d00af8c8257cc02aec680fb37e4ccf10309cad474fa2b38c570ea3b0"}
Jul 17 06:25:02.925852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:02.925604    2567 scope.go:117] "RemoveContainer" containerID="3460aaf4d00af8c8257cc02aec680fb37e4ccf10309cad474fa2b38c570ea3b0"
Jul 17 06:25:03.933908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:03.933818    2567 generic.go:356] "Generic (PLEG): container finished" podID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerID="7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991" exitCode=6
Jul 17 06:25:03.933908 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:03.933895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerDied","Data":"7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991"}
Jul 17 06:25:03.934364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:03.933974    2567 scope.go:117] "RemoveContainer" containerID="3460aaf4d00af8c8257cc02aec680fb37e4ccf10309cad474fa2b38c570ea3b0"
Jul 17 06:25:03.934364 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:03.934257    2567 scope.go:117] "RemoveContainer" containerID="7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991"
Jul 17 06:25:03.934485 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:03.934460    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-4fd9v_odh-ai-gateway-infra(bc160966-4ada-4ef6-b509-7ae22e08f299)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299"
Jul 17 06:25:04.942236 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:04.942202    2567 scope.go:117] "RemoveContainer" containerID="7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991"
Jul 17 06:25:04.942673 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:04.942412    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-4fd9v_odh-ai-gateway-infra(bc160966-4ada-4ef6-b509-7ae22e08f299)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299"
Jul 17 06:25:09.015916 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:09.015884    2567 scope.go:117] "RemoveContainer" containerID="8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1"
Jul 17 06:25:09.972161 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:09.972127    2567 generic.go:356] "Generic (PLEG): container finished" podID="ac6b893b-689f-459c-b89a-a728d727dde4" containerID="3b8450338a832ebc7ce30ccb60cae5a75be3d8c0ff874845bee91e1232ef2979" exitCode=6
Jul 17 06:25:09.972313 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:09.972203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" event={"ID":"ac6b893b-689f-459c-b89a-a728d727dde4","Type":"ContainerDied","Data":"3b8450338a832ebc7ce30ccb60cae5a75be3d8c0ff874845bee91e1232ef2979"}
Jul 17 06:25:09.972313 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:09.972261    2567 scope.go:117] "RemoveContainer" containerID="8367a4e8ebe319a2dbba2128935dca58a9d5df6c96cb735841261bd479b6f2a1"
Jul 17 06:25:09.972583 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:09.972568    2567 scope.go:117] "RemoveContainer" containerID="3b8450338a832ebc7ce30ccb60cae5a75be3d8c0ff874845bee91e1232ef2979"
Jul 17 06:25:09.972861 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:09.972838    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-bwqps_odh-ai-gateway-infra(ac6b893b-689f-459c-b89a-a728d727dde4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" podUID="ac6b893b-689f-459c-b89a-a728d727dde4"
Jul 17 06:25:11.002282 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.002245    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:25:11.138456 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.138424    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:25:11.268837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.268741    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca\") pod \"ac6b893b-689f-459c-b89a-a728d727dde4\" (UID: \"ac6b893b-689f-459c-b89a-a728d727dde4\") "
Jul 17 06:25:11.269130 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.269105    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac6b893b-689f-459c-b89a-a728d727dde4" (UID: "ac6b893b-689f-459c-b89a-a728d727dde4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:25:11.369727 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.369667    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6b893b-689f-459c-b89a-a728d727dde4-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:25:11.985248 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.985216    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"
Jul 17 06:25:11.985432 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.985258    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps" event={"ID":"ac6b893b-689f-459c-b89a-a728d727dde4","Type":"ContainerDied","Data":"88612a86ba682fd9068cab8cfbddab5cfb1d9e2e342a4ae94f8f906043062145"}
Jul 17 06:25:11.985432 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:11.985325    2567 scope.go:117] "RemoveContainer" containerID="3b8450338a832ebc7ce30ccb60cae5a75be3d8c0ff874845bee91e1232ef2979"
Jul 17 06:25:12.025251 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:12.025219    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:25:12.025251 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:12.025253    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-bwqps"]
Jul 17 06:25:14.020216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:14.020180    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" path="/var/lib/kubelet/pods/ac6b893b-689f-459c-b89a-a728d727dde4/volumes"
Jul 17 06:25:14.533600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:14.533555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:25:17.014664 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:17.014636    2567 scope.go:117] "RemoveContainer" containerID="7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991"
Jul 17 06:25:18.023721 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:18.023673    2567 generic.go:356] "Generic (PLEG): container finished" podID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerID="65350fafa60c6ee5e0060b3b72ef39a482a7108bd6745d4e70a02bf7102a725d" exitCode=6
Jul 17 06:25:18.023721 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:18.023710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerDied","Data":"65350fafa60c6ee5e0060b3b72ef39a482a7108bd6745d4e70a02bf7102a725d"}
Jul 17 06:25:18.024286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:18.023770    2567 scope.go:117] "RemoveContainer" containerID="7537f371ec801ab0c2b4846ac7af2d375fd6fa06f17cdb6f8a263380a490f991"
Jul 17 06:25:18.024286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:18.024081    2567 scope.go:117] "RemoveContainer" containerID="65350fafa60c6ee5e0060b3b72ef39a482a7108bd6745d4e70a02bf7102a725d"
Jul 17 06:25:18.024404 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:18.024329    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-4fd9v_odh-ai-gateway-infra(bc160966-4ada-4ef6-b509-7ae22e08f299)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299"
Jul 17 06:25:19.052445 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:19.052408    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:19.191342 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:19.191318    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:19.232201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:19.232175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca\") pod \"bc160966-4ada-4ef6-b509-7ae22e08f299\" (UID: \"bc160966-4ada-4ef6-b509-7ae22e08f299\") "
Jul 17 06:25:19.232541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:19.232519    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc160966-4ada-4ef6-b509-7ae22e08f299" (UID: "bc160966-4ada-4ef6-b509-7ae22e08f299"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:25:19.333195 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:19.333114    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc160966-4ada-4ef6-b509-7ae22e08f299-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:25:20.037488 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:20.037458    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"
Jul 17 06:25:20.037488 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:20.037472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v" event={"ID":"bc160966-4ada-4ef6-b509-7ae22e08f299","Type":"ContainerDied","Data":"66ee515b34d4b0de60982253e2a356d9a2960174767efaa4ae46663892503a0a"}
Jul 17 06:25:20.037706 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:20.037525    2567 scope.go:117] "RemoveContainer" containerID="65350fafa60c6ee5e0060b3b72ef39a482a7108bd6745d4e70a02bf7102a725d"
Jul 17 06:25:20.054011 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:20.053985    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:20.057451 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:20.057425    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-4fd9v"]
Jul 17 06:25:22.021234 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:22.021199    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" path="/var/lib/kubelet/pods/bc160966-4ada-4ef6-b509-7ae22e08f299/volumes"
Jul 17 06:25:27.225893 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:27.225817    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:25:44.615976 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.615939    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616301    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616312    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616320    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616325    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616335    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616340    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616351    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616356    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616361    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616366    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616380    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616385    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616457    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616462    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616469    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616475    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616480    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc160966-4ada-4ef6-b509-7ae22e08f299" containerName="revoke-keys"
Jul 17 06:25:44.616634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.616486    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6b893b-689f-459c-b89a-a728d727dde4" containerName="revoke-keys"
Jul 17 06:25:44.619467 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.619450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:25:44.622300 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.622278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:25:44.627774 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.627752    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:25:44.768426 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.768386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f\" (UID: \"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:25:44.869662 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.869568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f\" (UID: \"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:25:44.870197 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.870177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f\" (UID: \"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:25:44.931379 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:44.931334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:25:45.066200 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:45.066168    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:25:45.067644 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:25:45.067621    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a2cddc_857a_4ca3_a798_4638ff3ff2b6.slice/crio-3599b64f1cf9c0e71ec22ec59c1aaf8fa53a82684a39e088037d8ab0f3a2a187 WatchSource:0}: Error finding container 3599b64f1cf9c0e71ec22ec59c1aaf8fa53a82684a39e088037d8ab0f3a2a187: Status 404 returned error can't find the container with id 3599b64f1cf9c0e71ec22ec59c1aaf8fa53a82684a39e088037d8ab0f3a2a187
Jul 17 06:25:45.179447 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:45.179368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerStarted","Data":"3599b64f1cf9c0e71ec22ec59c1aaf8fa53a82684a39e088037d8ab0f3a2a187"}
Jul 17 06:25:46.186836 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:46.186804    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerID="0db8025379d9aa001116a5ce2d4eddfc78c556a0f35754275024040c871f7ecc" exitCode=6
Jul 17 06:25:46.187351 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:46.186880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerDied","Data":"0db8025379d9aa001116a5ce2d4eddfc78c556a0f35754275024040c871f7ecc"}
Jul 17 06:25:46.187351 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:46.187081    2567 scope.go:117] "RemoveContainer" containerID="0db8025379d9aa001116a5ce2d4eddfc78c556a0f35754275024040c871f7ecc"
Jul 17 06:25:47.195176 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:47.195143    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerID="18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48" exitCode=6
Jul 17 06:25:47.195600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:47.195234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerDied","Data":"18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48"}
Jul 17 06:25:47.195600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:47.195289    2567 scope.go:117] "RemoveContainer" containerID="0db8025379d9aa001116a5ce2d4eddfc78c556a0f35754275024040c871f7ecc"
Jul 17 06:25:47.195600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:47.195517    2567 scope.go:117] "RemoveContainer" containerID="18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48"
Jul 17 06:25:47.195811 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:47.195787    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f_odh-ai-gateway-infra(e8a2cddc-857a-4ca3-a798-4638ff3ff2b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6"
Jul 17 06:25:48.202554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:48.202528    2567 scope.go:117] "RemoveContainer" containerID="18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48"
Jul 17 06:25:48.203014 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:25:48.202748    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f_odh-ai-gateway-infra(e8a2cddc-857a-4ca3-a798-4638ff3ff2b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6"
Jul 17 06:25:58.523073 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:25:58.523034    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:26:04.015756 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:04.015725    2567 scope.go:117] "RemoveContainer" containerID="18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48"
Jul 17 06:26:04.295442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:04.295412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerStarted","Data":"f74dee704a1b07d0bdf6f844d68745d31661d8d068eef48fd302cd4fe062dcee"}
Jul 17 06:26:04.312997 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:04.312945    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" podStartSLOduration=20.312930483 podStartE2EDuration="20.312930483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:26:04.310405311 +0000 UTC m=+3182.773589470" watchObservedRunningTime="2026-07-17 06:26:04.312930483 +0000 UTC m=+3182.776114643"
Jul 17 06:26:05.302641 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:05.302608    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerID="f74dee704a1b07d0bdf6f844d68745d31661d8d068eef48fd302cd4fe062dcee" exitCode=6
Jul 17 06:26:05.303117 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:05.302649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerDied","Data":"f74dee704a1b07d0bdf6f844d68745d31661d8d068eef48fd302cd4fe062dcee"}
Jul 17 06:26:05.303117 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:05.302743    2567 scope.go:117] "RemoveContainer" containerID="18e3c27d904ed6f6f957d03bab6e2f9296f9bbff17937c453cd9067896c26a48"
Jul 17 06:26:05.303117 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:05.303028    2567 scope.go:117] "RemoveContainer" containerID="f74dee704a1b07d0bdf6f844d68745d31661d8d068eef48fd302cd4fe062dcee"
Jul 17 06:26:05.303251 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:05.303231    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f_odh-ai-gateway-infra(e8a2cddc-857a-4ca3-a798-4638ff3ff2b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6"
Jul 17 06:26:05.321648 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:05.321613    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:26:06.444757 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:06.444732    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:26:06.464985 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:06.464955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca\") pod \"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6\" (UID: \"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6\") "
Jul 17 06:26:06.465326 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:06.465299    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" (UID: "e8a2cddc-857a-4ca3-a798-4638ff3ff2b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:26:06.565918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:06.565816    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:26:07.316320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:07.316293    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"
Jul 17 06:26:07.316502 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:07.316338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f" event={"ID":"e8a2cddc-857a-4ca3-a798-4638ff3ff2b6","Type":"ContainerDied","Data":"3599b64f1cf9c0e71ec22ec59c1aaf8fa53a82684a39e088037d8ab0f3a2a187"}
Jul 17 06:26:07.316502 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:07.316397    2567 scope.go:117] "RemoveContainer" containerID="f74dee704a1b07d0bdf6f844d68745d31661d8d068eef48fd302cd4fe062dcee"
Jul 17 06:26:07.348019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:07.347981    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:26:07.351822 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:07.351794    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-g8j6f"]
Jul 17 06:26:08.021033 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:08.021000    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" path="/var/lib/kubelet/pods/e8a2cddc-857a-4ca3-a798-4638ff3ff2b6/volumes"
Jul 17 06:26:12.991583 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.991532    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:12.992077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992059    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992078    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992089    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992099    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992112    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992194 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992121    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992194    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.992356 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.992208    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:12.995494 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.995469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:12.999568 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:12.999545    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:26:13.009965 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.009934    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:13.024553 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.024520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8286c\" (UID: \"bf1a2691-0dbc-4720-abe0-6c46abbf5d32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:13.124982 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.124949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8286c\" (UID: \"bf1a2691-0dbc-4720-abe0-6c46abbf5d32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:13.125645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.125624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-8286c\" (UID: \"bf1a2691-0dbc-4720-abe0-6c46abbf5d32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:13.306929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.306842    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:13.445949 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:13.445919    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:13.447317 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:26:13.447292    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1a2691_0dbc_4720_abe0_6c46abbf5d32.slice/crio-4ac1c25f2764b606fef374b1c7de3117b945e3a86d5f0bcdffe90665a0f8be6d WatchSource:0}: Error finding container 4ac1c25f2764b606fef374b1c7de3117b945e3a86d5f0bcdffe90665a0f8be6d: Status 404 returned error can't find the container with id 4ac1c25f2764b606fef374b1c7de3117b945e3a86d5f0bcdffe90665a0f8be6d
Jul 17 06:26:14.356814 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:14.356780    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerID="f4ff36a331a48793e255f6b4cd9303ed7ab4d71702199b18f340818ab889d8b6" exitCode=6
Jul 17 06:26:14.357227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:14.356865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerDied","Data":"f4ff36a331a48793e255f6b4cd9303ed7ab4d71702199b18f340818ab889d8b6"}
Jul 17 06:26:14.357227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:14.356922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerStarted","Data":"4ac1c25f2764b606fef374b1c7de3117b945e3a86d5f0bcdffe90665a0f8be6d"}
Jul 17 06:26:14.357227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:14.357006    2567 scope.go:117] "RemoveContainer" containerID="f4ff36a331a48793e255f6b4cd9303ed7ab4d71702199b18f340818ab889d8b6"
Jul 17 06:26:15.364407 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:15.364314    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerID="0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee" exitCode=6
Jul 17 06:26:15.364407 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:15.364377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerDied","Data":"0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee"}
Jul 17 06:26:15.364912 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:15.364440    2567 scope.go:117] "RemoveContainer" containerID="f4ff36a331a48793e255f6b4cd9303ed7ab4d71702199b18f340818ab889d8b6"
Jul 17 06:26:15.364912 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:15.364614    2567 scope.go:117] "RemoveContainer" containerID="0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee"
Jul 17 06:26:15.364912 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:15.364868    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8286c_odh-ai-gateway-infra(bf1a2691-0dbc-4720-abe0-6c46abbf5d32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32"
Jul 17 06:26:16.371747 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:16.371716    2567 scope.go:117] "RemoveContainer" containerID="0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee"
Jul 17 06:26:16.372281 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:16.371927    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8286c_odh-ai-gateway-infra(bf1a2691-0dbc-4720-abe0-6c46abbf5d32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32"
Jul 17 06:26:20.722339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:20.722301    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:26:28.015525 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:28.015487    2567 scope.go:117] "RemoveContainer" containerID="0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee"
Jul 17 06:26:28.449614 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:28.449580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerStarted","Data":"1b5be83f9f067327d38450da9054c8bed84b75646bedc770df068f3ee7e1ffc5"}
Jul 17 06:26:28.467440 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:28.467382    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" podStartSLOduration=16.46736558 podStartE2EDuration="16.46736558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:26:28.465289946 +0000 UTC m=+3206.928474054" watchObservedRunningTime="2026-07-17 06:26:28.46736558 +0000 UTC m=+3206.930549683"
Jul 17 06:26:29.457612 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:29.457580    2567 generic.go:356] "Generic (PLEG): container finished" podID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerID="1b5be83f9f067327d38450da9054c8bed84b75646bedc770df068f3ee7e1ffc5" exitCode=6
Jul 17 06:26:29.458015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:29.457656    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerDied","Data":"1b5be83f9f067327d38450da9054c8bed84b75646bedc770df068f3ee7e1ffc5"}
Jul 17 06:26:29.458015 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:29.457740    2567 scope.go:117] "RemoveContainer" containerID="0c93e673d36e392352b8db5f1e92eb5ca1295add678462785db13286abaf75ee"
Jul 17 06:26:29.458151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:29.458021    2567 scope.go:117] "RemoveContainer" containerID="1b5be83f9f067327d38450da9054c8bed84b75646bedc770df068f3ee7e1ffc5"
Jul 17 06:26:29.458274 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:29.458255    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-8286c_odh-ai-gateway-infra(bf1a2691-0dbc-4720-abe0-6c46abbf5d32)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32"
Jul 17 06:26:29.486954 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:29.486924    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:30.603730 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:30.603649    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:30.695600 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:30.695571    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca\") pod \"bf1a2691-0dbc-4720-abe0-6c46abbf5d32\" (UID: \"bf1a2691-0dbc-4720-abe0-6c46abbf5d32\") "
Jul 17 06:26:30.696105 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:30.696064    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf1a2691-0dbc-4720-abe0-6c46abbf5d32" (UID: "bf1a2691-0dbc-4720-abe0-6c46abbf5d32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:26:30.796406 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:30.796305    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf1a2691-0dbc-4720-abe0-6c46abbf5d32-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:26:31.472340 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:31.472310    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"
Jul 17 06:26:31.472340 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:31.472322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c" event={"ID":"bf1a2691-0dbc-4720-abe0-6c46abbf5d32","Type":"ContainerDied","Data":"4ac1c25f2764b606fef374b1c7de3117b945e3a86d5f0bcdffe90665a0f8be6d"}
Jul 17 06:26:31.472556 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:31.472387    2567 scope.go:117] "RemoveContainer" containerID="1b5be83f9f067327d38450da9054c8bed84b75646bedc770df068f3ee7e1ffc5"
Jul 17 06:26:31.497049 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:31.497010    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:31.503024 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:31.502997    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-8286c"]
Jul 17 06:26:32.020663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:32.020629    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" path="/var/lib/kubelet/pods/bf1a2691-0dbc-4720-abe0-6c46abbf5d32/volumes"
Jul 17 06:26:41.323852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:41.323815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:26:44.663785 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.663748    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:26:44.664179 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664123    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664179 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664133    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664179 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664159    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664179 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664219    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a2cddc-857a-4ca3-a798-4638ff3ff2b6" containerName="revoke-keys"
Jul 17 06:26:44.664309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664228    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664234    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.664309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.664240    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:44.667408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.667389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:26:44.669906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.669884    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:26:44.675975 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.675952    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:26:44.824382 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.824334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7\" (UID: \"aa754f68-45db-439f-a8fa-3937f911a10e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:26:44.925219 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.925119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7\" (UID: \"aa754f68-45db-439f-a8fa-3937f911a10e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:26:44.925844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.925817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7\" (UID: \"aa754f68-45db-439f-a8fa-3937f911a10e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:26:44.979159 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:44.979120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:26:45.114019 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:45.113987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:26:45.115649 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:26:45.115619    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa754f68_45db_439f_a8fa_3937f911a10e.slice/crio-b1fa0960fc74532b26416bd0b746b1aa28c7f7a3b89562e8da5ca9ee51ca9f86 WatchSource:0}: Error finding container b1fa0960fc74532b26416bd0b746b1aa28c7f7a3b89562e8da5ca9ee51ca9f86: Status 404 returned error can't find the container with id b1fa0960fc74532b26416bd0b746b1aa28c7f7a3b89562e8da5ca9ee51ca9f86
Jul 17 06:26:45.554952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:45.554877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerStarted","Data":"e7d7565cab07f6a3693360d2dc518b5241a42e8a30afc6aa258200dddad79944"}
Jul 17 06:26:45.555146 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:45.554970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerStarted","Data":"b1fa0960fc74532b26416bd0b746b1aa28c7f7a3b89562e8da5ca9ee51ca9f86"}
Jul 17 06:26:45.570882 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:45.570796    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" podStartSLOduration=1.5707790190000002 podStartE2EDuration="1.570779019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:26:45.569308207 +0000 UTC m=+3224.032492311" watchObservedRunningTime="2026-07-17 06:26:45.570779019 +0000 UTC m=+3224.033963157"
Jul 17 06:26:46.562216 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:46.562181    2567 generic.go:356] "Generic (PLEG): container finished" podID="aa754f68-45db-439f-a8fa-3937f911a10e" containerID="e7d7565cab07f6a3693360d2dc518b5241a42e8a30afc6aa258200dddad79944" exitCode=6
Jul 17 06:26:46.562634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:46.562278    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerDied","Data":"e7d7565cab07f6a3693360d2dc518b5241a42e8a30afc6aa258200dddad79944"}
Jul 17 06:26:46.562634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:46.562452    2567 scope.go:117] "RemoveContainer" containerID="e7d7565cab07f6a3693360d2dc518b5241a42e8a30afc6aa258200dddad79944"
Jul 17 06:26:47.573342 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:47.573283    2567 generic.go:356] "Generic (PLEG): container finished" podID="aa754f68-45db-439f-a8fa-3937f911a10e" containerID="9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6" exitCode=6
Jul 17 06:26:47.573802 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:47.573346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerDied","Data":"9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6"}
Jul 17 06:26:47.573802 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:47.573415    2567 scope.go:117] "RemoveContainer" containerID="e7d7565cab07f6a3693360d2dc518b5241a42e8a30afc6aa258200dddad79944"
Jul 17 06:26:47.573802 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:47.573597    2567 scope.go:117] "RemoveContainer" containerID="9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6"
Jul 17 06:26:47.573948 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:47.573855    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7_odh-ai-gateway-infra(aa754f68-45db-439f-a8fa-3937f911a10e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" podUID="aa754f68-45db-439f-a8fa-3937f911a10e"
Jul 17 06:26:48.581139 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:48.581112    2567 scope.go:117] "RemoveContainer" containerID="9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6"
Jul 17 06:26:48.581550 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:48.581316    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7_odh-ai-gateway-infra(aa754f68-45db-439f-a8fa-3937f911a10e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" podUID="aa754f68-45db-439f-a8fa-3937f911a10e"
Jul 17 06:26:51.359430 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.359394    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:26:51.359873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.359783    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:51.359873 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.359794    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1a2691-0dbc-4720-abe0-6c46abbf5d32" containerName="revoke-keys"
Jul 17 06:26:51.364131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.364112    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:26:51.370628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.370561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:26:51.379825 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.379801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-t84vs\" (UID: \"1a41f3b2-9ce4-457e-be34-24f6054c8ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:26:51.481120 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.481088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-t84vs\" (UID: \"1a41f3b2-9ce4-457e-be34-24f6054c8ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:26:51.481740 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.481717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-t84vs\" (UID: \"1a41f3b2-9ce4-457e-be34-24f6054c8ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:26:51.676122 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.676026    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:26:51.814817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:51.814793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:26:51.816557 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:26:51.816525    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a41f3b2_9ce4_457e_be34_24f6054c8ad5.slice/crio-1ca41702f3dd0e082b63c1525218619dcc73421f9fccd147f21443136f68aaa7 WatchSource:0}: Error finding container 1ca41702f3dd0e082b63c1525218619dcc73421f9fccd147f21443136f68aaa7: Status 404 returned error can't find the container with id 1ca41702f3dd0e082b63c1525218619dcc73421f9fccd147f21443136f68aaa7
Jul 17 06:26:52.605518 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:52.605485    2567 generic.go:356] "Generic (PLEG): container finished" podID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerID="724d79b9bc7d86dda2f3e5d37d1b186a070d5e4b2a7861c3c7660ef903b92980" exitCode=6
Jul 17 06:26:52.605953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:52.605555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" event={"ID":"1a41f3b2-9ce4-457e-be34-24f6054c8ad5","Type":"ContainerDied","Data":"724d79b9bc7d86dda2f3e5d37d1b186a070d5e4b2a7861c3c7660ef903b92980"}
Jul 17 06:26:52.605953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:52.605596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" event={"ID":"1a41f3b2-9ce4-457e-be34-24f6054c8ad5","Type":"ContainerStarted","Data":"1ca41702f3dd0e082b63c1525218619dcc73421f9fccd147f21443136f68aaa7"}
Jul 17 06:26:52.605953 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:52.605724    2567 scope.go:117] "RemoveContainer" containerID="724d79b9bc7d86dda2f3e5d37d1b186a070d5e4b2a7861c3c7660ef903b92980"
Jul 17 06:26:53.612764 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:53.612726    2567 generic.go:356] "Generic (PLEG): container finished" podID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerID="727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887" exitCode=6
Jul 17 06:26:53.613211 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:53.612811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" event={"ID":"1a41f3b2-9ce4-457e-be34-24f6054c8ad5","Type":"ContainerDied","Data":"727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887"}
Jul 17 06:26:53.613211 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:53.612893    2567 scope.go:117] "RemoveContainer" containerID="724d79b9bc7d86dda2f3e5d37d1b186a070d5e4b2a7861c3c7660ef903b92980"
Jul 17 06:26:53.613211 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:53.613091    2567 scope.go:117] "RemoveContainer" containerID="727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887"
Jul 17 06:26:53.613334 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:53.613322    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-t84vs_odh-ai-gateway-infra(1a41f3b2-9ce4-457e-be34-24f6054c8ad5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5"
Jul 17 06:26:54.623309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:54.623282    2567 scope.go:117] "RemoveContainer" containerID="727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887"
Jul 17 06:26:54.623700 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:26:54.623462    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-t84vs_odh-ai-gateway-infra(1a41f3b2-9ce4-457e-be34-24f6054c8ad5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5"
Jul 17 06:26:59.332431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:26:59.332389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:27:03.014817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:03.014777    2567 scope.go:117] "RemoveContainer" containerID="9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6"
Jul 17 06:27:03.681654 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:03.681624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerStarted","Data":"907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3"}
Jul 17 06:27:03.681998 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:03.681980    2567 scope.go:117] "RemoveContainer" containerID="907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3"
Jul 17 06:27:03.682251 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:03.682230    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7_odh-ai-gateway-infra(aa754f68-45db-439f-a8fa-3937f911a10e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" podUID="aa754f68-45db-439f-a8fa-3937f911a10e"
Jul 17 06:27:04.689256 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:04.689223    2567 generic.go:356] "Generic (PLEG): container finished" podID="aa754f68-45db-439f-a8fa-3937f911a10e" containerID="907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3" exitCode=6
Jul 17 06:27:04.689751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:04.689302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerDied","Data":"907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3"}
Jul 17 06:27:04.689751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:04.689364    2567 scope.go:117] "RemoveContainer" containerID="9cb09b2312579c3e85185a7a2263266e8c8935fb6ab2c5b450a9562e9e9cacd6"
Jul 17 06:27:04.689751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:04.689631    2567 scope.go:117] "RemoveContainer" containerID="907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3"
Jul 17 06:27:04.689930 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:04.689910    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7_odh-ai-gateway-infra(aa754f68-45db-439f-a8fa-3937f911a10e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" podUID="aa754f68-45db-439f-a8fa-3937f911a10e"
Jul 17 06:27:04.706874 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:04.706847    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:27:05.015032 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.015004    2567 scope.go:117] "RemoveContainer" containerID="727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887"
Jul 17 06:27:05.698859 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.698817    2567 generic.go:356] "Generic (PLEG): container finished" podID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerID="9fe1948b7886ad404d305556e8d4b4532ca09e670b9b8fb4d0520b53b3d4dce6" exitCode=6
Jul 17 06:27:05.699309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.698877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" event={"ID":"1a41f3b2-9ce4-457e-be34-24f6054c8ad5","Type":"ContainerDied","Data":"9fe1948b7886ad404d305556e8d4b4532ca09e670b9b8fb4d0520b53b3d4dce6"}
Jul 17 06:27:05.699309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.698936    2567 scope.go:117] "RemoveContainer" containerID="727ac336fd0a029cb45c6db981f64b6b27894baca1e30b0720b9e41e2253a887"
Jul 17 06:27:05.699309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.699205    2567 scope.go:117] "RemoveContainer" containerID="9fe1948b7886ad404d305556e8d4b4532ca09e670b9b8fb4d0520b53b3d4dce6"
Jul 17 06:27:05.699487 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:05.699441    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-t84vs_odh-ai-gateway-infra(1a41f3b2-9ce4-457e-be34-24f6054c8ad5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5"
Jul 17 06:27:05.835554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.835487    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:27:05.919113 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.919076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca\") pod \"aa754f68-45db-439f-a8fa-3937f911a10e\" (UID: \"aa754f68-45db-439f-a8fa-3937f911a10e\") "
Jul 17 06:27:05.919396 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:05.919375    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa754f68-45db-439f-a8fa-3937f911a10e" (UID: "aa754f68-45db-439f-a8fa-3937f911a10e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:27:06.020526 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.020495    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa754f68-45db-439f-a8fa-3937f911a10e-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:27:06.705437 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.705406    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"
Jul 17 06:27:06.705902 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.705408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7" event={"ID":"aa754f68-45db-439f-a8fa-3937f911a10e","Type":"ContainerDied","Data":"b1fa0960fc74532b26416bd0b746b1aa28c7f7a3b89562e8da5ca9ee51ca9f86"}
Jul 17 06:27:06.705902 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.705545    2567 scope.go:117] "RemoveContainer" containerID="907edcaa8918d6605d71ff993ab819bb6cbf4f553fc2a05a79ae2cdae59474c3"
Jul 17 06:27:06.726441 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.726391    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:27:06.731813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.731788    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-xlfj7"]
Jul 17 06:27:06.741598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.741570    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:27:06.877516 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.877487    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:27:06.929498 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.929467    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca\") pod \"1a41f3b2-9ce4-457e-be34-24f6054c8ad5\" (UID: \"1a41f3b2-9ce4-457e-be34-24f6054c8ad5\") "
Jul 17 06:27:06.929885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:06.929859    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a41f3b2-9ce4-457e-be34-24f6054c8ad5" (UID: "1a41f3b2-9ce4-457e-be34-24f6054c8ad5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:27:07.030826 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.030730    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a41f3b2-9ce4-457e-be34-24f6054c8ad5-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:27:07.715644 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.715607    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"
Jul 17 06:27:07.715644 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.715633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs" event={"ID":"1a41f3b2-9ce4-457e-be34-24f6054c8ad5","Type":"ContainerDied","Data":"1ca41702f3dd0e082b63c1525218619dcc73421f9fccd147f21443136f68aaa7"}
Jul 17 06:27:07.716205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.715716    2567 scope.go:117] "RemoveContainer" containerID="9fe1948b7886ad404d305556e8d4b4532ca09e670b9b8fb4d0520b53b3d4dce6"
Jul 17 06:27:07.738718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.738673    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:27:07.743275 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:07.743247    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-t84vs"]
Jul 17 06:27:08.022961 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:08.022878    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" path="/var/lib/kubelet/pods/1a41f3b2-9ce4-457e-be34-24f6054c8ad5/volumes"
Jul 17 06:27:08.023227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:08.023214    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" path="/var/lib/kubelet/pods/aa754f68-45db-439f-a8fa-3937f911a10e/volumes"
Jul 17 06:27:18.703813 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.703776    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704140    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704151    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704166    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704172    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704180    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704186 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704186    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704196    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704201    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704217    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704222    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704276    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704284    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704291    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:18.704404 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.704296    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:18.707486 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.707468    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:18.709970 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.709941    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:27:18.715869 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.715321    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:18.840152 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.840109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs\" (UID: \"6e2d7140-816e-4c63-a994-ba1e800ced8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:18.940995 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.940946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs\" (UID: \"6e2d7140-816e-4c63-a994-ba1e800ced8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:18.941588 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:18.941565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs\" (UID: \"6e2d7140-816e-4c63-a994-ba1e800ced8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:19.019554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:19.019474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:19.163589 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:19.163556    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:19.164726 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:27:19.164697    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2d7140_816e_4c63_a994_ba1e800ced8a.slice/crio-db2b1930da47fae113b5421c82fd6ac2b6137822c3d5ae070c713c4e20c5a55e WatchSource:0}: Error finding container db2b1930da47fae113b5421c82fd6ac2b6137822c3d5ae070c713c4e20c5a55e: Status 404 returned error can't find the container with id db2b1930da47fae113b5421c82fd6ac2b6137822c3d5ae070c713c4e20c5a55e
Jul 17 06:27:19.785912 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:19.785869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerStarted","Data":"77538e8bf07ac82362c81873541fd53c3435d4f750bd3d1cd704abb2d064e8fa"}
Jul 17 06:27:19.786316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:19.785940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerStarted","Data":"db2b1930da47fae113b5421c82fd6ac2b6137822c3d5ae070c713c4e20c5a55e"}
Jul 17 06:27:19.801807 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:19.801759    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" podStartSLOduration=1.80174417 podStartE2EDuration="1.80174417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:27:19.800013722 +0000 UTC m=+3258.263197828" watchObservedRunningTime="2026-07-17 06:27:19.80174417 +0000 UTC m=+3258.264928274"
Jul 17 06:27:20.793482 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:20.793444    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerID="77538e8bf07ac82362c81873541fd53c3435d4f750bd3d1cd704abb2d064e8fa" exitCode=6
Jul 17 06:27:20.793854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:20.793533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerDied","Data":"77538e8bf07ac82362c81873541fd53c3435d4f750bd3d1cd704abb2d064e8fa"}
Jul 17 06:27:20.793854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:20.793642    2567 scope.go:117] "RemoveContainer" containerID="77538e8bf07ac82362c81873541fd53c3435d4f750bd3d1cd704abb2d064e8fa"
Jul 17 06:27:21.801461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:21.801428    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerID="15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9" exitCode=6
Jul 17 06:27:21.801929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:21.801515    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerDied","Data":"15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9"}
Jul 17 06:27:21.801929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:21.801578    2567 scope.go:117] "RemoveContainer" containerID="77538e8bf07ac82362c81873541fd53c3435d4f750bd3d1cd704abb2d064e8fa"
Jul 17 06:27:21.801929 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:21.801665    2567 scope.go:117] "RemoveContainer" containerID="15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9"
Jul 17 06:27:21.802065 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:21.801928    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs_odh-ai-gateway-infra(6e2d7140-816e-4c63-a994-ba1e800ced8a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a"
Jul 17 06:27:22.808667 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:22.808638    2567 scope.go:117] "RemoveContainer" containerID="15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9"
Jul 17 06:27:22.809143 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:22.808928    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs_odh-ai-gateway-infra(6e2d7140-816e-4c63-a994-ba1e800ced8a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a"
Jul 17 06:27:33.014781 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:33.014747    2567 scope.go:117] "RemoveContainer" containerID="15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9"
Jul 17 06:27:33.871462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:33.871381    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerID="b4107f636948843b61e13cd3935893efdcc29e037d7d8e1c31919ad23f4306e4" exitCode=6
Jul 17 06:27:33.871462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:33.871440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerDied","Data":"b4107f636948843b61e13cd3935893efdcc29e037d7d8e1c31919ad23f4306e4"}
Jul 17 06:27:33.871702 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:33.871490    2567 scope.go:117] "RemoveContainer" containerID="15b34e4f1b450bdc66cc938c59a21a6441835e83390d7135ff1bf9131304e6d9"
Jul 17 06:27:33.871909 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:33.871876    2567 scope.go:117] "RemoveContainer" containerID="b4107f636948843b61e13cd3935893efdcc29e037d7d8e1c31919ad23f4306e4"
Jul 17 06:27:33.872168 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:33.872146    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs_odh-ai-gateway-infra(6e2d7140-816e-4c63-a994-ba1e800ced8a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a"
Jul 17 06:27:34.915590 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:34.915549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:34.992035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:34.992005    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:27:35.057942 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.057917    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:35.086567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.086543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca\") pod \"6e2d7140-816e-4c63-a994-ba1e800ced8a\" (UID: \"6e2d7140-816e-4c63-a994-ba1e800ced8a\") "
Jul 17 06:27:35.086906 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.086882    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6e2d7140-816e-4c63-a994-ba1e800ced8a" (UID: "6e2d7140-816e-4c63-a994-ba1e800ced8a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:27:35.187639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.187552    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e2d7140-816e-4c63-a994-ba1e800ced8a-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:27:35.885200 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.885166    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"
Jul 17 06:27:35.885388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.885202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs" event={"ID":"6e2d7140-816e-4c63-a994-ba1e800ced8a","Type":"ContainerDied","Data":"db2b1930da47fae113b5421c82fd6ac2b6137822c3d5ae070c713c4e20c5a55e"}
Jul 17 06:27:35.885388 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.885263    2567 scope.go:117] "RemoveContainer" containerID="b4107f636948843b61e13cd3935893efdcc29e037d7d8e1c31919ad23f4306e4"
Jul 17 06:27:35.915561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.915525    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:35.917896 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:35.917873    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-97f0d5b3-zv9vs"]
Jul 17 06:27:36.021324 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:36.021287    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" path="/var/lib/kubelet/pods/6e2d7140-816e-4c63-a994-ba1e800ced8a/volumes"
Jul 17 06:27:41.424259 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424223    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:27:41.424651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424609    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424621    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424628    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424634    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424652    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424657    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424663    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424669    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424751    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424760    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424768    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2d7140-816e-4c63-a994-ba1e800ced8a" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424777    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a41f3b2-9ce4-457e-be34-24f6054c8ad5" containerName="revoke-keys"
Jul 17 06:27:41.424852 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.424783    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa754f68-45db-439f-a8fa-3937f911a10e" containerName="revoke-keys"
Jul 17 06:27:41.429139 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.429121    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:27:41.431860 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.431827    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:27:41.434855 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.434826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:27:41.545967 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.545923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-s7c4t\" (UID: \"e62ddbe4-d794-4912-b0a7-aa731d83b7f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:27:41.646801 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.646749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-s7c4t\" (UID: \"e62ddbe4-d794-4912-b0a7-aa731d83b7f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:27:41.647396 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.647376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-s7c4t\" (UID: \"e62ddbe4-d794-4912-b0a7-aa731d83b7f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:27:41.740711 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.740646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:27:41.872913 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.872882    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:27:41.874427 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:27:41.874396    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62ddbe4_d794_4912_b0a7_aa731d83b7f6.slice/crio-54a5868c6038ce2feb425c52576bbd57527044335875e8f74c761d52a35dc5c2 WatchSource:0}: Error finding container 54a5868c6038ce2feb425c52576bbd57527044335875e8f74c761d52a35dc5c2: Status 404 returned error can't find the container with id 54a5868c6038ce2feb425c52576bbd57527044335875e8f74c761d52a35dc5c2
Jul 17 06:27:41.925688 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:41.925655    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" event={"ID":"e62ddbe4-d794-4912-b0a7-aa731d83b7f6","Type":"ContainerStarted","Data":"54a5868c6038ce2feb425c52576bbd57527044335875e8f74c761d52a35dc5c2"}
Jul 17 06:27:42.932745 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:42.932645    2567 generic.go:356] "Generic (PLEG): container finished" podID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerID="11a78227351c5b2a3722db7f6ce7dd3677524f7dea1684502568bcef8d963271" exitCode=6
Jul 17 06:27:42.933131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:42.932741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" event={"ID":"e62ddbe4-d794-4912-b0a7-aa731d83b7f6","Type":"ContainerDied","Data":"11a78227351c5b2a3722db7f6ce7dd3677524f7dea1684502568bcef8d963271"}
Jul 17 06:27:42.933131 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:42.932970    2567 scope.go:117] "RemoveContainer" containerID="11a78227351c5b2a3722db7f6ce7dd3677524f7dea1684502568bcef8d963271"
Jul 17 06:27:43.940227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:43.940139    2567 generic.go:356] "Generic (PLEG): container finished" podID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerID="4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6" exitCode=6
Jul 17 06:27:43.940227 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:43.940216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" event={"ID":"e62ddbe4-d794-4912-b0a7-aa731d83b7f6","Type":"ContainerDied","Data":"4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6"}
Jul 17 06:27:43.940714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:43.940265    2567 scope.go:117] "RemoveContainer" containerID="11a78227351c5b2a3722db7f6ce7dd3677524f7dea1684502568bcef8d963271"
Jul 17 06:27:43.940714 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:43.940475    2567 scope.go:117] "RemoveContainer" containerID="4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6"
Jul 17 06:27:43.940805 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:43.940708    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-s7c4t_odh-ai-gateway-infra(e62ddbe4-d794-4912-b0a7-aa731d83b7f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6"
Jul 17 06:27:44.946798 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:27:44.946770    2567 scope.go:117] "RemoveContainer" containerID="4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6"
Jul 17 06:27:44.947183 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:27:44.946959    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-s7c4t_odh-ai-gateway-infra(e62ddbe4-d794-4912-b0a7-aa731d83b7f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6"
Jul 17 06:28:00.015632 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:00.015590    2567 scope.go:117] "RemoveContainer" containerID="4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6"
Jul 17 06:28:00.219218 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:00.219191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:28:01.041973 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:01.041943    2567 generic.go:356] "Generic (PLEG): container finished" podID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerID="110a435811d458b8cbd88629a21b919095c1c7ff9915bf9bc7412ecc631a74ca" exitCode=6
Jul 17 06:28:01.042432 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:01.042016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" event={"ID":"e62ddbe4-d794-4912-b0a7-aa731d83b7f6","Type":"ContainerDied","Data":"110a435811d458b8cbd88629a21b919095c1c7ff9915bf9bc7412ecc631a74ca"}
Jul 17 06:28:01.042432 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:01.042092    2567 scope.go:117] "RemoveContainer" containerID="4cd96530bff1a80672cfc3638a911e17ac440ed0cdf767e5d2eec5a2f11b34f6"
Jul 17 06:28:01.042554 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:01.042467    2567 scope.go:117] "RemoveContainer" containerID="110a435811d458b8cbd88629a21b919095c1c7ff9915bf9bc7412ecc631a74ca"
Jul 17 06:28:01.042710 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:01.042664    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-s7c4t_odh-ai-gateway-infra(e62ddbe4-d794-4912-b0a7-aa731d83b7f6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6"
Jul 17 06:28:02.085161 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.085123    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:28:02.231358 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.231333    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:28:02.336030 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.335933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca\") pod \"e62ddbe4-d794-4912-b0a7-aa731d83b7f6\" (UID: \"e62ddbe4-d794-4912-b0a7-aa731d83b7f6\") "
Jul 17 06:28:02.336318 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.336296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e62ddbe4-d794-4912-b0a7-aa731d83b7f6" (UID: "e62ddbe4-d794-4912-b0a7-aa731d83b7f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:28:02.356339 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.356310    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:28:02.373384 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.373360    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kgtr8_b117a2a3-f598-445e-832d-90235f9d9f27/ovn-acl-logging/0.log"
Jul 17 06:28:02.437583 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:02.437546    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62ddbe4-d794-4912-b0a7-aa731d83b7f6-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:03.054878 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.054850    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"
Jul 17 06:28:03.054878 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.054863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t" event={"ID":"e62ddbe4-d794-4912-b0a7-aa731d83b7f6","Type":"ContainerDied","Data":"54a5868c6038ce2feb425c52576bbd57527044335875e8f74c761d52a35dc5c2"}
Jul 17 06:28:03.055161 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.054921    2567 scope.go:117] "RemoveContainer" containerID="110a435811d458b8cbd88629a21b919095c1c7ff9915bf9bc7412ecc631a74ca"
Jul 17 06:28:03.075043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075016    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:03.075399 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075387    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075402    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075415    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075421    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075429    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075452 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075435    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075493    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.075598 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.075505    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:03.080315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.080294    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:28:03.080489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.080415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:03.083036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.083010    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-s7c4t"]
Jul 17 06:28:03.083222 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.083086    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:28:03.086514 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.086488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:03.243883 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.243840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs\" (UID: \"c40e2ac6-5db7-496b-9331-d705200fe1ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:03.345269 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.345231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs\" (UID: \"c40e2ac6-5db7-496b-9331-d705200fe1ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:03.345895 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.345875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs\" (UID: \"c40e2ac6-5db7-496b-9331-d705200fe1ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:03.393547 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.393513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:03.527993 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:03.527967    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:03.529193 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:28:03.529164    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40e2ac6_5db7_496b_9331_d705200fe1ad.slice/crio-6f9b368d7d1e48c503cdad7292a6824f38cfb256b12151f59ae5d9862e1b19e8 WatchSource:0}: Error finding container 6f9b368d7d1e48c503cdad7292a6824f38cfb256b12151f59ae5d9862e1b19e8: Status 404 returned error can't find the container with id 6f9b368d7d1e48c503cdad7292a6824f38cfb256b12151f59ae5d9862e1b19e8
Jul 17 06:28:04.021362 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:04.021325    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" path="/var/lib/kubelet/pods/e62ddbe4-d794-4912-b0a7-aa731d83b7f6/volumes"
Jul 17 06:28:04.061806 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:04.061720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerStarted","Data":"8316471a447495388b093ef5d2d1009eba2d7802b6b355b761dc06c502c2f997"}
Jul 17 06:28:04.061806 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:04.061784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerStarted","Data":"6f9b368d7d1e48c503cdad7292a6824f38cfb256b12151f59ae5d9862e1b19e8"}
Jul 17 06:28:04.077895 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:04.077848    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" podStartSLOduration=1.077833596 podStartE2EDuration="1.077833596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:28:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:28:04.075961272 +0000 UTC m=+3302.539145377" watchObservedRunningTime="2026-07-17 06:28:04.077833596 +0000 UTC m=+3302.541017700"
Jul 17 06:28:05.069742 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:05.069708    2567 generic.go:356] "Generic (PLEG): container finished" podID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerID="8316471a447495388b093ef5d2d1009eba2d7802b6b355b761dc06c502c2f997" exitCode=6
Jul 17 06:28:05.070141 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:05.069750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerDied","Data":"8316471a447495388b093ef5d2d1009eba2d7802b6b355b761dc06c502c2f997"}
Jul 17 06:28:05.070141 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:05.070018    2567 scope.go:117] "RemoveContainer" containerID="8316471a447495388b093ef5d2d1009eba2d7802b6b355b761dc06c502c2f997"
Jul 17 06:28:06.076958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:06.076922    2567 generic.go:356] "Generic (PLEG): container finished" podID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerID="8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f" exitCode=6
Jul 17 06:28:06.077462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:06.077014    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerDied","Data":"8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f"}
Jul 17 06:28:06.077462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:06.077077    2567 scope.go:117] "RemoveContainer" containerID="8316471a447495388b093ef5d2d1009eba2d7802b6b355b761dc06c502c2f997"
Jul 17 06:28:06.077462 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:06.077299    2567 scope.go:117] "RemoveContainer" containerID="8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f"
Jul 17 06:28:06.077639 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:06.077513    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs_odh-ai-gateway-infra(c40e2ac6-5db7-496b-9331-d705200fe1ad)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad"
Jul 17 06:28:07.084320 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:07.084284    2567 scope.go:117] "RemoveContainer" containerID="8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f"
Jul 17 06:28:07.084731 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:07.084457    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs_odh-ai-gateway-infra(c40e2ac6-5db7-496b-9331-d705200fe1ad)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad"
Jul 17 06:28:20.720305 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:20.720267    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:28:22.018674 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:22.018641    2567 scope.go:117] "RemoveContainer" containerID="8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f"
Jul 17 06:28:23.174853 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:23.174817    2567 generic.go:356] "Generic (PLEG): container finished" podID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerID="2fceb5524fa0e0bd89226fa9b6d1bc66e621058bb63cf61e46351502d745f1cf" exitCode=6
Jul 17 06:28:23.175286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:23.174890    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerDied","Data":"2fceb5524fa0e0bd89226fa9b6d1bc66e621058bb63cf61e46351502d745f1cf"}
Jul 17 06:28:23.175286 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:23.174951    2567 scope.go:117] "RemoveContainer" containerID="8f7eb883d4d7eec489d0b4aa40f550b455f7b7869f124cb5c68f7cc888c6080f"
Jul 17 06:28:23.175408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:23.175288    2567 scope.go:117] "RemoveContainer" containerID="2fceb5524fa0e0bd89226fa9b6d1bc66e621058bb63cf61e46351502d745f1cf"
Jul 17 06:28:23.175509 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:23.175488    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs_odh-ai-gateway-infra(c40e2ac6-5db7-496b-9331-d705200fe1ad)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad"
Jul 17 06:28:24.201778 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:24.201744    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:24.335561 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:24.335537    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:24.429860 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:24.429817    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca\") pod \"c40e2ac6-5db7-496b-9331-d705200fe1ad\" (UID: \"c40e2ac6-5db7-496b-9331-d705200fe1ad\") "
Jul 17 06:28:24.430239 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:24.430210    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c40e2ac6-5db7-496b-9331-d705200fe1ad" (UID: "c40e2ac6-5db7-496b-9331-d705200fe1ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:28:24.531549 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:24.531458    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40e2ac6-5db7-496b-9331-d705200fe1ad-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:25.189168 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:25.189140    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"
Jul 17 06:28:25.189168 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:25.189146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs" event={"ID":"c40e2ac6-5db7-496b-9331-d705200fe1ad","Type":"ContainerDied","Data":"6f9b368d7d1e48c503cdad7292a6824f38cfb256b12151f59ae5d9862e1b19e8"}
Jul 17 06:28:25.189431 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:25.189202    2567 scope.go:117] "RemoveContainer" containerID="2fceb5524fa0e0bd89226fa9b6d1bc66e621058bb63cf61e46351502d745f1cf"
Jul 17 06:28:25.211183 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:25.211159    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:25.215198 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:25.215173    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-583f1136-xpnvs"]
Jul 17 06:28:26.021362 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.021324    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" path="/var/lib/kubelet/pods/c40e2ac6-5db7-496b-9331-d705200fe1ad/volumes"
Jul 17 06:28:26.892166 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.892121    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-140212734156464"]
Jul 17 06:28:26.893051 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893019    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893191 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893049    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893191 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893089    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893191 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893097    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893218    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893231    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893242    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:26.893325 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.893252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62ddbe4-d794-4912-b0a7-aa731d83b7f6" containerName="revoke-keys"
Jul 17 06:28:26.898009 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.897985    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212734156464"]
Jul 17 06:28:26.898142 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.898062    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:26.900573 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.900553    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n2k4r\""
Jul 17 06:28:26.953818 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:26.953782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9fv\" (UniqueName: \"kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv\") pod \"test-curl-7409-140212734156464\" (UID: \"dce2c51f-a083-4d81-b722-c572c6f34a0f\") " pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:27.054474 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:27.054424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9fv\" (UniqueName: \"kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv\") pod \"test-curl-7409-140212734156464\" (UID: \"dce2c51f-a083-4d81-b722-c572c6f34a0f\") " pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:27.063584 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:27.063559    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9fv\" (UniqueName: \"kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv\") pod \"test-curl-7409-140212734156464\" (UID: \"dce2c51f-a083-4d81-b722-c572c6f34a0f\") " pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:27.207082 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:27.207052    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:27.360335 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:27.360302    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212734156464"]
Jul 17 06:28:27.361755 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:28:27.361723    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddce2c51f_a083_4d81_b722_c572c6f34a0f.slice/crio-e6cb888b58006a1a5e3c483dfb7a7ba76d1b49c3e05fbf026f4bbd90eb6ea675 WatchSource:0}: Error finding container e6cb888b58006a1a5e3c483dfb7a7ba76d1b49c3e05fbf026f4bbd90eb6ea675: Status 404 returned error can't find the container with id e6cb888b58006a1a5e3c483dfb7a7ba76d1b49c3e05fbf026f4bbd90eb6ea675
Jul 17 06:28:27.363190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:27.363167    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:28:28.208548 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:28.208513    2567 generic.go:356] "Generic (PLEG): container finished" podID="dce2c51f-a083-4d81-b722-c572c6f34a0f" containerID="f56bbfec3a935db882c56984c38fdde90ae941f08fe1f517829a6d16c6fd05ad" exitCode=0
Jul 17 06:28:28.209007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:28.208589    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212734156464" event={"ID":"dce2c51f-a083-4d81-b722-c572c6f34a0f","Type":"ContainerDied","Data":"f56bbfec3a935db882c56984c38fdde90ae941f08fe1f517829a6d16c6fd05ad"}
Jul 17 06:28:28.209007 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:28.208626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212734156464" event={"ID":"dce2c51f-a083-4d81-b722-c572c6f34a0f","Type":"ContainerStarted","Data":"e6cb888b58006a1a5e3c483dfb7a7ba76d1b49c3e05fbf026f4bbd90eb6ea675"}
Jul 17 06:28:29.344260 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.344236    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:29.377557 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.377526    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj9fv\" (UniqueName: \"kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv\") pod \"dce2c51f-a083-4d81-b722-c572c6f34a0f\" (UID: \"dce2c51f-a083-4d81-b722-c572c6f34a0f\") "
Jul 17 06:28:29.379905 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.379879    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv" (OuterVolumeSpecName: "kube-api-access-xj9fv") pod "dce2c51f-a083-4d81-b722-c572c6f34a0f" (UID: "dce2c51f-a083-4d81-b722-c572c6f34a0f"). InnerVolumeSpecName "kube-api-access-xj9fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:28:29.383254 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.383239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-140212734156464_dce2c51f-a083-4d81-b722-c572c6f34a0f/test-curl-7409-140212734156464/0.log"
Jul 17 06:28:29.436709 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.436660    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-140212734156464"]
Jul 17 06:28:29.442638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.442614    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-140212734156464"]
Jul 17 06:28:29.478464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:29.478371    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj9fv\" (UniqueName: \"kubernetes.io/projected/dce2c51f-a083-4d81-b722-c572c6f34a0f-kube-api-access-xj9fv\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:30.020645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:30.020614    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce2c51f-a083-4d81-b722-c572c6f34a0f" path="/var/lib/kubelet/pods/dce2c51f-a083-4d81-b722-c572c6f34a0f/volumes"
Jul 17 06:28:30.220618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:30.220592    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212734156464"
Jul 17 06:28:30.220618 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:30.220605    2567 scope.go:117] "RemoveContainer" containerID="f56bbfec3a935db882c56984c38fdde90ae941f08fe1f517829a6d16c6fd05ad"
Jul 17 06:28:35.857071 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857036    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-140212735273840"]
Jul 17 06:28:35.857469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857405    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:35.857469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857415    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40e2ac6-5db7-496b-9331-d705200fe1ad" containerName="revoke-keys"
Jul 17 06:28:35.857469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857422    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce2c51f-a083-4d81-b722-c572c6f34a0f" containerName="test-curl-7409-140212734156464"
Jul 17 06:28:35.857469 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857429    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce2c51f-a083-4d81-b722-c572c6f34a0f" containerName="test-curl-7409-140212734156464"
Jul 17 06:28:35.857649 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.857501    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce2c51f-a083-4d81-b722-c572c6f34a0f" containerName="test-curl-7409-140212734156464"
Jul 17 06:28:35.861837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.861818    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:35.864729 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.864699    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n2k4r\""
Jul 17 06:28:35.869090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.869061    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212735273840"]
Jul 17 06:28:35.938795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:35.938757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zct\" (UniqueName: \"kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct\") pod \"test-curl-7409-140212735273840\" (UID: \"1b3f4552-e926-4448-8bea-bec36babf12a\") " pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:36.039250 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:36.039216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zct\" (UniqueName: \"kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct\") pod \"test-curl-7409-140212735273840\" (UID: \"1b3f4552-e926-4448-8bea-bec36babf12a\") " pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:36.048374 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:36.048345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zct\" (UniqueName: \"kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct\") pod \"test-curl-7409-140212735273840\" (UID: \"1b3f4552-e926-4448-8bea-bec36babf12a\") " pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:36.172267 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:36.172181    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:36.422072 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:36.422020    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:28:36.524354 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:36.524290    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212735273840"]
Jul 17 06:28:36.526719 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:28:36.526663    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b3f4552_e926_4448_8bea_bec36babf12a.slice/crio-41d14d6370d04b1a96d28f85b998ad1054f1f49499bb9b9d6c7ffcd4b8d902ea WatchSource:0}: Error finding container 41d14d6370d04b1a96d28f85b998ad1054f1f49499bb9b9d6c7ffcd4b8d902ea: Status 404 returned error can't find the container with id 41d14d6370d04b1a96d28f85b998ad1054f1f49499bb9b9d6c7ffcd4b8d902ea
Jul 17 06:28:37.272023 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:37.271982    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b3f4552-e926-4448-8bea-bec36babf12a" containerID="e37c9a834f1d68fa87c6de68827eb31cdb873d3635913c155d238681ef1f5296" exitCode=0
Jul 17 06:28:37.272422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:37.272065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212735273840" event={"ID":"1b3f4552-e926-4448-8bea-bec36babf12a","Type":"ContainerDied","Data":"e37c9a834f1d68fa87c6de68827eb31cdb873d3635913c155d238681ef1f5296"}
Jul 17 06:28:37.272422 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:37.272108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212735273840" event={"ID":"1b3f4552-e926-4448-8bea-bec36babf12a","Type":"ContainerStarted","Data":"41d14d6370d04b1a96d28f85b998ad1054f1f49499bb9b9d6c7ffcd4b8d902ea"}
Jul 17 06:28:38.414720 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.414693    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:38.436629 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.436604    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-140212735273840_1b3f4552-e926-4448-8bea-bec36babf12a/test-curl-7409-140212735273840/0.log"
Jul 17 06:28:38.461398 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.461370    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-140212735273840"]
Jul 17 06:28:38.464184 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.464161    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-140212735273840"]
Jul 17 06:28:38.561966 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.561872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5zct\" (UniqueName: \"kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct\") pod \"1b3f4552-e926-4448-8bea-bec36babf12a\" (UID: \"1b3f4552-e926-4448-8bea-bec36babf12a\") "
Jul 17 06:28:38.564308 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.564276    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct" (OuterVolumeSpecName: "kube-api-access-g5zct") pod "1b3f4552-e926-4448-8bea-bec36babf12a" (UID: "1b3f4552-e926-4448-8bea-bec36babf12a"). InnerVolumeSpecName "kube-api-access-g5zct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:28:38.588449 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.588418    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7409-140212735274848"]
Jul 17 06:28:38.588922 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.588901    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b3f4552-e926-4448-8bea-bec36babf12a" containerName="test-curl-7409-140212735273840"
Jul 17 06:28:38.589027 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.588923    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b3f4552-e926-4448-8bea-bec36babf12a" containerName="test-curl-7409-140212735273840"
Jul 17 06:28:38.589090 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.589035    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b3f4552-e926-4448-8bea-bec36babf12a" containerName="test-curl-7409-140212735273840"
Jul 17 06:28:38.592168 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.592149    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:38.597911 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.597889    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212735274848"]
Jul 17 06:28:38.670458 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.670411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gln2j\" (UniqueName: \"kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j\") pod \"test-curl-7409-140212735274848\" (UID: \"45dc3358-8897-404f-a69e-2221518c8663\") " pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:38.670628 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.670490    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5zct\" (UniqueName: \"kubernetes.io/projected/1b3f4552-e926-4448-8bea-bec36babf12a-kube-api-access-g5zct\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:38.771734 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.771661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gln2j\" (UniqueName: \"kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j\") pod \"test-curl-7409-140212735274848\" (UID: \"45dc3358-8897-404f-a69e-2221518c8663\") " pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:38.779967 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.779938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gln2j\" (UniqueName: \"kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j\") pod \"test-curl-7409-140212735274848\" (UID: \"45dc3358-8897-404f-a69e-2221518c8663\") " pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:38.902602 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:38.902514    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:39.035844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:39.035819    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7409-140212735274848"]
Jul 17 06:28:39.037195 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:28:39.037169    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45dc3358_8897_404f_a69e_2221518c8663.slice/crio-bcc2322612e310bb3af5d2c7b98b2c1e5d8479d6d1cbe3e308801f665b917b08 WatchSource:0}: Error finding container bcc2322612e310bb3af5d2c7b98b2c1e5d8479d6d1cbe3e308801f665b917b08: Status 404 returned error can't find the container with id bcc2322612e310bb3af5d2c7b98b2c1e5d8479d6d1cbe3e308801f665b917b08
Jul 17 06:28:39.284645 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:39.284619    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:39.284862 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:39.284619    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d14d6370d04b1a96d28f85b998ad1054f1f49499bb9b9d6c7ffcd4b8d902ea"
Jul 17 06:28:39.285859 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:39.285835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212735274848" event={"ID":"45dc3358-8897-404f-a69e-2221518c8663","Type":"ContainerStarted","Data":"bcc2322612e310bb3af5d2c7b98b2c1e5d8479d6d1cbe3e308801f665b917b08"}
Jul 17 06:28:39.295144 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:39.295118    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7409-140212735273840\" is forbidden: User \"system:node:ip-10-0-142-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-187.ec2.internal' and this object" podUID="1b3f4552-e926-4448-8bea-bec36babf12a" pod="opendatahub/test-curl-7409-140212735273840"
Jul 17 06:28:40.020972 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:40.020942    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b3f4552-e926-4448-8bea-bec36babf12a" path="/var/lib/kubelet/pods/1b3f4552-e926-4448-8bea-bec36babf12a/volumes"
Jul 17 06:28:40.292782 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:40.292696    2567 generic.go:356] "Generic (PLEG): container finished" podID="45dc3358-8897-404f-a69e-2221518c8663" containerID="93232dfefa1eb2826b8b7038c2a15157eeeebedc90bcdd9daf3e8d2a61162996" exitCode=0
Jul 17 06:28:40.292933 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:40.292773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7409-140212735274848" event={"ID":"45dc3358-8897-404f-a69e-2221518c8663","Type":"ContainerDied","Data":"93232dfefa1eb2826b8b7038c2a15157eeeebedc90bcdd9daf3e8d2a61162996"}
Jul 17 06:28:41.436913 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.436886    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:41.457638 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.457611    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7409-140212735274848_45dc3358-8897-404f-a69e-2221518c8663/test-curl-7409-140212735274848/0.log"
Jul 17 06:28:41.486889 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.486854    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7409-140212735274848"]
Jul 17 06:28:41.489696 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.489659    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7409-140212735274848"]
Jul 17 06:28:41.596932 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.596839    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gln2j\" (UniqueName: \"kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j\") pod \"45dc3358-8897-404f-a69e-2221518c8663\" (UID: \"45dc3358-8897-404f-a69e-2221518c8663\") "
Jul 17 06:28:41.599035 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.599012    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j" (OuterVolumeSpecName: "kube-api-access-gln2j") pod "45dc3358-8897-404f-a69e-2221518c8663" (UID: "45dc3358-8897-404f-a69e-2221518c8663"). InnerVolumeSpecName "kube-api-access-gln2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:28:41.698091 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:41.698060    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gln2j\" (UniqueName: \"kubernetes.io/projected/45dc3358-8897-404f-a69e-2221518c8663-kube-api-access-gln2j\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:42.021399 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:42.021365    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45dc3358-8897-404f-a69e-2221518c8663" path="/var/lib/kubelet/pods/45dc3358-8897-404f-a69e-2221518c8663/volumes"
Jul 17 06:28:42.305084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:42.305006    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7409-140212735274848"
Jul 17 06:28:42.305084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:42.305049    2567 scope.go:117] "RemoveContainer" containerID="93232dfefa1eb2826b8b7038c2a15157eeeebedc90bcdd9daf3e8d2a61162996"
Jul 17 06:28:54.559665 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.559628    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:28:54.560190 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.559906    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" podUID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" containerName="maas-api" containerID="cri-o://df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7" gracePeriod=30
Jul 17 06:28:54.815639 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.815581    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:28:54.825232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.825210    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca\") pod \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") "
Jul 17 06:28:54.825297 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.825254    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5l58\" (UniqueName: \"kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58\") pod \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") "
Jul 17 06:28:54.825332 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.825295    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls\") pod \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\" (UID: \"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0\") "
Jul 17 06:28:54.825567 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.825533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" (UID: "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:28:54.827425 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.827398    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" (UID: "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:28:54.827541 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.827518    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58" (OuterVolumeSpecName: "kube-api-access-b5l58") pod "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" (UID: "ffbbe99d-2e55-4ee7-8b15-6a03744b54f0"). InnerVolumeSpecName "kube-api-access-b5l58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:28:54.926044 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.926002    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-openshift-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:54.926044 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.926036    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5l58\" (UniqueName: \"kubernetes.io/projected/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-kube-api-access-b5l58\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:54.926044 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:54.926047    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0-maas-api-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:28:55.388316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.388277    2567 generic.go:356] "Generic (PLEG): container finished" podID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" containerID="df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7" exitCode=0
Jul 17 06:28:55.388496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.388329    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"
Jul 17 06:28:55.388496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.388369    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" event={"ID":"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0","Type":"ContainerDied","Data":"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"}
Jul 17 06:28:55.388496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.388422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h" event={"ID":"ffbbe99d-2e55-4ee7-8b15-6a03744b54f0","Type":"ContainerDied","Data":"16bffc8384d52b087b878657c06fc18968ccaccdf1289f9d6adc1b22c567b37b"}
Jul 17 06:28:55.388496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.388447    2567 scope.go:117] "RemoveContainer" containerID="df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"
Jul 17 06:28:55.398151 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.398131    2567 scope.go:117] "RemoveContainer" containerID="df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"
Jul 17 06:28:55.398419 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:28:55.398397    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7\": container with ID starting with df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7 not found: ID does not exist" containerID="df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"
Jul 17 06:28:55.398527 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.398426    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7"} err="failed to get container status \"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7\": rpc error: code = NotFound desc = could not find container \"df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7\": container with ID starting with df49d5cb0239d94a8d27495a6e0c13bda1920a40a9679d118c4a4d136144bde7 not found: ID does not exist"
Jul 17 06:28:55.411939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.411913    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:28:55.416616 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:55.416594    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e9bcaa-67c69779f9-wvs7h"]
Jul 17 06:28:56.022317 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:56.022274    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" path="/var/lib/kubelet/pods/ffbbe99d-2e55-4ee7-8b15-6a03744b54f0/volumes"
Jul 17 06:28:58.625077 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:28:58.625041    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:29:20.665241 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:20.665204    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:29:20.665780 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:20.665449    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" podUID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" containerName="maas-api" containerID="cri-o://a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892" gracePeriod=30
Jul 17 06:29:21.107760 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.107729    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:29:21.267613 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.267533    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls\") pod \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") "
Jul 17 06:29:21.267613 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.267593    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27rdv\" (UniqueName: \"kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv\") pod \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") "
Jul 17 06:29:21.267854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.267715    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca\") pod \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\" (UID: \"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061\") "
Jul 17 06:29:21.268043 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.268021    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" (UID: "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:29:21.269827 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.269804    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv" (OuterVolumeSpecName: "kube-api-access-27rdv") pod "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" (UID: "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061"). InnerVolumeSpecName "kube-api-access-27rdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:29:21.269885 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.269810    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" (UID: "0e6ffdd8-bbac-4a4a-b7b1-878b537d2061"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:29:21.369022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.368985    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-openshift-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:29:21.369022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.369014    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-maas-api-tls\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:29:21.369022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.369023    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27rdv\" (UniqueName: \"kubernetes.io/projected/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061-kube-api-access-27rdv\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:29:21.542058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.541968    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" containerID="a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892" exitCode=0
Jul 17 06:29:21.542058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.542013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" event={"ID":"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061","Type":"ContainerDied","Data":"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"}
Jul 17 06:29:21.542058 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.542030    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"
Jul 17 06:29:21.542294 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.542077    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz" event={"ID":"0e6ffdd8-bbac-4a4a-b7b1-878b537d2061","Type":"ContainerDied","Data":"25d43d93a8411a11635047f97bc8d46dd8e9c1b6454074ecb5b3cb30a50e5598"}
Jul 17 06:29:21.542294 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.542098    2567 scope.go:117] "RemoveContainer" containerID="a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"
Jul 17 06:29:21.555767 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.555747    2567 scope.go:117] "RemoveContainer" containerID="a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"
Jul 17 06:29:21.556010 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:21.555991    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892\": container with ID starting with a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892 not found: ID does not exist" containerID="a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"
Jul 17 06:29:21.556056 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.556018    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892"} err="failed to get container status \"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892\": rpc error: code = NotFound desc = could not find container \"a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892\": container with ID starting with a0227015daf0e2de9316f0d32e5c8a04e8ddcc72132487062d6f77b74ae7c892 not found: ID does not exist"
Jul 17 06:29:21.565918 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.565892    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:29:21.569337 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:21.569314    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-efbd92-9b59c7b5c-6cvnz"]
Jul 17 06:29:22.022357 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:22.022320    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" path="/var/lib/kubelet/pods/0e6ffdd8-bbac-4a4a-b7b1-878b537d2061/volumes"
Jul 17 06:29:24.024693 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:24.024652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-w29xv"]
Jul 17 06:29:41.525068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525026    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525427    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" containerName="maas-api"
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525439    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" containerName="maas-api"
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525453    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45dc3358-8897-404f-a69e-2221518c8663" containerName="test-curl-7409-140212735274848"
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525459    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45dc3358-8897-404f-a69e-2221518c8663" containerName="test-curl-7409-140212735274848"
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525468    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" containerName="maas-api"
Jul 17 06:29:41.525497 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525475    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" containerName="maas-api"
Jul 17 06:29:41.525735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525530    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffbbe99d-2e55-4ee7-8b15-6a03744b54f0" containerName="maas-api"
Jul 17 06:29:41.525735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525539    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45dc3358-8897-404f-a69e-2221518c8663" containerName="test-curl-7409-140212735274848"
Jul 17 06:29:41.525735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.525545    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6ffdd8-bbac-4a4a-b7b1-878b537d2061" containerName="maas-api"
Jul 17 06:29:41.530129 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.530104    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:41.533897 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.533868    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 06:29:41.534028 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.533872    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pcjfr\""
Jul 17 06:29:41.536777 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.536752    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:29:41.545870 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.545835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-n9lh6\" (UID: \"2d7bc965-213f-48a4-9930-1c38cb510e00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:41.646238 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.646207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-n9lh6\" (UID: \"2d7bc965-213f-48a4-9930-1c38cb510e00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:41.646854 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.646834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3232801c-n9lh6\" (UID: \"2d7bc965-213f-48a4-9930-1c38cb510e00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:41.842122 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.842035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:41.974907 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:41.974880    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:29:41.976534 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:29:41.976507    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7bc965_213f_48a4_9930_1c38cb510e00.slice/crio-c1aa16da4fc8fa0930dc3e2b70bcd95b529323ac0da3af9610badaadda68e22e WatchSource:0}: Error finding container c1aa16da4fc8fa0930dc3e2b70bcd95b529323ac0da3af9610badaadda68e22e: Status 404 returned error can't find the container with id c1aa16da4fc8fa0930dc3e2b70bcd95b529323ac0da3af9610badaadda68e22e
Jul 17 06:29:42.604461 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:42.604433    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-cjchn_524c1673-0d90-4752-bdba-c749ca935f94/copy-manifests/0.log"
Jul 17 06:29:42.611634 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:42.611610    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-cjchn_524c1673-0d90-4752-bdba-c749ca935f94/manager/0.log"
Jul 17 06:29:42.661068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:42.661034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerStarted","Data":"6f8c85b8ee8f2c856576f899cb0dc42ff75e3ac0459136fb0d0e44821fbc906a"}
Jul 17 06:29:42.661242 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:42.661090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerStarted","Data":"c1aa16da4fc8fa0930dc3e2b70bcd95b529323ac0da3af9610badaadda68e22e"}
Jul 17 06:29:42.680191 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:42.680142    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" podStartSLOduration=1.680125154 podStartE2EDuration="1.680125154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:29:42.678229023 +0000 UTC m=+3401.141413127" watchObservedRunningTime="2026-07-17 06:29:42.680125154 +0000 UTC m=+3401.143309257"
Jul 17 06:29:43.396201 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.396174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737785-cl2ss_c2387dbb-f6be-4e94-b754-48abfad0676a/cleanup/0.log"
Jul 17 06:29:43.510824 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.510789    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737800-fxhtr_d3c05c5e-e425-4199-aa02-f844177259ac/cleanup/0.log"
Jul 17 06:29:43.620938 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.620906    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737815-w4c6x_1e242655-f8b6-438b-a4bf-051fe9d5afbf/cleanup/0.log"
Jul 17 06:29:43.668124 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.668036    2567 generic.go:356] "Generic (PLEG): container finished" podID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerID="6f8c85b8ee8f2c856576f899cb0dc42ff75e3ac0459136fb0d0e44821fbc906a" exitCode=6
Jul 17 06:29:43.668124 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.668099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerDied","Data":"6f8c85b8ee8f2c856576f899cb0dc42ff75e3ac0459136fb0d0e44821fbc906a"}
Jul 17 06:29:43.668350 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.668333    2567 scope.go:117] "RemoveContainer" containerID="6f8c85b8ee8f2c856576f899cb0dc42ff75e3ac0459136fb0d0e44821fbc906a"
Jul 17 06:29:43.733160 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.733132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-3232801c-n9lh6_2d7bc965-213f-48a4-9930-1c38cb510e00/revoke-keys/0.log"
Jul 17 06:29:43.846306 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:43.846280    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-1615b7-wxktr_898bab71-5de0-4763-a18b-d4c1bfb835fc/revoke-keys/0.log"
Jul 17 06:29:44.065994 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.065967    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-c0d19a-vtpxp_4a228003-8f3a-447b-9924-8361a68b2734/revoke-keys/0.log"
Jul 17 06:29:44.182303 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.182271    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-3483d7-k5nkf_8fe6be9e-21e0-4396-a886-a9f8dd23bf79/revoke-keys/0.log"
Jul 17 06:29:44.295342 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.295312    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-603a20da-t6lbz_258a35a8-6b98-4f31-97cb-8bf1c2f16c62/revoke-keys/0.log"
Jul 17 06:29:44.410963 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.410884    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-67214823-4jqjs_b2e5a613-eaca-4f4a-9f88-c8905fa94205/revoke-keys/0.log"
Jul 17 06:29:44.675361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.675280    2567 generic.go:356] "Generic (PLEG): container finished" podID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerID="0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21" exitCode=6
Jul 17 06:29:44.675361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.675327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerDied","Data":"0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21"}
Jul 17 06:29:44.675827 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.675374    2567 scope.go:117] "RemoveContainer" containerID="6f8c85b8ee8f2c856576f899cb0dc42ff75e3ac0459136fb0d0e44821fbc906a"
Jul 17 06:29:44.675827 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.675612    2567 scope.go:117] "RemoveContainer" containerID="0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21"
Jul 17 06:29:44.675896 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:44.675839    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-n9lh6_odh-ai-gateway-infra(2d7bc965-213f-48a4-9930-1c38cb510e00)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00"
Jul 17 06:29:44.812221 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.812185    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:29:44.815795 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.815779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:29:44.822189 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.822161    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:29:44.874261 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.874225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb\" (UID: \"86163130-117b-4cca-9113-74e3a3222181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:29:44.974702 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.974643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb\" (UID: \"86163130-117b-4cca-9113-74e3a3222181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:29:44.975283 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:44.975263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb\" (UID: \"86163130-117b-4cca-9113-74e3a3222181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:29:45.127365 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.127329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:29:45.275817 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.275716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:29:45.281905 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:29:45.281868    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86163130_117b_4cca_9113_74e3a3222181.slice/crio-c4baaa5bc8501064c628a836a7f9ddf51e8ba37fab19ebd5d41cb326a6c427a8 WatchSource:0}: Error finding container c4baaa5bc8501064c628a836a7f9ddf51e8ba37fab19ebd5d41cb326a6c427a8: Status 404 returned error can't find the container with id c4baaa5bc8501064c628a836a7f9ddf51e8ba37fab19ebd5d41cb326a6c427a8
Jul 17 06:29:45.561243 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.561162    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/util/0.log"
Jul 17 06:29:45.567844 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.567822    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/pull/0.log"
Jul 17 06:29:45.574549 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.574529    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/extract/0.log"
Jul 17 06:29:45.682988 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.682958    2567 scope.go:117] "RemoveContainer" containerID="0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21"
Jul 17 06:29:45.683522 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:45.683194    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-n9lh6_odh-ai-gateway-infra(2d7bc965-213f-48a4-9930-1c38cb510e00)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00"
Jul 17 06:29:45.684172 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.684141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerStarted","Data":"9a406876f915e2024c3ab1a24c64e7177f5fb111d0d0ac3637d7bbe8aaadfac6"}
Jul 17 06:29:45.684309 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.684190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerStarted","Data":"c4baaa5bc8501064c628a836a7f9ddf51e8ba37fab19ebd5d41cb326a6c427a8"}
Jul 17 06:29:45.692754 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.692732    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/util/0.log"
Jul 17 06:29:45.702496 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.702470    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/pull/0.log"
Jul 17 06:29:45.709068 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.709051    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/extract/0.log"
Jul 17 06:29:45.713958 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.713915    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" podStartSLOduration=1.713900841 podStartE2EDuration="1.713900841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:29:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:29:45.712086632 +0000 UTC m=+3404.175270736" watchObservedRunningTime="2026-07-17 06:29:45.713900841 +0000 UTC m=+3404.177084961"
Jul 17 06:29:45.826136 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.826057    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/pull/0.log"
Jul 17 06:29:45.833384 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.833356    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/extract/0.log"
Jul 17 06:29:45.840537 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.840516    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/util/0.log"
Jul 17 06:29:45.954006 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.953977    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/util/0.log"
Jul 17 06:29:45.960750 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.960728    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/pull/0.log"
Jul 17 06:29:45.966868 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:45.966849    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/extract/0.log"
Jul 17 06:29:46.691489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:46.691455    2567 generic.go:356] "Generic (PLEG): container finished" podID="86163130-117b-4cca-9113-74e3a3222181" containerID="9a406876f915e2024c3ab1a24c64e7177f5fb111d0d0ac3637d7bbe8aaadfac6" exitCode=6
Jul 17 06:29:46.691969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:46.691538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerDied","Data":"9a406876f915e2024c3ab1a24c64e7177f5fb111d0d0ac3637d7bbe8aaadfac6"}
Jul 17 06:29:46.691969 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:46.691732    2567 scope.go:117] "RemoveContainer" containerID="9a406876f915e2024c3ab1a24c64e7177f5fb111d0d0ac3637d7bbe8aaadfac6"
Jul 17 06:29:46.838178 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:46.838144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-w29xv_3a33fff3-ea18-4ffa-9cb5-16100f96c070/limitador/0.log"
Jul 17 06:29:47.458794 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:47.458764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rb4wh_eef0f3a8-46ff-4498-92e8-01fcc11082b4/discovery/0.log"
Jul 17 06:29:47.699435 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:47.699402    2567 generic.go:356] "Generic (PLEG): container finished" podID="86163130-117b-4cca-9113-74e3a3222181" containerID="bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15" exitCode=6
Jul 17 06:29:47.699952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:47.699438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerDied","Data":"bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15"}
Jul 17 06:29:47.699952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:47.699505    2567 scope.go:117] "RemoveContainer" containerID="9a406876f915e2024c3ab1a24c64e7177f5fb111d0d0ac3637d7bbe8aaadfac6"
Jul 17 06:29:47.699952 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:47.699781    2567 scope.go:117] "RemoveContainer" containerID="bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15"
Jul 17 06:29:47.700117 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:47.700010    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb_odh-ai-gateway-infra(86163130-117b-4cca-9113-74e3a3222181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" podUID="86163130-117b-4cca-9113-74e3a3222181"
Jul 17 06:29:48.527700 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:48.527662    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cq86t_04eeba1b-609d-4c89-a32d-e1eaac7b3cae/main/0.log"
Jul 17 06:29:48.708168 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:48.708136    2567 scope.go:117] "RemoveContainer" containerID="bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15"
Jul 17 06:29:48.708556 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:48.708353    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb_odh-ai-gateway-infra(86163130-117b-4cca-9113-74e3a3222181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" podUID="86163130-117b-4cca-9113-74e3a3222181"
Jul 17 06:29:57.015474 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.015396    2567 scope.go:117] "RemoveContainer" containerID="0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21"
Jul 17 06:29:57.390903 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.390872    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nz2h8_d69bccb2-b724-47b1-b267-dc685e49047a/global-pull-secret-syncer/0.log"
Jul 17 06:29:57.472284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.472253    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vbdzf_266708c1-a69f-4d2a-a1d4-18bdccac4cd2/konnectivity-agent/0.log"
Jul 17 06:29:57.590490 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.590404    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-187.ec2.internal_05f6608d28020517457478c70f43bbd1/haproxy/0.log"
Jul 17 06:29:57.761766 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.761736    2567 generic.go:356] "Generic (PLEG): container finished" podID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerID="12e3dec79c0b0272d7ab2b1a0c50441ff018ff304bb9b34e0f7b25fe6c048dbe" exitCode=6
Jul 17 06:29:57.761939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.761812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerDied","Data":"12e3dec79c0b0272d7ab2b1a0c50441ff018ff304bb9b34e0f7b25fe6c048dbe"}
Jul 17 06:29:57.761939 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.761873    2567 scope.go:117] "RemoveContainer" containerID="0509da073b0498901fdb0f721e4deadc46553501d0625ab3fbfc30de8846aa21"
Jul 17 06:29:57.762223 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:57.762194    2567 scope.go:117] "RemoveContainer" containerID="12e3dec79c0b0272d7ab2b1a0c50441ff018ff304bb9b34e0f7b25fe6c048dbe"
Jul 17 06:29:57.762416 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:29:57.762397    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-3232801c-n9lh6_odh-ai-gateway-infra(2d7bc965-213f-48a4-9930-1c38cb510e00)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00"
Jul 17 06:29:58.789056 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:58.789022    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:29:58.924820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:58.924789    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:59.005164 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.005112    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca\") pod \"2d7bc965-213f-48a4-9930-1c38cb510e00\" (UID: \"2d7bc965-213f-48a4-9930-1c38cb510e00\") "
Jul 17 06:29:59.005536 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.005507    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d7bc965-213f-48a4-9930-1c38cb510e00" (UID: "2d7bc965-213f-48a4-9930-1c38cb510e00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:29:59.106037 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.105930    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7bc965-213f-48a4-9930-1c38cb510e00-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:29:59.776400 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.776369    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"
Jul 17 06:29:59.776605 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.776421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6" event={"ID":"2d7bc965-213f-48a4-9930-1c38cb510e00","Type":"ContainerDied","Data":"c1aa16da4fc8fa0930dc3e2b70bcd95b529323ac0da3af9610badaadda68e22e"}
Jul 17 06:29:59.776605 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.776489    2567 scope.go:117] "RemoveContainer" containerID="12e3dec79c0b0272d7ab2b1a0c50441ff018ff304bb9b34e0f7b25fe6c048dbe"
Jul 17 06:29:59.798837 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.798806    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:29:59.801994 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:29:59.801970    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3232801c-n9lh6"]
Jul 17 06:30:00.020384 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.020353    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" path="/var/lib/kubelet/pods/2d7bc965-213f-48a4-9930-1c38cb510e00/volumes"
Jul 17 06:30:00.135841 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.135762    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"]
Jul 17 06:30:00.136144 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136129    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136182 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136182 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136171    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136182 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136176    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136185    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136244    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.136287 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.136252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:00.140377 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.140360    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"
Jul 17 06:30:00.147455 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.147428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"]
Jul 17 06:30:00.151816 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.151795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"
Jul 17 06:30:00.514449 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.514410    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"]
Jul 17 06:30:00.516330 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:30:00.516302    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c251770_fb65_49a7_ab8d_89e3d1b81f92.slice/crio-c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b WatchSource:0}: Error finding container c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b: Status 404 returned error can't find the container with id c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b
Jul 17 06:30:00.788385 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:00.788351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6" event={"ID":"0c251770-fb65-49a7-ab8d-89e3d1b81f92","Type":"ContainerStarted","Data":"c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b"}
Jul 17 06:30:01.618522 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.618491    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/extract/0.log"
Jul 17 06:30:01.651392 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.651312    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/util/0.log"
Jul 17 06:30:01.681157 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.681133    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j867d_53285704-cfe5-413a-8377-f4fccf17b9f0/pull/0.log"
Jul 17 06:30:01.707753 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.707723    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/extract/0.log"
Jul 17 06:30:01.729312 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.729287    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/util/0.log"
Jul 17 06:30:01.751888 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.751861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e099tjq_42833256-4c78-41a9-bb16-6b7fb95eee71/pull/0.log"
Jul 17 06:30:01.778632 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.778598    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/extract/0.log"
Jul 17 06:30:01.796841 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.796811    2567 generic.go:356] "Generic (PLEG): container finished" podID="0c251770-fb65-49a7-ab8d-89e3d1b81f92" containerID="8064aebf8d2d59862a7bd94c0aafbb3e03e533c1492fa2fc614ff1d1808a9adc" exitCode=0
Jul 17 06:30:01.797022 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.796865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6" event={"ID":"0c251770-fb65-49a7-ab8d-89e3d1b81f92","Type":"ContainerDied","Data":"8064aebf8d2d59862a7bd94c0aafbb3e03e533c1492fa2fc614ff1d1808a9adc"}
Jul 17 06:30:01.801338 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.801314    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/util/0.log"
Jul 17 06:30:01.832558 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.832533    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xtnj_7d88cdfb-cbed-44d1-bc4b-729b1083a824/pull/0.log"
Jul 17 06:30:01.857751 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.857729    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/extract/0.log"
Jul 17 06:30:01.879094 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.879069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/util/0.log"
Jul 17 06:30:01.899784 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:01.899754    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1frs96_c4d8c185-a108-4a57-b0c7-070093642a06/pull/0.log"
Jul 17 06:30:02.602081 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:02.602050    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-w29xv_3a33fff3-ea18-4ffa-9cb5-16100f96c070/limitador/0.log"
Jul 17 06:30:02.930408 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:02.930381    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"
Jul 17 06:30:03.810065 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:03.810033    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6"
Jul 17 06:30:03.810065 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:03.810049    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737830-6jwl6" event={"ID":"0c251770-fb65-49a7-ab8d-89e3d1b81f92","Type":"ContainerDied","Data":"c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b"}
Jul 17 06:30:03.810279 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:03.810099    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3a84aa88f644cd9d1e3cceab183dda017935ffa44ef80e18c9b83a2d293686b"
Jul 17 06:30:03.988451 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:03.988419    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"]
Jul 17 06:30:03.990820 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:03.990797    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737785-cl2ss"]
Jul 17 06:30:04.014920 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.014893    2567 scope.go:117] "RemoveContainer" containerID="bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15"
Jul 17 06:30:04.020405 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.020377    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2387dbb-f6be-4e94-b754-48abfad0676a" path="/var/lib/kubelet/pods/c2387dbb-f6be-4e94-b754-48abfad0676a/volumes"
Jul 17 06:30:04.333585 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.333557    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/alertmanager/0.log"
Jul 17 06:30:04.354789 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.354765    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/config-reloader/0.log"
Jul 17 06:30:04.377551 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.377527    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/kube-rbac-proxy-web/0.log"
Jul 17 06:30:04.399534 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.399512    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/kube-rbac-proxy/0.log"
Jul 17 06:30:04.420192 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.420169    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/kube-rbac-proxy-metric/0.log"
Jul 17 06:30:04.444130 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.444107    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/prom-label-proxy/0.log"
Jul 17 06:30:04.465550 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.465522    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_104609b2-327d-4d05-8ffa-02fb605df47c/init-config-reloader/0.log"
Jul 17 06:30:04.623315 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.623285    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f8bbccccc-fd6n6_18adf439-a774-4c72-9c27-19b0a0f6ce15/metrics-server/0.log"
Jul 17 06:30:04.818069 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.818036    2567 generic.go:356] "Generic (PLEG): container finished" podID="86163130-117b-4cca-9113-74e3a3222181" containerID="c7a529f3076b39a840a4557daaafb4421dcc87e8460f867b3fecee478982289a" exitCode=6
Jul 17 06:30:04.818248 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.818097    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerDied","Data":"c7a529f3076b39a840a4557daaafb4421dcc87e8460f867b3fecee478982289a"}
Jul 17 06:30:04.818248 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.818170    2567 scope.go:117] "RemoveContainer" containerID="bb2c16cf192503a5902510e060cf85491e92fa5fdb2c4003ec632126be487d15"
Jul 17 06:30:04.818540 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.818521    2567 scope.go:117] "RemoveContainer" containerID="c7a529f3076b39a840a4557daaafb4421dcc87e8460f867b3fecee478982289a"
Jul 17 06:30:04.818778 ip-10-0-142-187 kubenswrapper[2567]: E0717 06:30:04.818749    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb_odh-ai-gateway-infra(86163130-117b-4cca-9113-74e3a3222181)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" podUID="86163130-117b-4cca-9113-74e3a3222181"
Jul 17 06:30:04.869948 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.869918    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-trbqt_235ab4c9-7d5f-43a1-bd57-336cce7f6bc4/node-exporter/0.log"
Jul 17 06:30:04.901643 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.901612    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-trbqt_235ab4c9-7d5f-43a1-bd57-336cce7f6bc4/kube-rbac-proxy/0.log"
Jul 17 06:30:04.947175 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.947144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-trbqt_235ab4c9-7d5f-43a1-bd57-336cce7f6bc4/init-textfile/0.log"
Jul 17 06:30:04.987047 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:04.987019    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-l2z85_0f01abfb-f359-4d94-af36-34704ba9836e/kube-rbac-proxy-main/0.log"
Jul 17 06:30:05.008041 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.008005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-l2z85_0f01abfb-f359-4d94-af36-34704ba9836e/kube-rbac-proxy-self/0.log"
Jul 17 06:30:05.030712 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.030612    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-l2z85_0f01abfb-f359-4d94-af36-34704ba9836e/openshift-state-metrics/0.log"
Jul 17 06:30:05.326842 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.326751    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-574fc6996d-vgxzn_b2ef69e6-903c-433f-b098-af26d603545c/telemeter-client/0.log"
Jul 17 06:30:05.348056 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.348024    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-574fc6996d-vgxzn_b2ef69e6-903c-433f-b098-af26d603545c/reload/0.log"
Jul 17 06:30:05.368183 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.368145    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-574fc6996d-vgxzn_b2ef69e6-903c-433f-b098-af26d603545c/kube-rbac-proxy/0.log"
Jul 17 06:30:05.401301 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.401274    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/thanos-query/0.log"
Jul 17 06:30:05.435511 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.435461    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/kube-rbac-proxy-web/0.log"
Jul 17 06:30:05.456925 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.456887    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/kube-rbac-proxy/0.log"
Jul 17 06:30:05.479464 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.479431    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/prom-label-proxy/0.log"
Jul 17 06:30:05.499894 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.499866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/kube-rbac-proxy-rules/0.log"
Jul 17 06:30:05.524442 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.524413    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f64c9c54b-4wm56_d5e34db1-9cb6-44f0-a8db-a87ddb6eea79/kube-rbac-proxy-metrics/0.log"
Jul 17 06:30:05.845718 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.845667    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:30:05.987167 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:05.987141    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:30:06.066296 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.066261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca\") pod \"86163130-117b-4cca-9113-74e3a3222181\" (UID: \"86163130-117b-4cca-9113-74e3a3222181\") "
Jul 17 06:30:06.066735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.066625    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86163130-117b-4cca-9113-74e3a3222181" (UID: "86163130-117b-4cca-9113-74e3a3222181"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:30:06.167881 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.167799    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86163130-117b-4cca-9113-74e3a3222181-maas-api-service-ca\") on node \"ip-10-0-142-187.ec2.internal\" DevicePath \"\""
Jul 17 06:30:06.834329 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.834296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb" event={"ID":"86163130-117b-4cca-9113-74e3a3222181","Type":"ContainerDied","Data":"c4baaa5bc8501064c628a836a7f9ddf51e8ba37fab19ebd5d41cb326a6c427a8"}
Jul 17 06:30:06.834329 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.834320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"
Jul 17 06:30:06.834591 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.834359    2567 scope.go:117] "RemoveContainer" containerID="c7a529f3076b39a840a4557daaafb4421dcc87e8460f867b3fecee478982289a"
Jul 17 06:30:06.856794 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.856768    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-7p99p_b1ca6cbc-0179-4cb2-ac21-f9557a13a121/networking-console-plugin/0.log"
Jul 17 06:30:06.858351 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.858328    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:30:06.867652 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:06.867625    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-81346fa0-rtwzb"]
Jul 17 06:30:08.021232 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.021197    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86163130-117b-4cca-9113-74e3a3222181" path="/var/lib/kubelet/pods/86163130-117b-4cca-9113-74e3a3222181/volumes"
Jul 17 06:30:08.060735 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.060703    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-z79vl_87d3dc7e-f5db-4563-8c24-47fa5b851b92/download-server/0.log"
Jul 17 06:30:08.084773 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.084715    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"]
Jul 17 06:30:08.085134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085111    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085134 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085132    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085147    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c251770-fb65-49a7-ab8d-89e3d1b81f92" containerName="cleanup"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085154    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c251770-fb65-49a7-ab8d-89e3d1b81f92" containerName="cleanup"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085170    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085177    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085250    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085273    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86163130-117b-4cca-9113-74e3a3222181" containerName="revoke-keys"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085281    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c251770-fb65-49a7-ab8d-89e3d1b81f92" containerName="cleanup"
Jul 17 06:30:08.085448 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.085293    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7bc965-213f-48a4-9930-1c38cb510e00" containerName="revoke-keys"
Jul 17 06:30:08.089840 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.089822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.092381 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.092354    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6jcf\"/\"kube-root-ca.crt\""
Jul 17 06:30:08.093244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.093226    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6jcf\"/\"openshift-service-ca.crt\""
Jul 17 06:30:08.093244 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.093239    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6jcf\"/\"default-dockercfg-jcjq2\""
Jul 17 06:30:08.100698 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.100647    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"]
Jul 17 06:30:08.185137 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.185090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-sys\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.185137 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.185140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmr6g\" (UniqueName: \"kubernetes.io/projected/6915ff9b-b869-4db2-ba58-0041a874a3d7-kube-api-access-jmr6g\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.185361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.185258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-proc\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.185361 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.185324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-lib-modules\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.185429 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.185364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-podres\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-proc\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286587 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-lib-modules\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-podres\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-sys\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-proc\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmr6g\" (UniqueName: \"kubernetes.io/projected/6915ff9b-b869-4db2-ba58-0041a874a3d7-kube-api-access-jmr6g\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-sys\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-podres\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.286821 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.286798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6915ff9b-b869-4db2-ba58-0041a874a3d7-lib-modules\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.294866 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.294843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmr6g\" (UniqueName: \"kubernetes.io/projected/6915ff9b-b869-4db2-ba58-0041a874a3d7-kube-api-access-jmr6g\") pod \"perf-node-gather-daemonset-cxlr2\" (UID: \"6915ff9b-b869-4db2-ba58-0041a874a3d7\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.400703 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.400644    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.538640 ip-10-0-142-187 kubenswrapper[2567]: W0717 06:30:08.538572    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6915ff9b_b869_4db2_ba58_0041a874a3d7.slice/crio-887ce07bae6371a2d1b9cf7fca5e21d82409212fd4d608a08eb057c446e144d0 WatchSource:0}: Error finding container 887ce07bae6371a2d1b9cf7fca5e21d82409212fd4d608a08eb057c446e144d0: Status 404 returned error can't find the container with id 887ce07bae6371a2d1b9cf7fca5e21d82409212fd4d608a08eb057c446e144d0
Jul 17 06:30:08.538640 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.538606    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"]
Jul 17 06:30:08.848284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.848195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2" event={"ID":"6915ff9b-b869-4db2-ba58-0041a874a3d7","Type":"ContainerStarted","Data":"6b25a0140c26a5e175c4bd3b904dd4570541df0b5b502e7bda8ff307bc15567d"}
Jul 17 06:30:08.848284 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.848245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2" event={"ID":"6915ff9b-b869-4db2-ba58-0041a874a3d7","Type":"ContainerStarted","Data":"887ce07bae6371a2d1b9cf7fca5e21d82409212fd4d608a08eb057c446e144d0"}
Jul 17 06:30:08.848489 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.848324    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:08.866880 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:08.866832    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2" podStartSLOduration=0.866818487 podStartE2EDuration="866.818487ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 06:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:30:08.864195248 +0000 UTC m=+3427.327379351" watchObservedRunningTime="2026-07-17 06:30:08.866818487 +0000 UTC m=+3427.330002591"
Jul 17 06:30:09.767316 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:09.767292    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nbvlz_68c7e398-971a-4af8-b120-7492f2f91fcb/dns/0.log"
Jul 17 06:30:09.786215 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:09.786187    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nbvlz_68c7e398-971a-4af8-b120-7492f2f91fcb/kube-rbac-proxy/0.log"
Jul 17 06:30:09.846251 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:09.846220    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gwjxr_1fd5f8f0-e459-458f-8e96-e4ca0003da1a/dns-node-resolver/0.log"
Jul 17 06:30:10.359756 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:10.359718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5695c76d95-trtbk_b0db64fd-bb7d-4546-b0b2-dfbe86a1fa05/registry/0.log"
Jul 17 06:30:10.431360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:10.431334    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lr5l2_ddcade3c-54a5-4606-b23b-f6d523c49bd0/node-ca/0.log"
Jul 17 06:30:11.426943 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:11.426907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rb4wh_eef0f3a8-46ff-4498-92e8-01fcc11082b4/discovery/0.log"
Jul 17 06:30:12.361651 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:12.361620    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tcj27_e5a843b1-dcd7-4755-8baf-68853ef12ce5/serve-healthcheck-canary/0.log"
Jul 17 06:30:12.915396 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:12.915371    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdwt7_927b0b7e-d2d4-4027-bdb1-74a7415faa99/kube-rbac-proxy/0.log"
Jul 17 06:30:12.937519 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:12.937496    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdwt7_927b0b7e-d2d4-4027-bdb1-74a7415faa99/exporter/0.log"
Jul 17 06:30:12.960273 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:12.960242    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdwt7_927b0b7e-d2d4-4027-bdb1-74a7415faa99/extractor/0.log"
Jul 17 06:30:14.864360 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:14.864333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-cxlr2"
Jul 17 06:30:15.702797 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:15.702765    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-cjchn_524c1673-0d90-4752-bdba-c749ca935f94/manager/0.log"
Jul 17 06:30:15.721623 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:15.721597    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-cjchn_524c1673-0d90-4752-bdba-c749ca935f94/copy-manifests/0.log"
Jul 17 06:30:17.204663 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:17.204637    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6687b4bb84-ksj5k_0c2571a4-0913-4dd5-a5d1-fd22bedc1cb6/manager/0.log"
Jul 17 06:30:17.898962 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:17.898930    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rb4wh_eef0f3a8-46ff-4498-92e8-01fcc11082b4/discovery/0.log"
Jul 17 06:30:19.365401 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:19.365311    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rb4wh_eef0f3a8-46ff-4498-92e8-01fcc11082b4/discovery/0.log"
Jul 17 06:30:22.348696 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:22.348644    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-bqlgh_bd6a7b83-9967-451e-9d5f-3fed8120908d/migrator/0.log"
Jul 17 06:30:22.369115 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:22.369079    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-bqlgh_bd6a7b83-9967-451e-9d5f-3fed8120908d/graceful-termination/0.log"
Jul 17 06:30:23.778636 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.778609    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/kube-multus-additional-cni-plugins/0.log"
Jul 17 06:30:23.798799 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.798764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/egress-router-binary-copy/0.log"
Jul 17 06:30:23.818084 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.818062    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/cni-plugins/0.log"
Jul 17 06:30:23.839165 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.839142    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/bond-cni-plugin/0.log"
Jul 17 06:30:23.859160 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.859139    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/routeoverride-cni/0.log"
Jul 17 06:30:23.879277 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.879254    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/whereabouts-cni-bincopy/0.log"
Jul 17 06:30:23.900776 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:23.900744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp88x_232ea57f-e48f-4ef6-9ce3-46609b7fc283/whereabouts-cni/0.log"
Jul 17 06:30:24.134036 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:24.133958    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gsn4q_c4666bbd-64d6-4977-b104-b4c625801801/kube-multus/0.log"
Jul 17 06:30:24.216205 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:24.216174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hzh45_17f769d5-02cb-4652-9dea-0876273087c6/network-metrics-daemon/0.log"
Jul 17 06:30:24.244858 ip-10-0-142-187 kubenswrapper[2567]: I0717 06:30:24.244833    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hzh45_17f769d5-02cb-4652-9dea-0876273087c6/kube-rbac-proxy/0.log"