Sep 14 12:58:08.149740 ip-10-0-129-167 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 12:58:08.585265 ip-10-0-129-167 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:08.585265 ip-10-0-129-167 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 12:58:08.585265 ip-10-0-129-167 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:08.585265 ip-10-0-129-167 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 12:58:08.585265 ip-10-0-129-167 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:08.586279 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.586197    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 12:58:08.589848 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589833    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.589848 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589850    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589854    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589858    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589861    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589865    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589868    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589871    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589873    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589876    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589879    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589882    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589884    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589887    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589889    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589892    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589894    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589897    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589899    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589902    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.589919 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589905    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589909    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589911    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589914    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589916    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589918    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589921    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589924    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589927    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589929    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589932    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589935    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589937    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589940    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589942    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589945    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589947    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589950    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589953    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589956    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.590374 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589959    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589962    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589964    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589967    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589969    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589971    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589974    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589976    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589979    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589981    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589983    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589986    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589989    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.589998    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590001    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590004    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590007    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590010    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590012    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590015    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.590865 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590018    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590021    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590026    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590030    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590033    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590036    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590039    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590042    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590044    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590047    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590050    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590052    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590055    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590058    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590061    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590064    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590067    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590069    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590072    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.591618 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590076    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590079    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590081    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590083    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590086    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590089    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590091    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590094    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590097    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590099    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590102    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590104    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590107    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590109    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590112    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590114    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590117    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590119    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590122    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590124    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.592355 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590803    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590809    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590812    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590814    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590817    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590820    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590823    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590826    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590829    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590832    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590836    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590838    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590841    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590844    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590846    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590849    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590852    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590854    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590857    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590859    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.592931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590862    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590866    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590869    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590872    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590874    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590877    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590879    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590882    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590885    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590889    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590893    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590896    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590899    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590902    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590904    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590907    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590910    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590913    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590916    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.593442 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590919    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590922    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590925    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590928    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590931    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590934    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590936    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590939    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590941    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590944    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590946    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590949    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590951    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590954    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.590957    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591000    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591738    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591747    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591751    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591756    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.593931 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591762    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591771    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591776    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591781    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591786    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591790    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591807    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591812    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591822    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591826    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591831    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591836    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591841    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591846    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591850    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591854    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591859    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591864    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591868    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591873    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.594420 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591877    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591886    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591891    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591895    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591901    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591907    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591915    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591921    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591927    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591931    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591936    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591940    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591944    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591954    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591993    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.591998    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592002    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592007    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592011    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592015    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.594926 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592904    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592916    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592920    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592924    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592927    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592930    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592934    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592937    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592940    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592943    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592946    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592948    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592951    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592954    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592956    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592959    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592961    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592964    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592966    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.595423 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592969    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592972    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592974    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592977    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592980    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592983    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592985    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592988    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592990    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592993    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592995    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.592998    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593001    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593003    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593006    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593009    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593012    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593014    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593017    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593020    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.595913 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593023    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593025    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593028    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593030    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593033    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593040    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593043    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593046    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593048    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593051    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593053    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593056    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593058    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593061    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593063    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593066    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593069    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593071    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593074    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593077    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.596403 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593079    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593082    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593084    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593087    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593089    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593092    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593095    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593098    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593101    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593104    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593106    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593109    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593111    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593114    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593116    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593119    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593122    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593127    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593131    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.596914 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593134    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593137    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593140    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593142    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593145    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593147    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593150    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593152    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593155    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593158    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593162    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593164    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593167    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593171    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593175    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593177    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593180    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593183    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593185    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.597392 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593189    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593191    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593286    2566 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593323    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593341    2566 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593346    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593351    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593355    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593359    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593363    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593366    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593370    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593373    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593377    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593380    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593383    2566 flags.go:64] FLAG: --cgroup-root=""
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593386    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593389    2566 flags.go:64] FLAG: --client-ca-file=""
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593392    2566 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593395    2566 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593399    2566 flags.go:64] FLAG: --cluster-domain=""
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593402    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593405    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593408    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 12:58:08.597901 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593412    2566 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593416    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593419    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593422    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593425    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593428    2566 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593431    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593434    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593438    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593440    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593444    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593448    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593451    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593454    2566 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593456    2566 flags.go:64] FLAG: --enable-server="true"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593460    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593465    2566 flags.go:64] FLAG: --event-burst="100"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593468    2566 flags.go:64] FLAG: --event-qps="50"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593471    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593489    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593492    2566 flags.go:64] FLAG: --eviction-hard=""
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593500    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593503    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593506    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593509    2566 flags.go:64] FLAG: --eviction-soft=""
Sep 14 12:58:08.598523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593512    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593515    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593518    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593521    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593524    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593527    2566 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593530    2566 flags.go:64] FLAG: --feature-gates=""
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593533    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593536    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593539    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593542    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593545    2566 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593548    2566 flags.go:64] FLAG: --help="false"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593551    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593555    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593558    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593561    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593564    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593567    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593570    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593573    2566 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593576    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593579    2566 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 12:58:08.599118 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593582    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593585    2566 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593588    2566 flags.go:64] FLAG: --kube-reserved=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593591    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593594    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593597    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593599    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593602    2566 flags.go:64] FLAG: --lock-file=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593605    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593608    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593614    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593620    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593622    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593625    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593628    2566 flags.go:64] FLAG: --logging-format="text"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593631    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593634    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593637    2566 flags.go:64] FLAG: --manifest-url=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593640    2566 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593644    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593647    2566 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593651    2566 flags.go:64] FLAG: --max-pods="110"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593654    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593657    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593660    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 12:58:08.599717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593663    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593666    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593669    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593671    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593678    2566 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593681    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593684    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593687    2566 flags.go:64] FLAG: --pod-cidr=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593691    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593696    2566 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593699    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593702    2566 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593705    2566 flags.go:64] FLAG: --port="10250"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593708    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593711    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0036a564f49280c75"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593714    2566 flags.go:64] FLAG: --qos-reserved=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593717    2566 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593721    2566 flags.go:64] FLAG: --register-node="true"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593724    2566 flags.go:64] FLAG: --register-with-taints=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593728    2566 flags.go:64] FLAG: --registry-burst="10"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593731    2566 flags.go:64] FLAG: --registry-qps="5"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593734    2566 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593737    2566 flags.go:64] FLAG: --reserved-memory=""
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593740    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593743    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 12:58:08.600349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593746    2566 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593749    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593752    2566 flags.go:64] FLAG: --runonce="false"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593755    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593758    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593761    2566 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593764    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593767    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593770    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593773    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593776    2566 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593779    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593782    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593785    2566 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593787    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593790    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593794    2566 flags.go:64] FLAG: --system-cgroups=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593796    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593802    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593805    2566 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593808    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593813    2566 flags.go:64] FLAG: --tls-min-version=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593816    2566 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593819    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593824    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 12:58:08.600988 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593828    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593830    2566 flags.go:64] FLAG: --v="2"
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593834    2566 flags.go:64] FLAG: --version="false"
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593838    2566 flags.go:64] FLAG: --vmodule=""
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593842    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.593845    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593961    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593965    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593968    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593971    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593974    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593977    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593980    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593983    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593985    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593988    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593991    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593994    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593996    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.593999    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594001    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.601749 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594004    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594006    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594009    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594012    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594015    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594017    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594020    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594022    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594025    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594027    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594033    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594035    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594038    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594041    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594043    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594046    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594048    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594051    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594054    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594057    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.602268 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594061    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594064    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594068    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594072    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594075    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594078    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594081    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594084    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594086    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594100    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594102    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594105    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594108    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594110    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594113    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594115    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594119    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594121    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594124    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.602782 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594127    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594130    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594133    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594138    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594141    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594144    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594146    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594149    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594151    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594154    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594157    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594160    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594162    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594165    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594167    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594170    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594172    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594175    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594178    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.603242 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594180    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594183    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594186    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594188    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594191    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594193    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594196    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594198    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594201    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594205    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594208    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594212    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594215    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594218    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594220    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594223    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594228    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594231    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594233    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.603726 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594236    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594238    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594242    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594244    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594247    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594249    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.594252    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.594723    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.601653    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.601667    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.602573    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.602581    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602637    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602643    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602646    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.604197 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602649    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602652    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602656    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602658    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602662    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602666    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602670    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602672    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602675    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602678    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602681    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602683    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602686    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602689    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602692    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602695    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602697    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602700    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602703    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602706    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.604667 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602708    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602711    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602714    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602716    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602719    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602722    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602726    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602729    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602732    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602735    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602737    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602740    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602742    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602745    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602747    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602750    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602754    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602757    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602760    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.605181 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602763    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602766    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602769    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602772    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602775    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602778    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602781    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602784    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602787    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602790    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602793    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602795    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602798    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602801    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602803    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602806    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602809    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602811    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602814    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.605668 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602818    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602821    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602824    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602827    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602830    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602832    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602835    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602838    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602840    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602843    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602845    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602848    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602851    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602853    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602856    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602859    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602861    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602864    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602866    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.606122 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602869    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602871    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602874    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602878    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602881    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602884    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602887    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602890    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602893    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602896    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602898    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602901    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602904    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602907    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602910    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602920    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602923    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602925    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.606596 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.602928    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.602933    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603044    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603049    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603052    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603055    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603058    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603061    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603064    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603066    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603069    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603072    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603075    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603078    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603081    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603083    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:08.607035 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603086    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603089    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603092    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603095    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603097    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603100    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603103    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603105    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603108    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603112    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603115    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603119    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603122    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603125    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603133    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603137    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603139    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603142    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603145    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:08.607439 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603149    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603152    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603155    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603158    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603160    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603163    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603166    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603169    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603171    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603174    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603177    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603180    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603182    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603185    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603187    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603190    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603192    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603195    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603198    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603200    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:08.607912 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603203    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603206    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603208    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603211    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603213    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603216    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603219    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603221    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603225    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603227    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603230    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603232    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603235    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603237    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603240    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603242    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603245    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603248    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603251    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:08.608418 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603253    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603256    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603259    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603261    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603264    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603266    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603269    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603271    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603274    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603276    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603279    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603281    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603283    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603286    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603289    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603291    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603294    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603296    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603300    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603304    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:08.608984 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603308    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603310    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603313    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603316    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603318    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603321    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:08.603324    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.603329    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.604424    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.606885    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.607956    2566 server.go:1019] "Starting client certificate rotation"
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.608057    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 12:58:08.609463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.608101    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 12:58:08.610438 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.610424    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 12:58:08.611576 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.611561    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 12:58:08.627566 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.627542    2566 log.go:25] "Validated CRI v1 runtime API"
Sep 14 12:58:08.630312 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.630297    2566 log.go:25] "Validated CRI v1 image API"
Sep 14 12:58:08.631151 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.631134    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 12:58:08.633842 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.633823    2566 fs.go:135] Filesystem UUIDs: map[1c70f096-601f-45a3-8955-8a745c162776:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d3765bad-1011-4215-99f9-317228d9fef5:/dev/nvme0n1p4]
Sep 14 12:58:08.633902 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.633840    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 12:58:08.639877 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.639860    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 12:58:08.639952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.639769    2566 manager.go:216] Machine: {Timestamp:2026-09-14 12:58:08.638295532 +0000 UTC m=+0.369648391 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099955 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237f1ca293ba0a91713a81b0c4bcec SystemUUID:ec237f1c-a293-ba0a-9171-3a81b0c4bcec BootID:3bd468d5-1e20-4719-987c-61ed822c1e76 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ea:da:2d:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ea:da:2d:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:cd:78:f2:03:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 12:58:08.639952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.639898    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 12:58:08.640032 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.640008    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 12:58:08.643190 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.643170    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 12:58:08.643333 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.643193    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 12:58:08.644057 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.644037    2566 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 12:58:08.644057 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.644060    2566 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 12:58:08.644130 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.644068    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 12:58:08.644940 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.644930    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 12:58:08.645731 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.645721    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 12:58:08.648603 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648592    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 12:58:08.648710 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648701    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 12:58:08.648742 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648729    2566 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 12:58:08.648773 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648752    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 12:58:08.648773 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648769    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 12:58:08.648827 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648780    2566 kubelet.go:398] "Adding apiserver pod source"
Sep 14 12:58:08.648827 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.648789    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 12:58:08.649109 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.649098    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 12:58:08.649148 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.649119    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 12:58:08.651731 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.651717    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 12:58:08.653538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.653523    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 12:58:08.653615 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.653561    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 12:58:08.655414 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655399    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655418    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655426    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655434    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655447    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655455    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655488    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655497    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 12:58:08.655509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655507    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 12:58:08.655759 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655515    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 12:58:08.655759 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655527    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 12:58:08.655759 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.655535    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 12:58:08.656497 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.656465    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 12:58:08.656497 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.656490    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 12:58:08.660617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.660601    2566 server.go:1268] "Started kubelet"
Sep 14 12:58:08.661342 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.661296    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 12:58:08.661443 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.661430    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 12:58:08.661518 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.661352    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 12:58:08.661518 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.661425    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 12:58:08.661518 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.661352    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 12:58:08.661518 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.661512    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 12:58:08.661672 ip-10-0-129-167 systemd[1]: Started Kubernetes Kubelet.
Sep 14 12:58:08.665616 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.665592    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 12:58:08.667090 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.667069    2566 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 12:58:08.667179 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.667108    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 12:58:08.670503 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.669451    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-167.ec2.internal.18d53159ca0153af  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-167.ec2.internal,UID:ip-10-0-129-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-167.ec2.internal,},FirstTimestamp:2026-09-14 12:58:08.660575151 +0000 UTC m=+0.391928009,LastTimestamp:2026-09-14 12:58:08.660575151 +0000 UTC m=+0.391928009,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-167.ec2.internal,}"
Sep 14 12:58:08.670852 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.670836    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 12:58:08.671349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.671334    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 12:58:08.671530 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.671508    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:08.671952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.671933    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 12:58:08.671952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.671936    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 12:58:08.671952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.671960    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 12:58:08.672172 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672013    2566 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 12:58:08.672172 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672031    2566 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 12:58:08.672246 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672233    2566 factory.go:55] Registering systemd factory
Sep 14 12:58:08.672274 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672260    2566 factory.go:223] Registration of the systemd container factory successfully
Sep 14 12:58:08.672329 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672311    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkkgw"
Sep 14 12:58:08.672583 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672468    2566 factory.go:153] Registering CRI-O factory
Sep 14 12:58:08.672583 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672509    2566 factory.go:223] Registration of the crio container factory successfully
Sep 14 12:58:08.672583 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672570    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 12:58:08.672707 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672591    2566 factory.go:103] Registering Raw factory
Sep 14 12:58:08.672707 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672606    2566 manager.go:1196] Started watching for new ooms in manager
Sep 14 12:58:08.672978 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.672966    2566 manager.go:349] Starting recovery of all containers
Sep 14 12:58:08.676222 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.676188    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 12:58:08.676403 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.676383    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 12:58:08.683156 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.683136    2566 manager.go:354] Recovery completed
Sep 14 12:58:08.683255 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.683210    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkkgw"
Sep 14 12:58:08.687245 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.687230    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.689993 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.689974    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.690070 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690003    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.690070 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690013    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.690629 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690616    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 12:58:08.690629 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690624    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.690774 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690626    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 12:58:08.690774 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.690675    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 12:58:08.691342 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.691329    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.691393 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.691355    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.691393 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.691364    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.692069 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.692058    2566 policy_none.go:49] "None policy: Start"
Sep 14 12:58:08.692105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.692073    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 12:58:08.692105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.692082    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 12:58:08.693047 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.693036    2566 policy_none.go:47] "Start"
Sep 14 12:58:08.693420 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.692298    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-167.ec2.internal.18d53159cbc22b3a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-167.ec2.internal,UID:ip-10-0-129-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-167.ec2.internal,},FirstTimestamp:2026-09-14 12:58:08.689990458 +0000 UTC m=+0.421343316,LastTimestamp:2026-09-14 12:58:08.689990458 +0000 UTC m=+0.421343316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-167.ec2.internal,}"
Sep 14 12:58:08.719140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719125    2566 manager.go:337] "Starting Device Plugin manager"
Sep 14 12:58:08.719229 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.719166    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 12:58:08.719229 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719178    2566 server.go:87] "Starting device plugin registration server"
Sep 14 12:58:08.719448 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719437    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 12:58:08.719533 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719449    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 12:58:08.719664 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719630    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 12:58:08.719720 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719706    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 12:58:08.719720 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.719714    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 12:58:08.720133 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.720103    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 12:58:08.720202 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.720168    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:08.765626 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.765598    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 12:58:08.766714 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.766697    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 12:58:08.766797 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.766741    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 12:58:08.766797 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.766759    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 12:58:08.766797 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.766794    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 12:58:08.768782 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.768759    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:08.819605 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.819583    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.820502 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.820487    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.820586 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.820520    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.820586 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.820536    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.820586 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.820558    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.827127 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.827114    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.827166 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.827135    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-167.ec2.internal\": node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:08.838569 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.838484    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:08.867703 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.867682    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"]
Sep 14 12:58:08.867767 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.867748    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.869782 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.869760    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.869864 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.869793    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.869864 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.869803    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.871210 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871198    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.871330 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871317    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.871402 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871351    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.871972 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871957    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.872052 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871990    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.872052 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872005    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.872052 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.871960    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.872052 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872046    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.872230 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872059    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.872797 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.872849 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.872849 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.872840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979aa361aaf6f040c740f0c683314ad1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"979aa361aaf6f040c740f0c683314ad1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.873346 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.873328    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.873422 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.873358    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:08.874006 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.873988    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:08.874096 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.874018    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:08.874096 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.874029    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:08.900110 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.900090    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-167.ec2.internal\" not found" node="ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.904624 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.904609    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-167.ec2.internal\" not found" node="ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.939228 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:08.939210    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:08.973400 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.973538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973409    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.973538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979aa361aaf6f040c740f0c683314ad1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"979aa361aaf6f040c740f0c683314ad1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.973538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973511    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979aa361aaf6f040c740f0c683314ad1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"979aa361aaf6f040c740f0c683314ad1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.973538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:08.973699 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:08.973573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4a76eac18462ec9f2ef75141492b30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"a4a76eac18462ec9f2ef75141492b30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:09.040315 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:09.040295    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:09.140882 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:09.140820    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:09.202410 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:09.202374    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:09.208115 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:09.208095    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:09.241396 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:09.241370    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:10.758443 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:10.758417    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:10.858916 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:10.858846    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:10.959346 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:10.959319    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:11.023858 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.023831    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 12:58:11.024294 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.023960    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 12:58:11.060135 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:11.060104    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:11.107123 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.107086    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 12:53:10 +0000 UTC" deadline="2028-03-27 10:36:35.021599965 +0000 UTC"
Sep 14 12:58:11.107123 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.107116    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13437h38m23.914486865s"
Sep 14 12:58:11.160436 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:11.160403    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
Sep 14 12:58:11.219731 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:11.219512    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a76eac18462ec9f2ef75141492b30e.slice/crio-a63e5597e321f137ee69c7d924d8192e1ddb69e884f9e03c4bbe7a2bd617ac12 WatchSource:0}: Error finding container a63e5597e321f137ee69c7d924d8192e1ddb69e884f9e03c4bbe7a2bd617ac12: Status 404 returned error can't find the container with id a63e5597e321f137ee69c7d924d8192e1ddb69e884f9e03c4bbe7a2bd617ac12
Sep 14 12:58:11.223488 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.223470    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 12:58:11.257521 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.257503    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:11.288777 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.288754    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:11.305087 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.305066    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 12:58:11.307374 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.307362    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
Sep 14 12:58:11.316111 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.316095    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:11.317209 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.317196    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 12:58:11.349662 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:11.349638    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979aa361aaf6f040c740f0c683314ad1.slice/crio-95ead39deb3cbc4a85f5195a27c2df28a13fb7dd20fb58479c75b9b6cbab4848 WatchSource:0}: Error finding container 95ead39deb3cbc4a85f5195a27c2df28a13fb7dd20fb58479c75b9b6cbab4848: Status 404 returned error can't find the container with id 95ead39deb3cbc4a85f5195a27c2df28a13fb7dd20fb58479c75b9b6cbab4848
Sep 14 12:58:11.626423 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:11.626337    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:12.067263 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.067186    2566 apiserver.go:52] "Watching apiserver"
Sep 14 12:58:12.076650 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.076623    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 12:58:12.077119 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.077091    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4","openshift-cluster-node-tuning-operator/tuned-phvtf","openshift-dns/node-resolver-5mm2w","openshift-image-registry/node-ca-nn8s8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-c5nfw","openshift-multus/network-metrics-daemon-8hn27","kube-system/konnectivity-agent-z9mwf","kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal","openshift-multus/multus-cq2pm","openshift-network-diagnostics/network-check-target-z8qs7","openshift-network-operator/iptables-alerter-sjbkj","openshift-ovn-kubernetes/ovnkube-node-st6pb","kube-system/global-pull-secret-syncer-fgdpr"]
Sep 14 12:58:12.078833 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.078520    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.078833 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.078609    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:12.079750 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.079719    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:12.079848 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.079788    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:12.080939 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.080909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.082638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.082621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.083579 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.083484    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.083579 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.083549    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:12.084481 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.084457    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.084571 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.084463    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.084571 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.084494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvz8j\""
Sep 14 12:58:12.084893 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.084854    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.084972 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.084917    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.085241 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.085222    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 12:58:12.085471 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.085455    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtstv\""
Sep 14 12:58:12.085623 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.085604    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.086369 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.086351    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.087817 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.087798    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vvphc\""
Sep 14 12:58:12.088366 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.087964    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 12:58:12.088366 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.088125    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.088502 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.088411    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.088502 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.088487    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 12:58:12.088708 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.088671    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 12:58:12.089012 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.088994    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.089199 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.089178    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 12:58:12.089568 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.089550    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 12:58:12.089661 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.089575    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 12:58:12.089661 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.089632    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kts7q\""
Sep 14 12:58:12.090304 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.090271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.092130 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.092111    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.092245 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.092117    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 12:58:12.093717 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.093698    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.095523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.095494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 12:58:12.095617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.095549    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.095673 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.095617    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.095857 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.095835    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 12:58:12.095857 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.095838    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.096167 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.096143    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.097377 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec0bc69-308d-40bd-9f6b-7644f7494ded-host\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.097483 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097402    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-agent-certs\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.097483 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-konnectivity-ca\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.097593 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.097593 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec0bc69-308d-40bd-9f6b-7644f7494ded-serviceca\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.097693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097580    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.097693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097618    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rrwrp\""
Sep 14 12:58:12.097693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097627    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.097693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097645    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.097957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-cnibin\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098011    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-slash\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098069    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e843a4f-6502-4288-96e1-3b69e00bab7a-hosts-file\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098126    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-ovn\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098218    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-systemd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098251    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-system-cni-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-conf\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098445    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-etc-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098471    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-bin\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098514    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098563    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwlwh\""
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-node-log\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.100976 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098651    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-log-socket\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovn-node-metrics-cert\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098709    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-modprobe-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098747    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-run\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098781    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-kubelet-config\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098809    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098894    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.098984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgppm\" (UniqueName: \"kubernetes.io/projected/31dcd600-0e7e-4728-bd69-3a893ef77db5-kube-api-access-fgppm\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-env-overrides\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099090    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-systemd-units\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-kubelet\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-netns\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-tuned\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099359    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 12:58:12.101914 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099366    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-systemd\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-host\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099490    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjh4x\" (UniqueName: \"kubernetes.io/projected/594b715e-ce54-4f93-832a-32827b632a0a-kube-api-access-mjh4x\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099541    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-netd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099761    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-script-lib\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.099978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-sys\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100154    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-config\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjsb5\" (UniqueName: \"kubernetes.io/projected/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-kube-api-access-xjsb5\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysconfig\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-lib-modules\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-tmp\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100501    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e843a4f-6502-4288-96e1-3b69e00bab7a-tmp-dir\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100533    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-dbus\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-var-lib-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100595    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-kubernetes\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100606    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwrvq\""
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100626    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhfnl\" (UniqueName: \"kubernetes.io/projected/79e7ba94-68fe-4f5d-abab-eb7603102238-kube-api-access-dhfnl\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.102757 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/4e843a4f-6502-4288-96e1-3b69e00bab7a-kube-api-access-dtgw7\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100678    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100716    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nmqbj\""
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.101415    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.100683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznph\" (UniqueName: \"kubernetes.io/projected/aec0bc69-308d-40bd-9f6b-7644f7494ded-kube-api-access-jznph\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.101536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-var-lib-kubelet\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.101602    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pnrrw\""
Sep 14 12:58:12.103676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.101623    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:12.109529 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.109512    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 12:58:12.135953 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.135899    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dv842"
Sep 14 12:58:12.143418 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.143396    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dv842"
Sep 14 12:58:12.188835 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.188785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" event={"ID":"979aa361aaf6f040c740f0c683314ad1","Type":"ContainerStarted","Data":"95ead39deb3cbc4a85f5195a27c2df28a13fb7dd20fb58479c75b9b6cbab4848"}
Sep 14 12:58:12.189455 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.189437    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 12:58:12.190239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.190217    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"a4a76eac18462ec9f2ef75141492b30e","Type":"ContainerStarted","Data":"a63e5597e321f137ee69c7d924d8192e1ddb69e884f9e03c4bbe7a2bd617ac12"}
Sep 14 12:58:12.202200 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202174    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-konnectivity-ca\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.202200 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.202364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-system-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.202364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202288    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.202364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202322    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-multus\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.202364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-hostroot\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec0bc69-308d-40bd-9f6b-7644f7494ded-serviceca\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202414    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-cnibin\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202437    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-slash\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-socket-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e843a4f-6502-4288-96e1-3b69e00bab7a-hosts-file\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202508    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-ovn\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-cni-binary-copy\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-k8s-cni-cncf-io\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.202638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-conf-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-systemd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-sys-fs\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-etc-kubernetes\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202775    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-konnectivity-ca\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-system-cni-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202805    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec0bc69-308d-40bd-9f6b-7644f7494ded-serviceca\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-system-cni-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-conf\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xvb9\" (UniqueName: \"kubernetes.io/projected/0605e0cc-440b-4883-9ef8-8e4606b1d424-kube-api-access-8xvb9\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-etc-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-bin\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da9ecead-dcb6-4979-91d4-95fe093fe251-iptables-alerter-script\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202966    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203140 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-node-log\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-log-socket\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-cnibin\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovn-node-metrics-cert\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-modprobe-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203134    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-slash\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203148    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-run\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-kubelet-config\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203197    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e843a4f-6502-4288-96e1-3b69e00bab7a-hosts-file\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgppm\" (UniqueName: \"kubernetes.io/projected/31dcd600-0e7e-4728-bd69-3a893ef77db5-kube-api-access-fgppm\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203265    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-env-overrides\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203287    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmsbj\" (UniqueName: \"kubernetes.io/projected/da9ecead-dcb6-4979-91d4-95fe093fe251-kube-api-access-kmsbj\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203344    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysctl-conf\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.203874 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203395    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-etc-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-systemd-units\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203439    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-bin\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.202909    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-systemd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203462    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-kubelet\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203494    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-netns\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203530    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-netns\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-kubelet\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31dcd600-0e7e-4728-bd69-3a893ef77db5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203720    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203724    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-run-ovn\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203786    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203827    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-log-socket\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-modprobe-d\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203862    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-node-log\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.203039    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.203234    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:12.204604 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203909    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.203935    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-run\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.204021    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:12.703985861 +0000 UTC m=+3.018769210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204201    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-tuned\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204215    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-kubelet-config\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204253    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-bin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-multus-certs\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.204328    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:12.704287193 +0000 UTC m=+3.019070537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-systemd-units\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-systemd\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204421    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-host\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31dcd600-0e7e-4728-bd69-3a893ef77db5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204463    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-device-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-netns\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-host\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.205433 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-env-overrides\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-run-ovn-kubernetes\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da9ecead-dcb6-4979-91d4-95fe093fe251-host-slash\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-systemd\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjh4x\" (UniqueName: \"kubernetes.io/projected/594b715e-ce54-4f93-832a-32827b632a0a-kube-api-access-mjh4x\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204674    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-netd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-script-lib\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-sys\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-host-cni-netd\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204948    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-registration-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204975    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-sys\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.204997    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-socket-dir-parent\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-kubelet\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205084    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-config\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjsb5\" (UniqueName: \"kubernetes.io/projected/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-kube-api-access-xjsb5\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205212    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysconfig\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.206243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205254    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-lib-modules\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-tmp\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-daemon-config\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-script-lib\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e843a4f-6502-4288-96e1-3b69e00bab7a-tmp-dir\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205437    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-sysconfig\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205537    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-lib-modules\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205612    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovnkube-config\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-dbus\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-var-lib-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-kubernetes\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-var-lib-openvswitch\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205827    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhfnl\" (UniqueName: \"kubernetes.io/projected/79e7ba94-68fe-4f5d-abab-eb7603102238-kube-api-access-dhfnl\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205834    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/344fac89-2ec6-49c3-b18b-49a097126d98-dbus\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e843a4f-6502-4288-96e1-3b69e00bab7a-tmp-dir\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205878    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dp9\" (UniqueName: \"kubernetes.io/projected/9d6f23e2-6af9-454f-a204-543f7d07e662-kube-api-access-52dp9\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/4e843a4f-6502-4288-96e1-3b69e00bab7a-kube-api-access-dtgw7\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-kubernetes\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207038 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.205974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jznph\" (UniqueName: \"kubernetes.io/projected/aec0bc69-308d-40bd-9f6b-7644f7494ded-kube-api-access-jznph\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-var-lib-kubelet\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206097    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e7ba94-68fe-4f5d-abab-eb7603102238-var-lib-kubelet\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-cnibin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206217    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec0bc69-308d-40bd-9f6b-7644f7494ded-host\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206241    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-agent-certs\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.207886 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.206268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec0bc69-308d-40bd-9f6b-7644f7494ded-host\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.209075 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.209028    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-etc-tuned\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.209228 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.209192    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-ovn-node-metrics-cert\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.210133 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.210112    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/550b8152-985e-4e0c-b8e1-3fdb4c8dd016-agent-certs\") pod \"konnectivity-agent-z9mwf\" (UID: \"550b8152-985e-4e0c-b8e1-3fdb4c8dd016\") " pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.210295 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.210278    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79e7ba94-68fe-4f5d-abab-eb7603102238-tmp\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.218476 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.218459    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:12.218560 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.218480    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:12.218560 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.218490    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:12.218560 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.218538    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:12.718525978 +0000 UTC m=+3.033309333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:12.224063 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.223993    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgppm\" (UniqueName: \"kubernetes.io/projected/31dcd600-0e7e-4728-bd69-3a893ef77db5-kube-api-access-fgppm\") pod \"multus-additional-cni-plugins-c5nfw\" (UID: \"31dcd600-0e7e-4728-bd69-3a893ef77db5\") " pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.224887 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.224666    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhfnl\" (UniqueName: \"kubernetes.io/projected/79e7ba94-68fe-4f5d-abab-eb7603102238-kube-api-access-dhfnl\") pod \"tuned-phvtf\" (UID: \"79e7ba94-68fe-4f5d-abab-eb7603102238\") " pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.226853 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.225856    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/4e843a4f-6502-4288-96e1-3b69e00bab7a-kube-api-access-dtgw7\") pod \"node-resolver-5mm2w\" (UID: \"4e843a4f-6502-4288-96e1-3b69e00bab7a\") " pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.226853 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.226341    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjsb5\" (UniqueName: \"kubernetes.io/projected/ded6b5c4-5bcf-4e99-97ed-575ed20a300e-kube-api-access-xjsb5\") pod \"ovnkube-node-st6pb\" (UID: \"ded6b5c4-5bcf-4e99-97ed-575ed20a300e\") " pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.226983 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.226922    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznph\" (UniqueName: \"kubernetes.io/projected/aec0bc69-308d-40bd-9f6b-7644f7494ded-kube-api-access-jznph\") pod \"node-ca-nn8s8\" (UID: \"aec0bc69-308d-40bd-9f6b-7644f7494ded\") " pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.228924 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.228903    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjh4x\" (UniqueName: \"kubernetes.io/projected/594b715e-ce54-4f93-832a-32827b632a0a-kube-api-access-mjh4x\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.307268 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-system-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307268 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-multus\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-hostroot\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307330    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-socket-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307357    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-cni-binary-copy\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307357    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-system-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307363    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-multus\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307492 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307432    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-hostroot\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-k8s-cni-cncf-io\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307520    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-socket-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-k8s-cni-cncf-io\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-conf-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-sys-fs\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307661    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-etc-kubernetes\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xvb9\" (UniqueName: \"kubernetes.io/projected/0605e0cc-440b-4883-9ef8-8e4606b1d424-kube-api-access-8xvb9\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307728 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da9ecead-dcb6-4979-91d4-95fe093fe251-iptables-alerter-script\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-conf-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307729    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-sys-fs\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307762    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-etc-kubernetes\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307783    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmsbj\" (UniqueName: \"kubernetes.io/projected/da9ecead-dcb6-4979-91d4-95fe093fe251-kube-api-access-kmsbj\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307827    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-bin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-multus-certs\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-device-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-netns\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da9ecead-dcb6-4979-91d4-95fe093fe251-host-slash\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307924    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-multus-certs\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-registration-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-cni-bin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307994    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-registration-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.307995 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308000    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-run-netns\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.307888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-cni-binary-copy\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-socket-dir-parent\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308039    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-device-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-kubelet\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308080    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-socket-dir-parent\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-cni-dir\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-daemon-config\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308122    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-host-var-lib-kubelet\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da9ecead-dcb6-4979-91d4-95fe093fe251-host-slash\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dp9\" (UniqueName: \"kubernetes.io/projected/9d6f23e2-6af9-454f-a204-543f7d07e662-kube-api-access-52dp9\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-cnibin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308259    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da9ecead-dcb6-4979-91d4-95fe093fe251-iptables-alerter-script\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308273    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6f23e2-6af9-454f-a204-543f7d07e662-cnibin\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308319    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0605e0cc-440b-4883-9ef8-8e4606b1d424-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.308645 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.308503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6f23e2-6af9-454f-a204-543f7d07e662-multus-daemon-config\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.319710 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.319646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xvb9\" (UniqueName: \"kubernetes.io/projected/0605e0cc-440b-4883-9ef8-8e4606b1d424-kube-api-access-8xvb9\") pod \"aws-ebs-csi-driver-node-tk6d4\" (UID: \"0605e0cc-440b-4883-9ef8-8e4606b1d424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.319812 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.319796    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmsbj\" (UniqueName: \"kubernetes.io/projected/da9ecead-dcb6-4979-91d4-95fe093fe251-kube-api-access-kmsbj\") pod \"iptables-alerter-sjbkj\" (UID: \"da9ecead-dcb6-4979-91d4-95fe093fe251\") " pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.319861 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.319842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dp9\" (UniqueName: \"kubernetes.io/projected/9d6f23e2-6af9-454f-a204-543f7d07e662-kube-api-access-52dp9\") pod \"multus-cq2pm\" (UID: \"9d6f23e2-6af9-454f-a204-543f7d07e662\") " pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.389697 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.389664    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:12.396077 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.396054    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mm2w"
Sep 14 12:58:12.403538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.403513    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn8s8"
Sep 14 12:58:12.413136 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.413117    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5nfw"
Sep 14 12:58:12.418809 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.418789    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:12.427476 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.427455    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:12.435219 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.435202    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phvtf"
Sep 14 12:58:12.441721 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.441700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq2pm"
Sep 14 12:58:12.450332 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.450315    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4"
Sep 14 12:58:12.455905 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.455884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sjbkj"
Sep 14 12:58:12.711415 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.711324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:12.711415 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.711389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:12.711619 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.711480    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:12.711619 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.711541    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:13.7115265 +0000 UTC m=+4.026309834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:12.711619 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.711481    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:12.711763 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.711630    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:13.71161594 +0000 UTC m=+4.026399273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:12.812224 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:12.812189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:12.812406 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.812334    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:12.812406 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.812351    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:12.812406 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.812362    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:12.812569 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:12.812415    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:13.812397836 +0000 UTC m=+4.127181179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:13.145772 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:13.145738    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 12:53:12 +0000 UTC" deadline="2028-06-06 16:28:20.337153926 +0000 UTC"
Sep 14 12:58:13.145772 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:13.145772    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15147h30m7.191386468s"
Sep 14 12:58:13.195452 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:13.195346    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0605e0cc_440b_4883_9ef8_8e4606b1d424.slice/crio-faf523d256ff77e7f3f9d2b9c9c9e215bcc1601e3dc6bf4b3b991a8d33382cc2 WatchSource:0}: Error finding container faf523d256ff77e7f3f9d2b9c9c9e215bcc1601e3dc6bf4b3b991a8d33382cc2: Status 404 returned error can't find the container with id faf523d256ff77e7f3f9d2b9c9c9e215bcc1601e3dc6bf4b3b991a8d33382cc2
Sep 14 12:58:13.197319 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:13.197300    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec0bc69_308d_40bd_9f6b_7644f7494ded.slice/crio-4a858c50df31ec81fdfcadd3cdd21427123a123a1a8de1b522919b5f2af40b7a WatchSource:0}: Error finding container 4a858c50df31ec81fdfcadd3cdd21427123a123a1a8de1b522919b5f2af40b7a: Status 404 returned error can't find the container with id 4a858c50df31ec81fdfcadd3cdd21427123a123a1a8de1b522919b5f2af40b7a
Sep 14 12:58:13.200365 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:13.200348    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e7ba94_68fe_4f5d_abab_eb7603102238.slice/crio-337ac492be58d04bf519ee0f2074eaa0004afb4c401f0ca04fad7c311a7a12e4 WatchSource:0}: Error finding container 337ac492be58d04bf519ee0f2074eaa0004afb4c401f0ca04fad7c311a7a12e4: Status 404 returned error can't find the container with id 337ac492be58d04bf519ee0f2074eaa0004afb4c401f0ca04fad7c311a7a12e4
Sep 14 12:58:13.201072 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:13.201027    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550b8152_985e_4e0c_b8e1_3fdb4c8dd016.slice/crio-9984eec44fdfdba4862c11be1b6fc6603c93fbe1d1ffd1686c43ed1e31372c9e WatchSource:0}: Error finding container 9984eec44fdfdba4862c11be1b6fc6603c93fbe1d1ffd1686c43ed1e31372c9e: Status 404 returned error can't find the container with id 9984eec44fdfdba4862c11be1b6fc6603c93fbe1d1ffd1686c43ed1e31372c9e
Sep 14 12:58:13.206272 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:13.206241    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6f23e2_6af9_454f_a204_543f7d07e662.slice/crio-1d8bb96abb02886534cbad01f197c0b7c74e8c34152cf1b6db31588c08329d76 WatchSource:0}: Error finding container 1d8bb96abb02886534cbad01f197c0b7c74e8c34152cf1b6db31588c08329d76: Status 404 returned error can't find the container with id 1d8bb96abb02886534cbad01f197c0b7c74e8c34152cf1b6db31588c08329d76
Sep 14 12:58:13.718788 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:13.718704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:13.718788 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:13.718782    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:13.719001 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.718899    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:13.719001 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.718961    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:15.718942127 +0000 UTC m=+6.033725463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:13.719428 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.719345    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:13.719428 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.719398    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:15.719381877 +0000 UTC m=+6.034165213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:13.823154 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:13.822377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:13.823154 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.822689    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:13.823154 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.822713    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:13.823154 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.822725    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:13.823154 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:13.822781    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:15.822764125 +0000 UTC m=+6.137547478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:14.146782 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.146671    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 12:53:12 +0000 UTC" deadline="2028-06-22 04:03:30.784023342 +0000 UTC"
Sep 14 12:58:14.146782 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.146729    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15519h5m16.637297886s"
Sep 14 12:58:14.191347 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.191316    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:14.191505 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:14.191445    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:14.191880 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.191860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:14.191990 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:14.191967    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:14.192060 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.192037    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:14.192132 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:14.192114    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:14.210510 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.210085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" event={"ID":"979aa361aaf6f040c740f0c683314ad1","Type":"ContainerStarted","Data":"43aa447f9cd36b7667b6bb6e3afef058b3530beb4b9de078449028ec3ce63208"}
Sep 14 12:58:14.214464 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.214405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z9mwf" event={"ID":"550b8152-985e-4e0c-b8e1-3fdb4c8dd016","Type":"ContainerStarted","Data":"9984eec44fdfdba4862c11be1b6fc6603c93fbe1d1ffd1686c43ed1e31372c9e"}
Sep 14 12:58:14.224809 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.224498    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mm2w" event={"ID":"4e843a4f-6502-4288-96e1-3b69e00bab7a","Type":"ContainerStarted","Data":"ec0fdef650e4931621a35ae9c92ead1cae519185d951f1a5b558cc29d391c3ee"}
Sep 14 12:58:14.233556 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.233530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq2pm" event={"ID":"9d6f23e2-6af9-454f-a204-543f7d07e662","Type":"ContainerStarted","Data":"1d8bb96abb02886534cbad01f197c0b7c74e8c34152cf1b6db31588c08329d76"}
Sep 14 12:58:14.236439 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.236391    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" podStartSLOduration=3.236374315 podStartE2EDuration="3.236374315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:14.234773554 +0000 UTC m=+4.549556920" watchObservedRunningTime="2026-09-14 12:58:14.236374315 +0000 UTC m=+4.551157669"
Sep 14 12:58:14.240218 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.240191    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"4bbfae9e8816c326227937034e960b6c788cf56e5360578bae7bcadd1c43544c"}
Sep 14 12:58:14.248127 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.248104    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerStarted","Data":"a2e0bd96e8899a465c39082d564b8bce25074e34a65269467c70bd84b2fda830"}
Sep 14 12:58:14.261260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.261234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phvtf" event={"ID":"79e7ba94-68fe-4f5d-abab-eb7603102238","Type":"ContainerStarted","Data":"337ac492be58d04bf519ee0f2074eaa0004afb4c401f0ca04fad7c311a7a12e4"}
Sep 14 12:58:14.275815 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.275786    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn8s8" event={"ID":"aec0bc69-308d-40bd-9f6b-7644f7494ded","Type":"ContainerStarted","Data":"4a858c50df31ec81fdfcadd3cdd21427123a123a1a8de1b522919b5f2af40b7a"}
Sep 14 12:58:14.288526 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.288494    2566 generic.go:356] "Generic (PLEG): container finished" podID="a4a76eac18462ec9f2ef75141492b30e" containerID="63681aa1dc4789c5fefe897aa5ad6f20060eaec702e6bbbc0d742d123b8f0d72" exitCode=0
Sep 14 12:58:14.288647 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.288578    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"a4a76eac18462ec9f2ef75141492b30e","Type":"ContainerDied","Data":"63681aa1dc4789c5fefe897aa5ad6f20060eaec702e6bbbc0d742d123b8f0d72"}
Sep 14 12:58:14.294497 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.294437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sjbkj" event={"ID":"da9ecead-dcb6-4979-91d4-95fe093fe251","Type":"ContainerStarted","Data":"22e3e229475858fe8e72cd8ceda85f8a8c97101660d1174d4f46110fd9b8500b"}
Sep 14 12:58:14.303495 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:14.303470    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4" event={"ID":"0605e0cc-440b-4883-9ef8-8e4606b1d424","Type":"ContainerStarted","Data":"faf523d256ff77e7f3f9d2b9c9c9e215bcc1601e3dc6bf4b3b991a8d33382cc2"}
Sep 14 12:58:15.317127 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:15.316766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"a4a76eac18462ec9f2ef75141492b30e","Type":"ContainerStarted","Data":"b1fb02536ce6e31f9bc03a9b0fbfad4fd459780a0586c90c6315f45d4339a955"}
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:15.739920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:15.739991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.740141    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.740202    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:19.740183613 +0000 UTC m=+10.054966959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.740583    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:15.740707 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.740630    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:19.740616138 +0000 UTC m=+10.055399485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:15.840972 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:15.840926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:15.841170 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.841153    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:15.841236 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.841174    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:15.841236 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.841187    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:15.841332 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:15.841242    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:19.841224287 +0000 UTC m=+10.156007631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:16.184256 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:16.184165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:16.184411 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:16.184341    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:16.184939 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:16.184921    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:16.185039 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:16.185020    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:16.187269 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:16.187248    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:16.187378 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:16.187343    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:18.184035 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:18.183992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:18.184516 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:18.183992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:18.184516 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:18.183997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:18.184516 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:18.184151    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:18.184516 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:18.184255    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:18.184516 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:18.184371    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:19.776976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:19.777088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.777194    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.777262    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:27.777241991 +0000 UTC m=+18.092025346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.777194    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:19.777638 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.777330    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:27.777318492 +0000 UTC m=+18.092101828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:19.878167 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:19.877822    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:19.878167 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.878024    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:19.878167 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.878061    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:19.878167 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.878074    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:19.878167 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:19.878134    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:27.878116241 +0000 UTC m=+18.192899592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:20.185062 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:20.184972    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:20.185191 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:20.185110    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:20.185305 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:20.185283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:20.185407 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:20.185381    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:20.185475 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:20.185417    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:20.185585 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:20.185546    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:22.184494 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:22.184462    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:22.184494 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:22.184490    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:22.185023 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:22.184462    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:22.185023 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:22.184594    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:22.185023 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:22.184678    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:22.185023 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:22.184775    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:24.183813 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:24.183771    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:24.184260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:24.183777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:24.184260 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:24.183893    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:24.184260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:24.183919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:24.184260 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:24.184058    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:24.184260 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:24.184145    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:26.184024 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:26.183990    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:26.184024 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:26.184020    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:26.184527 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:26.184032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:26.184527 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:26.184129    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:26.184527 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:26.184255    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:26.184527 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:26.184359    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:27.835873 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:27.835819    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:27.836377 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:27.835898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:27.836377 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.835977    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:27.836377 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.836014    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:27.836377 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.836071    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:43.836035882 +0000 UTC m=+34.150819236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:27.836377 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.836088    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:58:43.836080037 +0000 UTC m=+34.150863366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:27.936629 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:27.936592    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:27.936807 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.936786    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:27.936857 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.936815    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:27.936857 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.936829    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:27.936960 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:27.936892    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:58:43.936874878 +0000 UTC m=+34.251658224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:28.187392 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:28.187303    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:28.187528 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:28.187481    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:28.187528 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:28.187491    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:28.187528 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:28.187510    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:28.187692 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:28.187590    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:28.187740 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:28.187693    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:30.184731 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:30.184701    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:30.185161 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:30.184809    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:30.185161 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:30.184813    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:30.185161 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:30.184912    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:30.185161 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:30.184941    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:30.185161 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:30.185006    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:31.351221 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.350981    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phvtf" event={"ID":"79e7ba94-68fe-4f5d-abab-eb7603102238","Type":"ContainerStarted","Data":"228fe6825cf646c96a5e3c10f75347f0a56f0c8b256940934a15d93232ab38b6"}
Sep 14 12:58:31.352578 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.352555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn8s8" event={"ID":"aec0bc69-308d-40bd-9f6b-7644f7494ded","Type":"ContainerStarted","Data":"746bb49b2e3dbc61efd53d8e2a819957db9c50d2e9b592d9088bc9f89f7fe366"}
Sep 14 12:58:31.354182 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.354161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4" event={"ID":"0605e0cc-440b-4883-9ef8-8e4606b1d424","Type":"ContainerStarted","Data":"ed34351bf760015c2a4996cffd7d3e6de509df92ff5f53d589b38d07e3140ffa"}
Sep 14 12:58:31.355581 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.355558    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z9mwf" event={"ID":"550b8152-985e-4e0c-b8e1-3fdb4c8dd016","Type":"ContainerStarted","Data":"0a0f84083fc9755c647a9ee9ae991d58080eeb99874f02648af94ae64b0a78a5"}
Sep 14 12:58:31.357076 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.357027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mm2w" event={"ID":"4e843a4f-6502-4288-96e1-3b69e00bab7a","Type":"ContainerStarted","Data":"3d1bec7f04a34cbf20df7cef0a7f742a39b1a5bfa455b8a9231ec40cd567b362"}
Sep 14 12:58:31.358498 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.358477    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq2pm" event={"ID":"9d6f23e2-6af9-454f-a204-543f7d07e662","Type":"ContainerStarted","Data":"568877fab247082a28bb5b7d4b10e7b15a6a6b61df238096c22c634fabd5af8d"}
Sep 14 12:58:31.360751 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.360732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"7c86d8a555687d6d40b2696e85daff0aeabc78b0473b5bf0b5211b47110e9458"}
Sep 14 12:58:31.360819 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.360794    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"b582427dc75df87b56022307a0d21c6e92a576a7e4ed691c0e2ca4a84604b2e5"}
Sep 14 12:58:31.360873 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.360827    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"3c8c3f0c47f72c4c1ec66bada79660e42221963c4ea755e6594ae5a70d40f8ad"}
Sep 14 12:58:31.360913 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.360874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"b368508fd1d79f25c16d5d14b5c77125cca9ac4dc5dd2aa0e6868cc0a6326c15"}
Sep 14 12:58:31.362112 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.362091    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="173877a7f484836fbf70675684ba24688fc781d0b88d2936f55837a22dfd28a0" exitCode=0
Sep 14 12:58:31.362181 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.362120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"173877a7f484836fbf70675684ba24688fc781d0b88d2936f55837a22dfd28a0"}
Sep 14 12:58:31.418588 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.418540    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-phvtf" podStartSLOduration=3.742106048 podStartE2EDuration="21.418529485s" totalImagesPullingTime="17.676423437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:31.416240388 +0000 UTC m=+21.731023744" watchObservedRunningTime="2026-09-14 12:58:31.418529485 +0000 UTC m=+21.733312836"
Sep 14 12:58:31.418697 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.418680    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" podStartSLOduration=20.418674916 podStartE2EDuration="20.418674916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:15.348287928 +0000 UTC m=+5.663071282" watchObservedRunningTime="2026-09-14 12:58:31.418674916 +0000 UTC m=+21.733458268"
Sep 14 12:58:31.457017 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.456843    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mm2w" podStartSLOduration=3.791184542 podStartE2EDuration="21.456830891s" totalImagesPullingTime="17.665646349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:31.453913069 +0000 UTC m=+21.768696421" watchObservedRunningTime="2026-09-14 12:58:31.456830891 +0000 UTC m=+21.771614242"
Sep 14 12:58:31.491573 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.491539    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nn8s8" podStartSLOduration=3.823313074 podStartE2EDuration="21.491526396s" totalImagesPullingTime="17.668213322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:31.491275356 +0000 UTC m=+21.806058711" watchObservedRunningTime="2026-09-14 12:58:31.491526396 +0000 UTC m=+21.806309738"
Sep 14 12:58:31.559018 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.558975    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cq2pm" podStartSLOduration=3.842150597 podStartE2EDuration="21.558962034s" totalImagesPullingTime="17.716811437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:31.558933633 +0000 UTC m=+21.873716998" watchObservedRunningTime="2026-09-14 12:58:31.558962034 +0000 UTC m=+21.873745383"
Sep 14 12:58:31.575165 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:31.575129    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z9mwf" podStartSLOduration=11.229788731 podStartE2EDuration="21.575115911s" totalImagesPullingTime="10.34532718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:31.574839242 +0000 UTC m=+21.889622594" watchObservedRunningTime="2026-09-14 12:58:31.575115911 +0000 UTC m=+21.889899280"
Sep 14 12:58:32.187551 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.187507    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:32.187678 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.187615    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:32.187678 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:32.187627    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:32.187678 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.187644    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:32.187836 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:32.187739    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:32.187836 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:32.187808    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:32.369660 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.369625    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"a7796ef17a30c5fc3dff2c85b023af80839ebc5f5d5f840c2b6e4be3f1e4bb26"}
Sep 14 12:58:32.370036 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.369721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"beecb2bd000d081aec82bb36355d6703bb8fca62dd44cb3d6abd437eaa2de8be"}
Sep 14 12:58:32.371572 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.371547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sjbkj" event={"ID":"da9ecead-dcb6-4979-91d4-95fe093fe251","Type":"ContainerStarted","Data":"442d90f112fdb95fc270744685c3ff638ff94dbb729394f0eeecb5108bb9e182"}
Sep 14 12:58:32.486683 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.486604    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 12:58:32.740903 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.740875    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:32.741572 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.741552    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:32.759007 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:32.758956    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sjbkj" podStartSLOduration=5.09881818 podStartE2EDuration="22.758940291s" totalImagesPullingTime="17.660122111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:32.388966346 +0000 UTC m=+22.703749698" watchObservedRunningTime="2026-09-14 12:58:32.758940291 +0000 UTC m=+23.073723643"
Sep 14 12:58:33.152957 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.152805    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T12:58:32.486627409Z","UUID":"2f30ec0b-6378-49c0-9aa1-4b90891fcb80","Handler":null,"Name":"","Endpoint":""}
Sep 14 12:58:33.154482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.154460    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 12:58:33.154594 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.154496    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 12:58:33.377000 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.376959    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4" event={"ID":"0605e0cc-440b-4883-9ef8-8e4606b1d424","Type":"ContainerStarted","Data":"6890dbaaf57bb769410c2878c011baf8819fd433c8bebf4b12a6abd56bf1d40f"}
Sep 14 12:58:33.377730 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.377336    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:33.377846 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:33.377819    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z9mwf"
Sep 14 12:58:34.189779 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.189751    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:34.189974 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.189860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:34.189974 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.189891    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:34.189974 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:34.189880    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:34.190212 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:34.190006    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:34.190212 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:34.190096    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:34.383251 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.383212    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"0a6305c42170f98045cd3945df7aa33bb4f7ffd4ca8797ce49125e482055628c"}
Sep 14 12:58:34.385582 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.385553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4" event={"ID":"0605e0cc-440b-4883-9ef8-8e4606b1d424","Type":"ContainerStarted","Data":"dd0a13aafc88a53b00083dbc1e58fbe99a06c16137429e38ba8757ba617f57ab"}
Sep 14 12:58:34.406613 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:34.406564    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk6d4" podStartSLOduration=4.537978301 podStartE2EDuration="24.406537684s" totalImagesPullingTime="19.868559383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:34.406452341 +0000 UTC m=+24.721235694" watchObservedRunningTime="2026-09-14 12:58:34.406537684 +0000 UTC m=+24.721321038"
Sep 14 12:58:36.184231 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.184039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:36.185096 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.184039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:36.185096 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:36.184330    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:36.185096 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.184039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:36.185096 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:36.184373    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:36.185096 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:36.184455    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:36.392983 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.392951    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" event={"ID":"ded6b5c4-5bcf-4e99-97ed-575ed20a300e","Type":"ContainerStarted","Data":"f22f46f0ec62d3b54e99d7d39e7beea56bbb33c59e96ae320514824cb6ab2310"}
Sep 14 12:58:36.393287 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.393263    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:36.393527 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.393331    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:36.394858 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.394835    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="23b12612e57efd4b0c130679fec3cc0fff72442ca837e84c9429d38c394da79f" exitCode=0
Sep 14 12:58:36.394957 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.394874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"23b12612e57efd4b0c130679fec3cc0fff72442ca837e84c9429d38c394da79f"}
Sep 14 12:58:36.408416 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.408398    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:36.603244 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:36.603195    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb" podStartSLOduration=8.898855119 podStartE2EDuration="26.60318178s" totalImagesPullingTime="17.704326661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:36.545579537 +0000 UTC m=+26.860362888" watchObservedRunningTime="2026-09-14 12:58:36.60318178 +0000 UTC m=+26.917965132"
Sep 14 12:58:37.397827 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:37.397793    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:37.414982 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:37.414946    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:58:38.184198 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.184009    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:38.184314 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.184015    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:38.184314 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.184295    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:38.184423 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.184085    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:38.184423 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.184346    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:38.184515 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.184457    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:38.243166 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.243145    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8qs7"]
Sep 14 12:58:38.246223 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.246204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hn27"]
Sep 14 12:58:38.269942 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.269916    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fgdpr"]
Sep 14 12:58:38.401580 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.401512    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="844e36b68a2593f8eb1636ea402a52cf68da17ab261a9690a0f9013b30378acf" exitCode=0
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.401603    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.401624    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"844e36b68a2593f8eb1636ea402a52cf68da17ab261a9690a0f9013b30378acf"}
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.401668    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:38.401809    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.401820    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:38.401970 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.401899    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:38.402257 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:38.401996    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:40.186840 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:40.186768    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:40.187265 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:40.186866    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:40.187265 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:40.186878    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:40.187265 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:40.186897    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:40.187265 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:40.186980    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:40.187265 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:40.187063    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:40.408780 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:40.408753    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="ea7f047b35d3f22f9d7d6e610362dffe6c8c415823a5696d1e665864f295218b" exitCode=0
Sep 14 12:58:40.408883 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:40.408805    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"ea7f047b35d3f22f9d7d6e610362dffe6c8c415823a5696d1e665864f295218b"}
Sep 14 12:58:42.187105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:42.187016    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:42.187519 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:42.187019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:42.187519 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:42.187182    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:42.187519 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:42.187031    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:42.187519 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:42.187243    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:42.187519 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:42.187307    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:43.851984 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:43.851804    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:43.852357 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:43.852014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:43.852357 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.851953    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:43.852357 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.852119    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret podName:344fac89-2ec6-49c3-b18b-49a097126d98 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.852098263 +0000 UTC m=+66.166881607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret") pod "global-pull-secret-syncer-fgdpr" (UID: "344fac89-2ec6-49c3-b18b-49a097126d98") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:43.852357 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.852149    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:43.852357 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.852196    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.852180341 +0000 UTC m=+66.166963688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:43.953084 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:43.953036    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:43.953246 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.953202    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:43.953246 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.953226    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:43.953246 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.953240    2566 projected.go:196] Error preparing data for projected volume kube-api-access-vgdzb for pod openshift-network-diagnostics/network-check-target-z8qs7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:43.953389 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:43.953294    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb podName:59a7b435-1d4f-4561-a8fb-980481c112ca nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.953276932 +0000 UTC m=+66.268060279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgdzb" (UniqueName: "kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb") pod "network-check-target-z8qs7" (UID: "59a7b435-1d4f-4561-a8fb-980481c112ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:44.186804 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.186736    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:44.186950 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.186846    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:44.186950 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:44.186850    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hn27" podUID="594b715e-ce54-4f93-832a-32827b632a0a"
Sep 14 12:58:44.186950 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.186878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:44.187104 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:44.186972    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8qs7" podUID="59a7b435-1d4f-4561-a8fb-980481c112ca"
Sep 14 12:58:44.187104 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:44.187066    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgdpr" podUID="344fac89-2ec6-49c3-b18b-49a097126d98"
Sep 14 12:58:44.421298 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.421270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerStarted","Data":"d1fde53113e1d2bc93a7e177d066d8b36befcaa68d313e38358124b8b6f7024a"}
Sep 14 12:58:44.519946 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.519925    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeReady"
Sep 14 12:58:44.520078 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.520068    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 12:58:44.574726 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.574703    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-952cx"]
Sep 14 12:58:44.577386 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.577372    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.580186 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.580163    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 12:58:44.580269 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.580197    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4h7f4\""
Sep 14 12:58:44.580464 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.580447    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 12:58:44.589538 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.587408    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6lk29"]
Sep 14 12:58:44.590746 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.590711    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.591547 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.591525    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-952cx"]
Sep 14 12:58:44.593870 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.593847    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 12:58:44.593996 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.593981    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 12:58:44.594093 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.593992    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 12:58:44.594642 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.594625    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fp9b8\""
Sep 14 12:58:44.605904 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.605884    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lk29"]
Sep 14 12:58:44.657823 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657801    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.657934 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjhb\" (UniqueName: \"kubernetes.io/projected/a224ad8e-2683-439a-8c5f-2ec635336022-kube-api-access-lcjhb\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.657934 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45cjl\" (UniqueName: \"kubernetes.io/projected/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-kube-api-access-45cjl\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.657934 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657931    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a224ad8e-2683-439a-8c5f-2ec635336022-config-volume\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.658113 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657953    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-cert\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.658113 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.657990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a224ad8e-2683-439a-8c5f-2ec635336022-tmp-dir\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759194 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759194 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjhb\" (UniqueName: \"kubernetes.io/projected/a224ad8e-2683-439a-8c5f-2ec635336022-kube-api-access-lcjhb\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759194 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45cjl\" (UniqueName: \"kubernetes.io/projected/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-kube-api-access-45cjl\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.759375 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759226    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a224ad8e-2683-439a-8c5f-2ec635336022-config-volume\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759375 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:44.759280    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:44.759375 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:44.759328    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:45.259313811 +0000 UTC m=+35.574097141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:44.759509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-cert\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.759509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a224ad8e-2683-439a-8c5f-2ec635336022-tmp-dir\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759748 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759732    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a224ad8e-2683-439a-8c5f-2ec635336022-tmp-dir\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.759787 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.759731    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a224ad8e-2683-439a-8c5f-2ec635336022-config-volume\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.763376 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.763350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-cert\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.776112 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.776094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjhb\" (UniqueName: \"kubernetes.io/projected/a224ad8e-2683-439a-8c5f-2ec635336022-kube-api-access-lcjhb\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:44.777880 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.777862    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45cjl\" (UniqueName: \"kubernetes.io/projected/3ef54ff3-e3ad-4732-9a69-a52d4f5d148e-kube-api-access-45cjl\") pod \"ingress-canary-6lk29\" (UID: \"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e\") " pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:44.899240 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:44.899215    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lk29"
Sep 14 12:58:45.178283 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:45.178220    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lk29"]
Sep 14 12:58:45.181178 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:45.181155    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef54ff3_e3ad_4732_9a69_a52d4f5d148e.slice/crio-ac2acbf084b853f45c4e0a101956667e6e3253eb36a19997d3f7f69475ea0593 WatchSource:0}: Error finding container ac2acbf084b853f45c4e0a101956667e6e3253eb36a19997d3f7f69475ea0593: Status 404 returned error can't find the container with id ac2acbf084b853f45c4e0a101956667e6e3253eb36a19997d3f7f69475ea0593
Sep 14 12:58:45.262463 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:45.262443    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:45.262577 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:45.262564    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:45.262621 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:45.262610    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:46.262597598 +0000 UTC m=+36.577380928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:45.426432 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:45.426401    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="d1fde53113e1d2bc93a7e177d066d8b36befcaa68d313e38358124b8b6f7024a" exitCode=0
Sep 14 12:58:45.426546 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:45.426470    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"d1fde53113e1d2bc93a7e177d066d8b36befcaa68d313e38358124b8b6f7024a"}
Sep 14 12:58:45.427701 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:45.427680    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lk29" event={"ID":"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e","Type":"ContainerStarted","Data":"ac2acbf084b853f45c4e0a101956667e6e3253eb36a19997d3f7f69475ea0593"}
Sep 14 12:58:46.184294 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.184071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:58:46.185018 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.184071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:58:46.185018 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.184120    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:58:46.188172 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.188148    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-578px\""
Sep 14 12:58:46.189591 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.189311    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 12:58:46.189591 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.189382    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 12:58:46.189591 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.189436    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 12:58:46.190105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.190087    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5b9s\""
Sep 14 12:58:46.192291 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.192272    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 12:58:46.269380 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.269352    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:46.269541 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:46.269497    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:46.269612 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:46.269559    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:48.269539857 +0000 UTC m=+38.584323202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:46.433777 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.433743    2566 generic.go:356] "Generic (PLEG): container finished" podID="31dcd600-0e7e-4728-bd69-3a893ef77db5" containerID="2e2d717ee0e899d85b56a72460861b0a827faafa21b8de098a1075aa1abe57a1" exitCode=0
Sep 14 12:58:46.433958 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:46.433807    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerDied","Data":"2e2d717ee0e899d85b56a72460861b0a827faafa21b8de098a1075aa1abe57a1"}
Sep 14 12:58:47.439274 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:47.439242    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" event={"ID":"31dcd600-0e7e-4728-bd69-3a893ef77db5","Type":"ContainerStarted","Data":"7c2bbcd0817d667635a8486968a7b5f117c4ca9cd1609ebfc88877d0c333cb88"}
Sep 14 12:58:47.484518 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:47.484470    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c5nfw" podStartSLOduration=9.168211596999999 podStartE2EDuration="37.484451688s" totalImagesPullingTime="28.316240091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:47.482840121 +0000 UTC m=+37.797623473" watchObservedRunningTime="2026-09-14 12:58:47.484451688 +0000 UTC m=+37.799235044"
Sep 14 12:58:48.283840 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:48.283802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:48.283987 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:48.283914    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:48.283987 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:48.283962    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:52.283949694 +0000 UTC m=+42.598733024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:48.443227 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:48.443196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lk29" event={"ID":"3ef54ff3-e3ad-4732-9a69-a52d4f5d148e","Type":"ContainerStarted","Data":"78cba2244fa0eb6e4c938a2bb2cf3e1ec7c5e8402d5ebb1c064d7592f8dd0ce1"}
Sep 14 12:58:52.308094 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:52.308060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:58:52.308447 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:52.308206    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:52.308447 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:52.308271    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.308256375 +0000 UTC m=+50.623039705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:59.184310 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.184209    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6lk29" podStartSLOduration=12.882796927 podStartE2EDuration="15.184191899s" totalImagesPullingTime="2.301394972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:48.465865259 +0000 UTC m=+38.780648611" watchObservedRunningTime="2026-09-14 12:58:59.184191899 +0000 UTC m=+49.498975251"
Sep 14 12:58:59.184698 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.184634    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"]
Sep 14 12:58:59.223417 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.223389    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"]
Sep 14 12:58:59.223557 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.223504    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"
Sep 14 12:58:59.226911 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.226885    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.228158 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.228132    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.228260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.228172    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vvk4s\""
Sep 14 12:58:59.236932 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.236913    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"]
Sep 14 12:58:59.237013 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.236947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"]
Sep 14 12:58:59.237069 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.237018    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.240311 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.240290    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 14 12:58:59.240311 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.240309    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zq9x6\""
Sep 14 12:58:59.240606 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.240589    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.241105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.241090    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 14 12:58:59.241105 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.241100    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.305187 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.305155    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"]
Sep 14 12:58:59.326253 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.326217    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"]
Sep 14 12:58:59.326385 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.326350    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.329054 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.329021    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 14 12:58:59.329165 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.329021    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q7dg5\""
Sep 14 12:58:59.329493 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.329477    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.329776 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.329758    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.330021 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.330008    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 14 12:58:59.352530 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.352501    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"]
Sep 14 12:58:59.352530 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.352531    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"]
Sep 14 12:58:59.352721 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.352632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.357164 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.357113    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 14 12:58:59.357288 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.357190    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 14 12:58:59.357288 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.357230    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.357481 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.357308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nl9f8\""
Sep 14 12:58:59.357481 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.357118    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.360213 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.360183    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.360311 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.360250    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.360374 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.360310    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrf7\" (UniqueName: \"kubernetes.io/projected/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-kube-api-access-lqrf7\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.360458 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.360379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjv6w\" (UniqueName: \"kubernetes.io/projected/318e5a38-b52f-4d57-97c9-b791e298e8c0-kube-api-access-pjv6w\") pod \"volume-data-source-validator-86695b7cc7-gtjwz\" (UID: \"318e5a38-b52f-4d57-97c9-b791e298e8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"
Sep 14 12:58:59.418584 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.418553    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9x266"]
Sep 14 12:58:59.432207 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.432186    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.435791 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.435738    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 14 12:58:59.436497 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.436473    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 14 12:58:59.436613 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.436501    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.436774 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.436756    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.437952 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.437907    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qk99d\""
Sep 14 12:58:59.449844 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.449818    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:58:59.452868 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.452843    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 14 12:58:59.461416 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461394    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrf7\" (UniqueName: \"kubernetes.io/projected/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-kube-api-access-lqrf7\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.461519 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjv6w\" (UniqueName: \"kubernetes.io/projected/318e5a38-b52f-4d57-97c9-b791e298e8c0-kube-api-access-pjv6w\") pod \"volume-data-source-validator-86695b7cc7-gtjwz\" (UID: \"318e5a38-b52f-4d57-97c9-b791e298e8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"
Sep 14 12:58:59.461519 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461465    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.461519 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.461669 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd7t\" (UniqueName: \"kubernetes.io/projected/56243070-e9e5-4c06-878a-2b66fea26332-kube-api-access-pzd7t\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.461669 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56243070-e9e5-4c06-878a-2b66fea26332-config\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.461669 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56243070-e9e5-4c06-878a-2b66fea26332-serving-cert\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.461780 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461689    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27z2\" (UniqueName: \"kubernetes.io/projected/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-kube-api-access-z27z2\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.461780 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.461780 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.461742    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.462272 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.462251    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.465152 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.465133    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.466773 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.466755    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.470987 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.470972    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29dxj\""
Sep 14 12:58:59.471279 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.471261    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 14 12:58:59.471352 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.471268    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 14 12:58:59.471497 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.471481    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 14 12:58:59.476039 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.476018    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 14 12:58:59.480235 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.480215    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:58:59.482685 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.482659    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrf7\" (UniqueName: \"kubernetes.io/projected/44f52b1b-d570-4eea-9fcd-3f9a90a5cca0-kube-api-access-lqrf7\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7wx2m\" (UID: \"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.488944 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.488922    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjv6w\" (UniqueName: \"kubernetes.io/projected/318e5a38-b52f-4d57-97c9-b791e298e8c0-kube-api-access-pjv6w\") pod \"volume-data-source-validator-86695b7cc7-gtjwz\" (UID: \"318e5a38-b52f-4d57-97c9-b791e298e8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"
Sep 14 12:58:59.499379 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.499353    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9x266"]
Sep 14 12:58:59.508129 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.508110    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"]
Sep 14 12:58:59.517055 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.517028    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.520364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.520344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 14 12:58:59.520462 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.520348    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2shgc\""
Sep 14 12:58:59.520462 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.520348    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 14 12:58:59.525268 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.525249    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"]
Sep 14 12:58:59.533442 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.533422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"
Sep 14 12:58:59.544903 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.544878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"
Sep 14 12:58:59.562949 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.562926    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlc9\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563067 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.562958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd7t\" (UniqueName: \"kubernetes.io/projected/56243070-e9e5-4c06-878a-2b66fea26332-kube-api-access-pzd7t\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.563067 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.562986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563067 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56243070-e9e5-4c06-878a-2b66fea26332-config\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.563191 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-config\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.563191 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563191 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563191 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563332 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56243070-e9e5-4c06-878a-2b66fea26332-serving-cert\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.563332 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563332 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27z2\" (UniqueName: \"kubernetes.io/projected/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-kube-api-access-z27z2\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.563332 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-trusted-ca\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.563489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563332    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.563489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqpz\" (UniqueName: \"kubernetes.io/projected/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-kube-api-access-qfqpz\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.563489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.563489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.563687 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-serving-cert\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.563687 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.563650    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:58:59.563759 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.563711    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.063693155 +0000 UTC m=+50.378476485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:58:59.563846 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.563783    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56243070-e9e5-4c06-878a-2b66fea26332-config\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.564213 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.564197    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.566083 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.566063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56243070-e9e5-4c06-878a-2b66fea26332-serving-cert\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.573349 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.573325    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd7t\" (UniqueName: \"kubernetes.io/projected/56243070-e9e5-4c06-878a-2b66fea26332-kube-api-access-pzd7t\") pod \"service-ca-operator-cf7c776b7-6jxk5\" (UID: \"56243070-e9e5-4c06-878a-2b66fea26332\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.573596 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.573574    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27z2\" (UniqueName: \"kubernetes.io/projected/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-kube-api-access-z27z2\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:58:59.635365 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.635333    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"
Sep 14 12:58:59.664312 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.664430 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.664430 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.664430 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664398    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-config\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.664430 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664413    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.664617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7de1dbd8-b83d-48b6-9f09-2e5228f039af-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.664617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664459    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-trusted-ca\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.664617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664478    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqpz\" (UniqueName: \"kubernetes.io/projected/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-kube-api-access-qfqpz\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.664857 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.664783    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:59.664857 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.664811    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:58:59.664857 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.665055 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.664872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.665055 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.664896    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.164871111 +0000 UTC m=+50.479654453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:58:59.665185 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.665185 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665169    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlc9\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.665281 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665228    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-serving-cert\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.665281 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665243    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-config\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.665377 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.665377 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.665781 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665728    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.666013 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.665990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-trusted-ca\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.666132 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.666014    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.667280 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.667263    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.667640 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.667624    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-serving-cert\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.667742 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.667725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.677913 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.677888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlc9\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.678086 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.678069    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:58:59.685324 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.685268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqpz\" (UniqueName: \"kubernetes.io/projected/a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac-kube-api-access-qfqpz\") pod \"console-operator-696884fb9c-9x266\" (UID: \"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac\") " pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.740664 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.740627    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:58:59.765963 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.765932    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7de1dbd8-b83d-48b6-9f09-2e5228f039af-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.766059 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.765965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.766115 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.766080    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:58:59.766160 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:58:59.766141    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.266127721 +0000 UTC m=+50.580911073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:58:59.766569 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.766549    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7de1dbd8-b83d-48b6-9f09-2e5228f039af-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:58:59.845416 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.845382    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz"]
Sep 14 12:58:59.849443 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:59.849415    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318e5a38_b52f_4d57_97c9_b791e298e8c0.slice/crio-62cecbb1aa980c5b9ce609eae31d4ec17ffe941bbce3ecc0d3206adcc0658887 WatchSource:0}: Error finding container 62cecbb1aa980c5b9ce609eae31d4ec17ffe941bbce3ecc0d3206adcc0658887: Status 404 returned error can't find the container with id 62cecbb1aa980c5b9ce609eae31d4ec17ffe941bbce3ecc0d3206adcc0658887
Sep 14 12:58:59.870888 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.870860    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m"]
Sep 14 12:58:59.874889 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:59.874864    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f52b1b_d570_4eea_9fcd_3f9a90a5cca0.slice/crio-61edf5b052ea6c356462536c51dd89187d3b17a9aa532160449dd2d516e6e2c2 WatchSource:0}: Error finding container 61edf5b052ea6c356462536c51dd89187d3b17a9aa532160449dd2d516e6e2c2: Status 404 returned error can't find the container with id 61edf5b052ea6c356462536c51dd89187d3b17a9aa532160449dd2d516e6e2c2
Sep 14 12:58:59.943467 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:58:59.943436    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5"]
Sep 14 12:58:59.946216 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:58:59.946162    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56243070_e9e5_4c06_878a_2b66fea26332.slice/crio-0cf9a8e418442c41de4e4be7b1b6835d2beb25b8d90c7a6034925f12a964f277 WatchSource:0}: Error finding container 0cf9a8e418442c41de4e4be7b1b6835d2beb25b8d90c7a6034925f12a964f277: Status 404 returned error can't find the container with id 0cf9a8e418442c41de4e4be7b1b6835d2beb25b8d90c7a6034925f12a964f277
Sep 14 12:59:00.039199 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.039168    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-9x266"]
Sep 14 12:59:00.042086 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:00.042063    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b23f5d_9f0a_4c78_8aa9_c3e05eaeadac.slice/crio-090f52b62085f7340b306d880dfc502cde8c82e4e35643f6300225d679bdee4b WatchSource:0}: Error finding container 090f52b62085f7340b306d880dfc502cde8c82e4e35643f6300225d679bdee4b: Status 404 returned error can't find the container with id 090f52b62085f7340b306d880dfc502cde8c82e4e35643f6300225d679bdee4b
Sep 14 12:59:00.068431 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.068408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:00.068560 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.068543    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:00.068608 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.068600    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:01.068584954 +0000 UTC m=+51.383368283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:00.169494 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.169464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:00.169645 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.169605    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:00.169645 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.169620    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:59:00.169715 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.169668    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:01.169653465 +0000 UTC m=+51.484436799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:59:00.270398 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.270365    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:00.270748 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.270466    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:59:00.270748 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.270524    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:01.270506053 +0000 UTC m=+51.585289403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:59:00.371700 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.371662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:00.371871 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.371826    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:59:00.371935 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:00.371904    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls podName:a224ad8e-2683-439a-8c5f-2ec635336022 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:16.37188172 +0000 UTC m=+66.686665056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls") pod "dns-default-952cx" (UID: "a224ad8e-2683-439a-8c5f-2ec635336022") : secret "dns-default-metrics-tls" not found
Sep 14 12:59:00.475523 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.475385    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5" event={"ID":"56243070-e9e5-4c06-878a-2b66fea26332","Type":"ContainerStarted","Data":"0cf9a8e418442c41de4e4be7b1b6835d2beb25b8d90c7a6034925f12a964f277"}
Sep 14 12:59:00.477034 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.477005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9x266" event={"ID":"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac","Type":"ContainerStarted","Data":"090f52b62085f7340b306d880dfc502cde8c82e4e35643f6300225d679bdee4b"}
Sep 14 12:59:00.479918 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.479856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m" event={"ID":"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0","Type":"ContainerStarted","Data":"61edf5b052ea6c356462536c51dd89187d3b17a9aa532160449dd2d516e6e2c2"}
Sep 14 12:59:00.482072 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:00.482033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz" event={"ID":"318e5a38-b52f-4d57-97c9-b791e298e8c0","Type":"ContainerStarted","Data":"62cecbb1aa980c5b9ce609eae31d4ec17ffe941bbce3ecc0d3206adcc0658887"}
Sep 14 12:59:01.077224 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:01.077163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:01.077500 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.077299    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:01.077500 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.077375    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.077355392 +0000 UTC m=+53.392138738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:01.178338 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:01.178306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:01.178507 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.178484    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:01.178577 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.178511    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:59:01.178577 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.178575    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.178555668 +0000 UTC m=+53.493339020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:59:01.279807 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:01.279763    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:01.280183 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.279921    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:59:01.280183 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:01.279966    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.279954226 +0000 UTC m=+53.594737570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:59:01.487229 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:01.487180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz" event={"ID":"318e5a38-b52f-4d57-97c9-b791e298e8c0","Type":"ContainerStarted","Data":"b1d7767c3444835855cbd3856ec4215ef6a66ba728e301a66343b74d88b02702"}
Sep 14 12:59:01.505364 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:01.505313    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-gtjwz" podStartSLOduration=1.19922985 podStartE2EDuration="2.505294607s" totalImagesPullingTime="1.306064757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:01.504365536 +0000 UTC m=+51.819148887" watchObservedRunningTime="2026-09-14 12:59:01.505294607 +0000 UTC m=+51.820077961"
Sep 14 12:59:03.089154 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.089127    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rcdzj"]
Sep 14 12:59:03.091109 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.091090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.093753 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.093719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:03.093869 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.093854    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:03.093930 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.093912    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:07.093896215 +0000 UTC m=+57.408679557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:03.099132 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.099112    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 12:59:03.099526 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.099502    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 12:59:03.099526 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.099517    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 12:59:03.100347 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.100268    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 12:59:03.100767 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.100752    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pk74f\""
Sep 14 12:59:03.112542 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.112520    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcdzj"]
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-data-volume\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-crio-socket\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194486    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96k5\" (UniqueName: \"kubernetes.io/projected/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-api-access-f96k5\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.194513    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.194650    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:03.194654 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.194665    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:59:03.195116 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.194716    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:07.19469693 +0000 UTC m=+57.509480280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:59:03.295654 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96k5\" (UniqueName: \"kubernetes.io/projected/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-api-access-f96k5\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.295764 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.295764 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-data-volume\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.295852 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295794    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.295852 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.295812    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.295852 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:03.295852 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295848    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-crio-socket\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.296063 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.295887    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.795867988 +0000 UTC m=+54.110651321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.296063 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.295926    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-crio-socket\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.296063 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.295937    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.296063 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.295981    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.795968149 +0000 UTC m=+54.110751493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.296063 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.296009    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:59:03.296280 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.296070    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:07.296038867 +0000 UTC m=+57.610822199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:59:03.296280 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.296159    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-data-volume\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.305908 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.305879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96k5\" (UniqueName: \"kubernetes.io/projected/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-api-access-f96k5\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.494142 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.494117    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/0.log"
Sep 14 12:59:03.494284 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.494159    2566 generic.go:356] "Generic (PLEG): container finished" podID="a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac" containerID="1f617883452e50c6330309c00658daa9a960ab0eca810af2bed6a36e39903d36" exitCode=255
Sep 14 12:59:03.494284 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.494246    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9x266" event={"ID":"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac","Type":"ContainerDied","Data":"1f617883452e50c6330309c00658daa9a960ab0eca810af2bed6a36e39903d36"}
Sep 14 12:59:03.494515 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.494498    2566 scope.go:117] "RemoveContainer" containerID="1f617883452e50c6330309c00658daa9a960ab0eca810af2bed6a36e39903d36"
Sep 14 12:59:03.496005 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.495976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m" event={"ID":"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0","Type":"ContainerStarted","Data":"4eee09ff5e8a7c05833d8ab232a6875ea5efb5c48f4e6047b3bdeb78376548eb"}
Sep 14 12:59:03.497588 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.497543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5" event={"ID":"56243070-e9e5-4c06-878a-2b66fea26332","Type":"ContainerStarted","Data":"5dcf89708c69703c6a6111336ab2f220e181e852d542b1b102edc38d6bcb25b7"}
Sep 14 12:59:03.557755 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.557710    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m" podStartSLOduration=1.338577344 podStartE2EDuration="4.557694762s" totalImagesPullingTime="3.219117418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:03.556831138 +0000 UTC m=+53.871614505" watchObservedRunningTime="2026-09-14 12:59:03.557694762 +0000 UTC m=+53.872478107"
Sep 14 12:59:03.586296 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.586251    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5" podStartSLOduration=1.432267339 podStartE2EDuration="4.586232434s" totalImagesPullingTime="3.153965095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:03.585478261 +0000 UTC m=+53.900261614" watchObservedRunningTime="2026-09-14 12:59:03.586232434 +0000 UTC m=+53.901015791"
Sep 14 12:59:03.799975 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.799886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.800227 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.799992    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.800227 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:03.800017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:03.800227 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.800058    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:04.800033312 +0000 UTC m=+55.114816646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.800227 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.800133    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.800227 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:03.800186    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:04.800171755 +0000 UTC m=+55.114955089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:04.502518 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.502490    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 12:59:04.502945 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.502927    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/0.log"
Sep 14 12:59:04.503021 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.502972    2566 generic.go:356] "Generic (PLEG): container finished" podID="a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac" containerID="238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1" exitCode=255
Sep 14 12:59:04.503095 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.503073    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9x266" event={"ID":"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac","Type":"ContainerDied","Data":"238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1"}
Sep 14 12:59:04.503143 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.503126    2566 scope.go:117] "RemoveContainer" containerID="1f617883452e50c6330309c00658daa9a960ab0eca810af2bed6a36e39903d36"
Sep 14 12:59:04.503399 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.503368    2566 scope.go:117] "RemoveContainer" containerID="238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1"
Sep 14 12:59:04.503565 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:04.503547    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9x266_openshift-console-operator(a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac)\"" pod="openshift-console-operator/console-operator-696884fb9c-9x266" podUID="a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac"
Sep 14 12:59:04.569168 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.569145    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mm2w_4e843a4f-6502-4288-96e1-3b69e00bab7a/dns-node-resolver/0.log"
Sep 14 12:59:04.810514 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.810438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:04.810514 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:04.810502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:04.810713 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:04.810569    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:04.810713 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:04.810592    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:04.810713 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:04.810621    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.810607988 +0000 UTC m=+57.125391318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:04.810713 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:04.810655    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.810638582 +0000 UTC m=+57.125421913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:05.507209 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:05.507185    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 12:59:05.507676 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:05.507548    2566 scope.go:117] "RemoveContainer" containerID="238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1"
Sep 14 12:59:05.507763 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:05.507736    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9x266_openshift-console-operator(a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac)\"" pod="openshift-console-operator/console-operator-696884fb9c-9x266" podUID="a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac"
Sep 14 12:59:05.581856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:05.581831    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn8s8_aec0bc69-308d-40bd-9f6b-7644f7494ded/node-ca/0.log"
Sep 14 12:59:06.169467 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:06.169436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lk29_3ef54ff3-e3ad-4732-9a69-a52d4f5d148e/serve-healthcheck-canary/0.log"
Sep 14 12:59:06.826946 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:06.826908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:06.827386 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:06.826999    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:06.827386 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:06.827085    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:06.827386 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:06.827092    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:06.827386 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:06.827142    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:10.827129263 +0000 UTC m=+61.141912593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:06.827386 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:06.827156    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:10.8271492 +0000 UTC m=+61.141932533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:07.129124 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:07.129039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:07.129259 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.129178    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:07.129259 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.129244    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.129228947 +0000 UTC m=+65.444012276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:07.229406 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:07.229377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:07.229534 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.229510    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:07.229534 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.229525    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:59:07.229600 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.229585    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.229573021 +0000 UTC m=+65.544356350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:59:07.330504 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:07.330452    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:07.330628 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.330582    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:59:07.330681 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:07.330639    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.330626591 +0000 UTC m=+65.645409937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:59:09.422065 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:09.422023    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-st6pb"
Sep 14 12:59:09.741011 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:09.740977    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:59:09.741179 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:09.741032    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:59:09.741366 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:09.741352    2566 scope.go:117] "RemoveContainer" containerID="238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1"
Sep 14 12:59:09.741514 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:09.741496    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-9x266_openshift-console-operator(a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac)\"" pod="openshift-console-operator/console-operator-696884fb9c-9x266" podUID="a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac"
Sep 14 12:59:10.858673 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:10.858631    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:10.859030 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:10.858706    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:10.859030 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:10.858774    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:10.859030 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:10.858779    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:10.859030 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:10.858833    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:18.858817318 +0000 UTC m=+69.173600667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:10.859030 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:10.858847    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:18.858840953 +0000 UTC m=+69.173624286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:15.193260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.193220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:15.193744 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.193353    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:15.193744 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.193412    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls podName:cea1970c-d05b-4fa9-b1db-6c042cecd6bc nodeName:}" failed. No retries permitted until 2026-09-14 12:59:31.193397099 +0000 UTC m=+81.508180452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rrv2n" (UID: "cea1970c-d05b-4fa9-b1db-6c042cecd6bc") : secret "cluster-monitoring-operator-tls" not found
Sep 14 12:59:15.293656 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.293629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:15.293761 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.293730    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:15.293761 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.293747    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df5fb9bd-mgjbq: secret "image-registry-tls" not found
Sep 14 12:59:15.293846 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.293795    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls podName:5e8e74b6-9725-4216-9a27-156ec2506825 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:31.293782853 +0000 UTC m=+81.608566182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls") pod "image-registry-6df5fb9bd-mgjbq" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825") : secret "image-registry-tls" not found
Sep 14 12:59:15.394705 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.394680    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:15.394847 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.394830    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 12:59:15.394889 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.394884    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert podName:7de1dbd8-b83d-48b6-9f09-2e5228f039af nodeName:}" failed. No retries permitted until 2026-09-14 12:59:31.39487163 +0000 UTC m=+81.709654961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5g8hg" (UID: "7de1dbd8-b83d-48b6-9f09-2e5228f039af") : secret "networking-console-plugin-cert" not found
Sep 14 12:59:15.899453 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.899420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:59:15.899453 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.899458    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 12:59:15.903260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.903240    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 12:59:15.903368 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.903351    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 12:59:15.910654 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.910632    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 14 12:59:15.910745 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:15.910698    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs podName:594b715e-ce54-4f93-832a-32827b632a0a nodeName:}" failed. No retries permitted until 2026-09-14 13:00:19.910679542 +0000 UTC m=+130.225462875 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs") pod "network-metrics-daemon-8hn27" (UID: "594b715e-ce54-4f93-832a-32827b632a0a") : secret "metrics-daemon-secret" not found
Sep 14 12:59:15.912643 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:15.912623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/344fac89-2ec6-49c3-b18b-49a097126d98-original-pull-secret\") pod \"global-pull-secret-syncer-fgdpr\" (UID: \"344fac89-2ec6-49c3-b18b-49a097126d98\") " pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:59:16.000706 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.000678    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:59:16.003608 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.003594    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 12:59:16.013942 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.013927    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 12:59:16.023593 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.023567    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgdzb\" (UniqueName: \"kubernetes.io/projected/59a7b435-1d4f-4561-a8fb-980481c112ca-kube-api-access-vgdzb\") pod \"network-check-target-z8qs7\" (UID: \"59a7b435-1d4f-4561-a8fb-980481c112ca\") " pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:59:16.197099 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.197021    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgdpr"
Sep 14 12:59:16.213290 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.213267    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-578px\""
Sep 14 12:59:16.221328 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.221312    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:59:16.403889 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.403848    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:16.405937 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.405916    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a224ad8e-2683-439a-8c5f-2ec635336022-metrics-tls\") pod \"dns-default-952cx\" (UID: \"a224ad8e-2683-439a-8c5f-2ec635336022\") " pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:16.501396 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.501370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fgdpr"]
Sep 14 12:59:16.504366 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:16.504342    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344fac89_2ec6_49c3_b18b_49a097126d98.slice/crio-46aac28611fc56f5bef0543f9700acbbdc38e87b24b5e17f36eab872c4aec6ee WatchSource:0}: Error finding container 46aac28611fc56f5bef0543f9700acbbdc38e87b24b5e17f36eab872c4aec6ee: Status 404 returned error can't find the container with id 46aac28611fc56f5bef0543f9700acbbdc38e87b24b5e17f36eab872c4aec6ee
Sep 14 12:59:16.519378 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.519365    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8qs7"]
Sep 14 12:59:16.521432 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:16.521413    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a7b435_1d4f_4561_a8fb_980481c112ca.slice/crio-5c5216de43b8133807f8dcd8988bc6299baa638fdebe655b339c6ae982397cf5 WatchSource:0}: Error finding container 5c5216de43b8133807f8dcd8988bc6299baa638fdebe655b339c6ae982397cf5: Status 404 returned error can't find the container with id 5c5216de43b8133807f8dcd8988bc6299baa638fdebe655b339c6ae982397cf5
Sep 14 12:59:16.534836 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.534810    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fgdpr" event={"ID":"344fac89-2ec6-49c3-b18b-49a097126d98","Type":"ContainerStarted","Data":"46aac28611fc56f5bef0543f9700acbbdc38e87b24b5e17f36eab872c4aec6ee"}
Sep 14 12:59:16.535876 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.535857    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8qs7" event={"ID":"59a7b435-1d4f-4561-a8fb-980481c112ca","Type":"ContainerStarted","Data":"5c5216de43b8133807f8dcd8988bc6299baa638fdebe655b339c6ae982397cf5"}
Sep 14 12:59:16.688167 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.688141    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4h7f4\""
Sep 14 12:59:16.695500 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.695484    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:16.985812 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:16.985781    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-952cx"]
Sep 14 12:59:16.988594 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:16.988569    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda224ad8e_2683_439a_8c5f_2ec635336022.slice/crio-d4949b3f92ba301652ca35dec5fffa5bf01e87475ca1ce4b1729868ada712efd WatchSource:0}: Error finding container d4949b3f92ba301652ca35dec5fffa5bf01e87475ca1ce4b1729868ada712efd: Status 404 returned error can't find the container with id d4949b3f92ba301652ca35dec5fffa5bf01e87475ca1ce4b1729868ada712efd
Sep 14 12:59:17.541896 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:17.541858    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-952cx" event={"ID":"a224ad8e-2683-439a-8c5f-2ec635336022","Type":"ContainerStarted","Data":"d4949b3f92ba301652ca35dec5fffa5bf01e87475ca1ce4b1729868ada712efd"}
Sep 14 12:59:18.926494 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:18.926461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:18.926973 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:18.926551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:18.926973 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:18.926662    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:18.926973 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:18.926726    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls podName:0e1b8628-2ee7-4d56-a20d-7d46697df8b6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:34.926712731 +0000 UTC m=+85.241496061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcdzj" (UID: "0e1b8628-2ee7-4d56-a20d-7d46697df8b6") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:18.927129 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:18.927020    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:21.556829 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.556750    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fgdpr" event={"ID":"344fac89-2ec6-49c3-b18b-49a097126d98","Type":"ContainerStarted","Data":"599f680b7666c90b99b406d5f6b9207237380412e251e4303d371195ec54f3cc"}
Sep 14 12:59:21.558558 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.558531    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8qs7" event={"ID":"59a7b435-1d4f-4561-a8fb-980481c112ca","Type":"ContainerStarted","Data":"ddb319f2d706e15fcb16ce63975af0abd9769ccd8038043868f051e44218241c"}
Sep 14 12:59:21.558687 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.558613    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:59:21.560308 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.560282    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-952cx" event={"ID":"a224ad8e-2683-439a-8c5f-2ec635336022","Type":"ContainerStarted","Data":"9646c9da57ce5686c5ef9b0d60e9f3809a85c85c8e9d21363633f077e1aeb53a"}
Sep 14 12:59:21.560443 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.560329    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-952cx" event={"ID":"a224ad8e-2683-439a-8c5f-2ec635336022","Type":"ContainerStarted","Data":"c10d696f97a3ba633714825696ce9b8cefd4f1ce4f48eb15b68952fc459fd52e"}
Sep 14 12:59:21.560509 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.560448    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:21.574658 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.574612    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fgdpr" podStartSLOduration=66.770024391 podStartE2EDuration="1m11.574597966s" totalImagesPullingTime="4.804573575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:21.573460879 +0000 UTC m=+71.888244231" watchObservedRunningTime="2026-09-14 12:59:21.574597966 +0000 UTC m=+71.889381320"
Sep 14 12:59:21.595052 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.595008    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-952cx" podStartSLOduration=33.290431776 podStartE2EDuration="37.594994769s" totalImagesPullingTime="4.304562993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:21.593852958 +0000 UTC m=+71.908636306" watchObservedRunningTime="2026-09-14 12:59:21.594994769 +0000 UTC m=+71.909778120"
Sep 14 12:59:21.634383 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:21.634343    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z8qs7" podStartSLOduration=66.851164664 podStartE2EDuration="1m11.634330481s" totalImagesPullingTime="4.783165817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:21.633752213 +0000 UTC m=+71.948535582" watchObservedRunningTime="2026-09-14 12:59:21.634330481 +0000 UTC m=+71.949113834"
Sep 14 12:59:22.184702 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.184677    2566 scope.go:117] "RemoveContainer" containerID="238eb3dad946ff939cfb600be8c047368d5970a72e892bf11bd82a9c3e2a9ae1"
Sep 14 12:59:22.566392 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.566361    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 12:59:22.566775 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.566484    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-9x266" event={"ID":"a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac","Type":"ContainerStarted","Data":"1ea88975c97f3837a1a67577956633dc5343c9bf093fb8ac5616c096a6dea9ae"}
Sep 14 12:59:22.567214 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.567196    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:59:22.585982 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.585936    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-9x266" podStartSLOduration=20.526081858 podStartE2EDuration="23.585920307s" totalImagesPullingTime="3.059838449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:22.585366755 +0000 UTC m=+72.900150108" watchObservedRunningTime="2026-09-14 12:59:22.585920307 +0000 UTC m=+72.900703660"
Sep 14 12:59:22.756958 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:22.756918    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-9x266"
Sep 14 12:59:31.225350 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.225307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:31.227670 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.227648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cea1970c-d05b-4fa9-b1db-6c042cecd6bc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rrv2n\" (UID: \"cea1970c-d05b-4fa9-b1db-6c042cecd6bc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:31.326257 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.326205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:31.328764 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.328740    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"image-registry-6df5fb9bd-mgjbq\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") " pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:31.426699 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.426663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:31.428930 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.428903    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7de1dbd8-b83d-48b6-9f09-2e5228f039af-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5g8hg\" (UID: \"7de1dbd8-b83d-48b6-9f09-2e5228f039af\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:31.462692 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.462665    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nl9f8\""
Sep 14 12:59:31.471024 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.471007    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"
Sep 14 12:59:31.569096 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.569070    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-952cx"
Sep 14 12:59:31.578849 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.578826    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29dxj\""
Sep 14 12:59:31.587057 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.587024    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:31.634197 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.634165    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2shgc\""
Sep 14 12:59:31.636226 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.636198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"
Sep 14 12:59:31.749539 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.749471    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:59:31.753621 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.753592    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n"]
Sep 14 12:59:31.755689 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:31.755663    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea1970c_d05b_4fa9_b1db_6c042cecd6bc.slice/crio-02ee6aec353014462291e1ec2f0825059cd9e5c545f4f17778429ff5e390383d WatchSource:0}: Error finding container 02ee6aec353014462291e1ec2f0825059cd9e5c545f4f17778429ff5e390383d: Status 404 returned error can't find the container with id 02ee6aec353014462291e1ec2f0825059cd9e5c545f4f17778429ff5e390383d
Sep 14 12:59:31.762826 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.762806    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"]
Sep 14 12:59:31.767069 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.767029    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.775840 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.775821    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 14 12:59:31.776495 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.776468    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 14 12:59:31.776573 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.776556    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 14 12:59:31.776786 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.776768    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 14 12:59:31.781587 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.781568    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"]
Sep 14 12:59:31.830420 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.830390    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57167081-2bec-4935-9c6a-4df4bda24b19-tmp\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.830584 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.830453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57167081-2bec-4935-9c6a-4df4bda24b19-klusterlet-config\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.830584 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.830482    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22htt\" (UniqueName: \"kubernetes.io/projected/57167081-2bec-4935-9c6a-4df4bda24b19-kube-api-access-22htt\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.860669 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.860642    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-c2dqr"]
Sep 14 12:59:31.863589 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.863574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:31.870933 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.870913    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-798fc9666d-hg2ld"]
Sep 14 12:59:31.871935 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.871918    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xqdk2\""
Sep 14 12:59:31.872576 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.872562    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 12:59:31.873919 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.873905    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.874541 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.874521    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 12:59:31.889091 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.889023    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:59:31.889951 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.889929    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c2dqr"]
Sep 14 12:59:31.892620 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:31.892601    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8e74b6_9725_4216_9a27_156ec2506825.slice/crio-1a4638680078b496d1cc67ec5f785b3ef56c2b42c4fb121629f865f80ae047bb WatchSource:0}: Error finding container 1a4638680078b496d1cc67ec5f785b3ef56c2b42c4fb121629f865f80ae047bb: Status 404 returned error can't find the container with id 1a4638680078b496d1cc67ec5f785b3ef56c2b42c4fb121629f865f80ae047bb
Sep 14 12:59:31.898468 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.898448    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798fc9666d-hg2ld"]
Sep 14 12:59:31.928370 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.928346    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg"]
Sep 14 12:59:31.930900 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.930875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-installation-pull-secrets\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931006 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:31.930948    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de1dbd8_b83d_48b6_9f09_2e5228f039af.slice/crio-da707d022df5265a425ef11cc1aca4e2cf1673fce59a3e67659af680469fa7cf WatchSource:0}: Error finding container da707d022df5265a425ef11cc1aca4e2cf1673fce59a3e67659af680469fa7cf: Status 404 returned error can't find the container with id da707d022df5265a425ef11cc1aca4e2cf1673fce59a3e67659af680469fa7cf
Sep 14 12:59:31.931006 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.930973    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-registry-tls\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931144 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931022    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57167081-2bec-4935-9c6a-4df4bda24b19-tmp\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.931144 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-image-registry-private-configuration\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931144 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6041af6-ebac-461b-8145-e9671e71a59a-ca-trust-extracted\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931297 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-trusted-ca\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931297 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931180    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqxw\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-kube-api-access-2bqxw\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931297 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931222    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-registry-certificates\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931297 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c29w\" (UniqueName: \"kubernetes.io/projected/9dfb058b-046b-41a4-a3a7-f544609b1a43-kube-api-access-9c29w\") pod \"downloads-76f99584f4-c2dqr\" (UID: \"9dfb058b-046b-41a4-a3a7-f544609b1a43\") " pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:31.931297 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931283    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-bound-sa-token\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:31.931480 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931330    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57167081-2bec-4935-9c6a-4df4bda24b19-klusterlet-config\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.931480 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57167081-2bec-4935-9c6a-4df4bda24b19-tmp\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.931480 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.931363    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22htt\" (UniqueName: \"kubernetes.io/projected/57167081-2bec-4935-9c6a-4df4bda24b19-kube-api-access-22htt\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.934424 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.934401    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/57167081-2bec-4935-9c6a-4df4bda24b19-klusterlet-config\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:31.955471 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:31.955445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22htt\" (UniqueName: \"kubernetes.io/projected/57167081-2bec-4935-9c6a-4df4bda24b19-kube-api-access-22htt\") pod \"klusterlet-addon-workmgr-785cd66b6f-7l6mm\" (UID: \"57167081-2bec-4935-9c6a-4df4bda24b19\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:32.032668 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032576    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-installation-pull-secrets\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032668 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032649    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-registry-tls\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032712    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-image-registry-private-configuration\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6041af6-ebac-461b-8145-e9671e71a59a-ca-trust-extracted\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032785    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-trusted-ca\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqxw\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-kube-api-access-2bqxw\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.032856 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-registry-certificates\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.033123 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c29w\" (UniqueName: \"kubernetes.io/projected/9dfb058b-046b-41a4-a3a7-f544609b1a43-kube-api-access-9c29w\") pod \"downloads-76f99584f4-c2dqr\" (UID: \"9dfb058b-046b-41a4-a3a7-f544609b1a43\") " pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:32.033123 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.032898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-bound-sa-token\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.033567 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.033542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6041af6-ebac-461b-8145-e9671e71a59a-ca-trust-extracted\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.034113 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.034089    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-trusted-ca\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.034204 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.034131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6041af6-ebac-461b-8145-e9671e71a59a-registry-certificates\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.035639 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.035614    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-registry-tls\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.035712 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.035643    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-installation-pull-secrets\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.035754 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.035730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6041af6-ebac-461b-8145-e9671e71a59a-image-registry-private-configuration\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.049415 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.049390    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c29w\" (UniqueName: \"kubernetes.io/projected/9dfb058b-046b-41a4-a3a7-f544609b1a43-kube-api-access-9c29w\") pod \"downloads-76f99584f4-c2dqr\" (UID: \"9dfb058b-046b-41a4-a3a7-f544609b1a43\") " pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:32.051542 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.051522    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-bound-sa-token\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.052164 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.052146    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqxw\" (UniqueName: \"kubernetes.io/projected/c6041af6-ebac-461b-8145-e9671e71a59a-kube-api-access-2bqxw\") pod \"image-registry-798fc9666d-hg2ld\" (UID: \"c6041af6-ebac-461b-8145-e9671e71a59a\") " pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.076180 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.076150    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:32.172702 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.172673    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:32.181693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.181671    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.350098 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.350022    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"]
Sep 14 12:59:32.352581 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:32.352549    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57167081_2bec_4935_9c6a_4df4bda24b19.slice/crio-cf3150d1d17f7e422f4931b4f0adc2b8af572f95958ca7b7f53b236e3d13792f WatchSource:0}: Error finding container cf3150d1d17f7e422f4931b4f0adc2b8af572f95958ca7b7f53b236e3d13792f: Status 404 returned error can't find the container with id cf3150d1d17f7e422f4931b4f0adc2b8af572f95958ca7b7f53b236e3d13792f
Sep 14 12:59:32.456291 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.456119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c2dqr"]
Sep 14 12:59:32.460770 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:32.460733    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfb058b_046b_41a4_a3a7_f544609b1a43.slice/crio-fc585717e142987c20794360cdfb86cca8745d971a6ea70a90713f0e9c2d1d56 WatchSource:0}: Error finding container fc585717e142987c20794360cdfb86cca8745d971a6ea70a90713f0e9c2d1d56: Status 404 returned error can't find the container with id fc585717e142987c20794360cdfb86cca8745d971a6ea70a90713f0e9c2d1d56
Sep 14 12:59:32.476246 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.476217    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798fc9666d-hg2ld"]
Sep 14 12:59:32.600680 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.600558    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg" event={"ID":"7de1dbd8-b83d-48b6-9f09-2e5228f039af","Type":"ContainerStarted","Data":"da707d022df5265a425ef11cc1aca4e2cf1673fce59a3e67659af680469fa7cf"}
Sep 14 12:59:32.602982 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.602474    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld" event={"ID":"c6041af6-ebac-461b-8145-e9671e71a59a","Type":"ContainerStarted","Data":"9d91e6e261784e518f8a6f332347abc7bca7a84a302e906f6381982e99ba0424"}
Sep 14 12:59:32.602982 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.602521    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld" event={"ID":"c6041af6-ebac-461b-8145-e9671e71a59a","Type":"ContainerStarted","Data":"1fd2011e18576a8ddc586995f2abc4b62f0da661e79b431314374ba63aa42a94"}
Sep 14 12:59:32.602982 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.602653    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:32.603980 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.603949    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm" event={"ID":"57167081-2bec-4935-9c6a-4df4bda24b19","Type":"ContainerStarted","Data":"cf3150d1d17f7e422f4931b4f0adc2b8af572f95958ca7b7f53b236e3d13792f"}
Sep 14 12:59:32.605336 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.605313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n" event={"ID":"cea1970c-d05b-4fa9-b1db-6c042cecd6bc","Type":"ContainerStarted","Data":"02ee6aec353014462291e1ec2f0825059cd9e5c545f4f17778429ff5e390383d"}
Sep 14 12:59:32.606638 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.606610    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c2dqr" event={"ID":"9dfb058b-046b-41a4-a3a7-f544609b1a43","Type":"ContainerStarted","Data":"fc585717e142987c20794360cdfb86cca8745d971a6ea70a90713f0e9c2d1d56"}
Sep 14 12:59:32.609206 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.609181    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" event={"ID":"5e8e74b6-9725-4216-9a27-156ec2506825","Type":"ContainerStarted","Data":"b1cb6b836155b3e6b7d259dbdf294260f20e91b07f3be97e6938b4aa833363b6"}
Sep 14 12:59:32.609324 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.609221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" event={"ID":"5e8e74b6-9725-4216-9a27-156ec2506825","Type":"ContainerStarted","Data":"1a4638680078b496d1cc67ec5f785b3ef56c2b42c4fb121629f865f80ae047bb"}
Sep 14 12:59:32.609390 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.609344    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:32.624675 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.624628    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld" podStartSLOduration=1.624609082 podStartE2EDuration="1.624609082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:32.62294779 +0000 UTC m=+82.937731143" watchObservedRunningTime="2026-09-14 12:59:32.624609082 +0000 UTC m=+82.939392436"
Sep 14 12:59:32.646964 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:32.646910    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" podStartSLOduration=33.646861529 podStartE2EDuration="33.646861529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:32.644925355 +0000 UTC m=+82.959708708" watchObservedRunningTime="2026-09-14 12:59:32.646861529 +0000 UTC m=+82.961644884"
Sep 14 12:59:34.623354 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:34.623313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg" event={"ID":"7de1dbd8-b83d-48b6-9f09-2e5228f039af","Type":"ContainerStarted","Data":"572d31b678e428f3fc3a8110c64b767fe0ba55dce1fbca02f6b69f81d9c2cdfe"}
Sep 14 12:59:34.626115 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:34.626082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n" event={"ID":"cea1970c-d05b-4fa9-b1db-6c042cecd6bc","Type":"ContainerStarted","Data":"f597b54870ce8eddd742e74badb63d9141581150955679014c6b4a75bc855976"}
Sep 14 12:59:34.732834 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:34.732777    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5g8hg" podStartSLOduration=34.036139549 podStartE2EDuration="35.732755236s" totalImagesPullingTime="1.696615687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:34.661175708 +0000 UTC m=+84.975959060" watchObservedRunningTime="2026-09-14 12:59:34.732755236 +0000 UTC m=+85.047538590"
Sep 14 12:59:34.964907 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:34.964861    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:34.968900 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:34.968817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e1b8628-2ee7-4d56-a20d-7d46697df8b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcdzj\" (UID: \"0e1b8628-2ee7-4d56-a20d-7d46697df8b6\") " pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:35.203558 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:35.203342    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pk74f\""
Sep 14 12:59:35.210953 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:35.210902    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcdzj"
Sep 14 12:59:37.306777 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.306728    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rrv2n" podStartSLOduration=36.387224707 podStartE2EDuration="38.306707603s" totalImagesPullingTime="1.919482896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:34.733505239 +0000 UTC m=+85.048288626" watchObservedRunningTime="2026-09-14 12:59:37.306707603 +0000 UTC m=+87.621491016"
Sep 14 12:59:37.307221 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.306916    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcdzj"]
Sep 14 12:59:37.309889 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:37.309847    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1b8628_2ee7_4d56_a20d_7d46697df8b6.slice/crio-5e672a277d0266467f5968f4b0bb036059b27b26db786c727f2d48b4f10c401d WatchSource:0}: Error finding container 5e672a277d0266467f5968f4b0bb036059b27b26db786c727f2d48b4f10c401d: Status 404 returned error can't find the container with id 5e672a277d0266467f5968f4b0bb036059b27b26db786c727f2d48b4f10c401d
Sep 14 12:59:37.641025 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.640881    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm" event={"ID":"57167081-2bec-4935-9c6a-4df4bda24b19","Type":"ContainerStarted","Data":"b02f0c0611c0a0168b76fb7bd7d60c42e302ad959bd4950d5d5f51f4659dae61"}
Sep 14 12:59:37.641198 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.641034    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:37.642939 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.642851    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcdzj" event={"ID":"0e1b8628-2ee7-4d56-a20d-7d46697df8b6","Type":"ContainerStarted","Data":"f19a4cf169b12f53997099908305ae144d729a12b0d9ee89b0fb36abbdf91082"}
Sep 14 12:59:37.642939 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.642913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcdzj" event={"ID":"0e1b8628-2ee7-4d56-a20d-7d46697df8b6","Type":"ContainerStarted","Data":"5e672a277d0266467f5968f4b0bb036059b27b26db786c727f2d48b4f10c401d"}
Sep 14 12:59:37.643162 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.643120    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm"
Sep 14 12:59:37.661455 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:37.661387    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785cd66b6f-7l6mm" podStartSLOduration=1.936524411 podStartE2EDuration="6.661370528s" totalImagesPullingTime="4.724846117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:37.661292819 +0000 UTC m=+87.976076173" watchObservedRunningTime="2026-09-14 12:59:37.661370528 +0000 UTC m=+87.976153881"
Sep 14 12:59:38.649007 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:38.648969    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcdzj" event={"ID":"0e1b8628-2ee7-4d56-a20d-7d46697df8b6","Type":"ContainerStarted","Data":"ba038197130393517c2fc2d02eef08c0ed8671f10185fa489c0723f95fc30bad"}
Sep 14 12:59:39.656021 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:39.655955    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcdzj" event={"ID":"0e1b8628-2ee7-4d56-a20d-7d46697df8b6","Type":"ContainerStarted","Data":"fe1d5cbf789e461be6219e9afedd1abacb997df7719f94f47d0dde8fa3d21005"}
Sep 14 12:59:39.693255 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:39.693203    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rcdzj" podStartSLOduration=34.652734769 podStartE2EDuration="36.693186196s" totalImagesPullingTime="2.040451427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:59:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:39.692568939 +0000 UTC m=+90.007352292" watchObservedRunningTime="2026-09-14 12:59:39.693186196 +0000 UTC m=+90.007969548"
Sep 14 12:59:42.872459 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.872422    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gg9ln"]
Sep 14 12:59:42.874967 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.874946    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:42.886260 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.886234    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 12:59:42.886421 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.886395    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 12:59:42.886540 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.886395    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 12:59:42.886540 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.886404    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cbw8t\""
Sep 14 12:59:42.887680 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:42.887663    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 12:59:43.036320 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5k5\" (UniqueName: \"kubernetes.io/projected/560c336b-52be-441e-be37-4d3c679955d0-kube-api-access-pg5k5\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036490 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036334    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036490 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-wtmp\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036490 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036389    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-sys\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036490 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-metrics-client-ca\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036706 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036559    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-textfile\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036706 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036706 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-root\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.036706 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.036695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.137917 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.137830    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-metrics-client-ca\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.137917 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.137907    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-textfile\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.137939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.137969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-root\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138023    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-root\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138239 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5k5\" (UniqueName: \"kubernetes.io/projected/560c336b-52be-441e-be37-4d3c679955d0-kube-api-access-pg5k5\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138472 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138472 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138286    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-wtmp\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138472 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-sys\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138472 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138363    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-textfile\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138472 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138408    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-sys\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138702 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:43.138484    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 14 12:59:43.138702 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138541    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-wtmp\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138702 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138549    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-metrics-client-ca\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.138702 ip-10-0-129-167 kubenswrapper[2566]: E0914 12:59:43.138556    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls podName:560c336b-52be-441e-be37-4d3c679955d0 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:43.638537762 +0000 UTC m=+93.953321106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls") pod "node-exporter-gg9ln" (UID: "560c336b-52be-441e-be37-4d3c679955d0") : secret "node-exporter-tls" not found
Sep 14 12:59:43.138895 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.138724    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.140545 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.140525    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.150358 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.150332    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5k5\" (UniqueName: \"kubernetes.io/projected/560c336b-52be-441e-be37-4d3c679955d0-kube-api-access-pg5k5\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.643628 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.643591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.646149 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.646125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/560c336b-52be-441e-be37-4d3c679955d0-node-exporter-tls\") pod \"node-exporter-gg9ln\" (UID: \"560c336b-52be-441e-be37-4d3c679955d0\") " pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:43.786315 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:43.786270    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gg9ln"
Sep 14 12:59:44.663842 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.663797    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 12:59:44.666352 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.666328    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.671813 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.671694    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 12:59:44.672257 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.672079    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 12:59:44.673431 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.672955    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7s58v\""
Sep 14 12:59:44.673431 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.672958    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 12:59:44.673431 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.673272    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 12:59:44.673795 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.673751    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 12:59:44.682075 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.682033    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 12:59:44.686316 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.686290    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 12:59:44.754248 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754410 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754410 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754319    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754410 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tjp9\" (UniqueName: \"kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754582 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754433    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754582 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.754582 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.754509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855619 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855586    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855782 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855632    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjp9\" (UniqueName: \"kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855863 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855863 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.855970 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.856082 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.855973    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.856536 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.856508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.856666 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.856519    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.856755 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.856727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.856891 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.856868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.858999 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.858979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.859176 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.859149    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.869216 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.869197    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjp9\" (UniqueName: \"kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9\") pod \"console-7d8d657b5b-bkpq5\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") " pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:44.980074 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:44.980027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 12:59:45.012057 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.012013    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79757cc99d-w5swf"]
Sep 14 12:59:45.014807 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.014786    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.018647 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.018626    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 14 12:59:45.019199 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.019178    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 14 12:59:45.019464 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.019446    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q9tb8\""
Sep 14 12:59:45.019663 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.019630    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 14 12:59:45.019817 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.019694    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 14 12:59:45.019920 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.019901    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2i7aecd3qrc8a\""
Sep 14 12:59:45.025428 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.025408    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 14 12:59:45.045868 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.045842    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79757cc99d-w5swf"]
Sep 14 12:59:45.159682 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159642    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.159848 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159704    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.159848 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.159848 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/491f93fb-bb84-4eed-85bf-4404a81f060e-metrics-client-ca\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.159848 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.160099 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.160099 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-grpc-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.160099 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.159927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpdnd\" (UniqueName: \"kubernetes.io/projected/491f93fb-bb84-4eed-85bf-4404a81f060e-kube-api-access-mpdnd\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261411 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261411 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-grpc-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpdnd\" (UniqueName: \"kubernetes.io/projected/491f93fb-bb84-4eed-85bf-4404a81f060e-kube-api-access-mpdnd\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261621    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.261652 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.261651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/491f93fb-bb84-4eed-85bf-4404a81f060e-metrics-client-ca\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.262680 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.262628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/491f93fb-bb84-4eed-85bf-4404a81f060e-metrics-client-ca\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.264761 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.264565    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.264761 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.264695    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-grpc-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.264931 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.264761    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.264931 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.264847    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.265276 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.265242    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.265373 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.265276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/491f93fb-bb84-4eed-85bf-4404a81f060e-secret-thanos-querier-tls\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.272135 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.272104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpdnd\" (UniqueName: \"kubernetes.io/projected/491f93fb-bb84-4eed-85bf-4404a81f060e-kube-api-access-mpdnd\") pod \"thanos-querier-79757cc99d-w5swf\" (UID: \"491f93fb-bb84-4eed-85bf-4404a81f060e\") " pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:45.326127 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:45.326103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:47.345880 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.345846    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"]
Sep 14 12:59:47.348414 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.348391    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.363967 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.363903    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 14 12:59:47.364120 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.363903    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 14 12:59:47.364120 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.364037    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 14 12:59:47.364120 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.363903    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2vlehgouabm7q\""
Sep 14 12:59:47.364120 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.364064    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 14 12:59:47.364291 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.364124    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hwnpq\""
Sep 14 12:59:47.464343 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.464306    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"]
Sep 14 12:59:47.479766 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.479766 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9htl\" (UniqueName: \"kubernetes.io/projected/f2ec605b-a16f-42b9-9c39-859b933d447b-kube-api-access-t9htl\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.479979 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479807    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-client-certs\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.479979 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479884    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-metrics-server-audit-profiles\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.479979 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-client-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.480125 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.479985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2ec605b-a16f-42b9-9c39-859b933d447b-audit-log\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.480125 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.480027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-tls\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.580753 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.580715    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.580915 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.580773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9htl\" (UniqueName: \"kubernetes.io/projected/f2ec605b-a16f-42b9-9c39-859b933d447b-kube-api-access-t9htl\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.580915 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.580907    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-client-certs\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581024 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.580954    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-metrics-server-audit-profiles\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581024 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.580996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-client-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581151 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.581073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2ec605b-a16f-42b9-9c39-859b933d447b-audit-log\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581151 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.581121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-tls\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581579 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.581532    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2ec605b-a16f-42b9-9c39-859b933d447b-audit-log\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.581579 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.581543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.582243 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.582214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2ec605b-a16f-42b9-9c39-859b933d447b-metrics-server-audit-profiles\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.584282 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.584215    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-client-ca-bundle\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.584617 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.584593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-client-certs\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.584693 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.584593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2ec605b-a16f-42b9-9c39-859b933d447b-secret-metrics-server-tls\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.597685 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.597611    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9htl\" (UniqueName: \"kubernetes.io/projected/f2ec605b-a16f-42b9-9c39-859b933d447b-kube-api-access-t9htl\") pod \"metrics-server-7b44d4f56f-vx7dp\" (UID: \"f2ec605b-a16f-42b9-9c39-859b933d447b\") " pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:47.659072 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:47.659029    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 12:59:48.224555 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.224523    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-766cd66547-j4qcg"]
Sep 14 12:59:48.228861 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.228831    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.233319 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.233291    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 14 12:59:48.233482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.233291    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 14 12:59:48.233482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.233292    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 14 12:59:48.233653 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.233599    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xbs6t\""
Sep 14 12:59:48.233791 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.233773    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 14 12:59:48.238859 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.238835    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 14 12:59:48.243881 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.243861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 14 12:59:48.248894 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.248873    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-766cd66547-j4qcg"]
Sep 14 12:59:48.389062 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-serving-certs-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-metrics-client-ca\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389274    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389311    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-federate-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.389543 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.389449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcmzr\" (UniqueName: \"kubernetes.io/projected/d22d836a-a659-4f09-881f-a614c86b7e1e-kube-api-access-xcmzr\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490442 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490352    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490442 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcmzr\" (UniqueName: \"kubernetes.io/projected/d22d836a-a659-4f09-881f-a614c86b7e1e-kube-api-access-xcmzr\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-serving-certs-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-metrics-client-ca\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.490713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.490658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-federate-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.491391 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.491326    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-serving-certs-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.491526 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.491481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-metrics-client-ca\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.491613 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.491552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.493674 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.493647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-federate-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.493825 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.493788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.493985 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.493963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-secret-telemeter-client\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.494037 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.493986    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d22d836a-a659-4f09-881f-a614c86b7e1e-telemeter-client-tls\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.500525 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.500483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcmzr\" (UniqueName: \"kubernetes.io/projected/d22d836a-a659-4f09-881f-a614c86b7e1e-kube-api-access-xcmzr\") pod \"telemeter-client-766cd66547-j4qcg\" (UID: \"d22d836a-a659-4f09-881f-a614c86b7e1e\") " pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:48.539697 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:48.539663    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg"
Sep 14 12:59:50.264553 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.264482    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"]
Sep 14 12:59:50.274998 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.274972    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-766cd66547-j4qcg"]
Sep 14 12:59:50.277966 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.277947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79757cc99d-w5swf"]
Sep 14 12:59:50.280500 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.280482    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 12:59:50.309714 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:50.309693    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ec605b_a16f_42b9_9c39_859b933d447b.slice/crio-9720287a8ff15804f256eaf6626b002338b8662d872fefc62b4a9b2e5fac9e8f WatchSource:0}: Error finding container 9720287a8ff15804f256eaf6626b002338b8662d872fefc62b4a9b2e5fac9e8f: Status 404 returned error can't find the container with id 9720287a8ff15804f256eaf6626b002338b8662d872fefc62b4a9b2e5fac9e8f
Sep 14 12:59:50.310951 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:50.310878    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22d836a_a659_4f09_881f_a614c86b7e1e.slice/crio-7c1d360335a12d74738125a810df2b462934b8e3fc41696062ab87fb94e9ed6f WatchSource:0}: Error finding container 7c1d360335a12d74738125a810df2b462934b8e3fc41696062ab87fb94e9ed6f: Status 404 returned error can't find the container with id 7c1d360335a12d74738125a810df2b462934b8e3fc41696062ab87fb94e9ed6f
Sep 14 12:59:50.311481 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:50.311459    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491f93fb_bb84_4eed_85bf_4404a81f060e.slice/crio-66b1889376b6a48983193d367f06ac4e1d2a9bbf38f602fc89eda3e47af24277 WatchSource:0}: Error finding container 66b1889376b6a48983193d367f06ac4e1d2a9bbf38f602fc89eda3e47af24277: Status 404 returned error can't find the container with id 66b1889376b6a48983193d367f06ac4e1d2a9bbf38f602fc89eda3e47af24277
Sep 14 12:59:50.312856 ip-10-0-129-167 kubenswrapper[2566]: W0914 12:59:50.312836    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9df56fb_57a6_4cda_bc49_4282f56ebb23.slice/crio-acc2824b643e939242fed1a422e613e9e93a757a93c051b9fa7f77985485801d WatchSource:0}: Error finding container acc2824b643e939242fed1a422e613e9e93a757a93c051b9fa7f77985485801d: Status 404 returned error can't find the container with id acc2824b643e939242fed1a422e613e9e93a757a93c051b9fa7f77985485801d
Sep 14 12:59:50.703076 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.702856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c2dqr" event={"ID":"9dfb058b-046b-41a4-a3a7-f544609b1a43","Type":"ContainerStarted","Data":"1fd7b21675db1c73ee1ce7c61e3a8bfc6cef2292448edd9616b25b3d72017b82"}
Sep 14 12:59:50.703348 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.703289    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:50.704498 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.704439    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp" event={"ID":"f2ec605b-a16f-42b9-9c39-859b933d447b","Type":"ContainerStarted","Data":"9720287a8ff15804f256eaf6626b002338b8662d872fefc62b4a9b2e5fac9e8f"}
Sep 14 12:59:50.706125 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.706079    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"66b1889376b6a48983193d367f06ac4e1d2a9bbf38f602fc89eda3e47af24277"}
Sep 14 12:59:50.708113 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.708032    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gg9ln" event={"ID":"560c336b-52be-441e-be37-4d3c679955d0","Type":"ContainerStarted","Data":"e988d6dd21bfeceb6ff90e0268d5e71c56aaab411bffa18a20cb6a16c3dd9cdd"}
Sep 14 12:59:50.709878 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.709853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d657b5b-bkpq5" event={"ID":"b9df56fb-57a6-4cda-bc49-4282f56ebb23","Type":"ContainerStarted","Data":"acc2824b643e939242fed1a422e613e9e93a757a93c051b9fa7f77985485801d"}
Sep 14 12:59:50.711316 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.711292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg" event={"ID":"d22d836a-a659-4f09-881f-a614c86b7e1e","Type":"ContainerStarted","Data":"7c1d360335a12d74738125a810df2b462934b8e3fc41696062ab87fb94e9ed6f"}
Sep 14 12:59:50.714101 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.714072    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-c2dqr"
Sep 14 12:59:50.723026 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:50.722985    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-c2dqr" podStartSLOduration=1.810372848 podStartE2EDuration="19.722972181s" totalImagesPullingTime="17.912599333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:50.721450938 +0000 UTC m=+101.036234297" watchObservedRunningTime="2026-09-14 12:59:50.722972181 +0000 UTC m=+101.037755533"
Sep 14 12:59:51.721385 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:51.721342    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gg9ln" event={"ID":"560c336b-52be-441e-be37-4d3c679955d0","Type":"ContainerDied","Data":"f89f090d05d50f63204134c11899713a546317befe5ca31c10778be279da09c5"}
Sep 14 12:59:51.722199 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:51.721866    2566 generic.go:356] "Generic (PLEG): container finished" podID="560c336b-52be-441e-be37-4d3c679955d0" containerID="f89f090d05d50f63204134c11899713a546317befe5ca31c10778be279da09c5" exitCode=0
Sep 14 12:59:52.570784 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:52.570675    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z8qs7"
Sep 14 12:59:52.616192 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:52.616164    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:52.731412 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:52.731380    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gg9ln" event={"ID":"560c336b-52be-441e-be37-4d3c679955d0","Type":"ContainerStarted","Data":"9393309eb84c79afcab1447486052b6a196533deeb791e915e71b51f7876429a"}
Sep 14 12:59:52.731870 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:52.731434    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gg9ln" event={"ID":"560c336b-52be-441e-be37-4d3c679955d0","Type":"ContainerStarted","Data":"58cebb3e6307a9c583a31d39f4fba70805eca86a3951d03b28599ac4fd7d86b1"}
Sep 14 12:59:52.756144 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:52.756070    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gg9ln" podStartSLOduration=9.735511262 podStartE2EDuration="10.756035581s" totalImagesPullingTime="927.345771ms" totalInitContainerRuntime="93.178548ms" isStatefulPod=true podCreationTimestamp="2026-09-14 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:52.755647291 +0000 UTC m=+103.070430641" watchObservedRunningTime="2026-09-14 12:59:52.756035581 +0000 UTC m=+103.070818935"
Sep 14 12:59:53.623074 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:53.622870    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-798fc9666d-hg2ld"
Sep 14 12:59:57.636415 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.636118    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" podUID="5e8e74b6-9725-4216-9a27-156ec2506825" containerName="registry" containerID="cri-o://b1cb6b836155b3e6b7d259dbdf294260f20e91b07f3be97e6938b4aa833363b6" gracePeriod=30
Sep 14 12:59:57.756557 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.756504    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp" event={"ID":"f2ec605b-a16f-42b9-9c39-859b933d447b","Type":"ContainerStarted","Data":"ff29ca5fa967917bdc5a7b049ba54a7141b2b52502b217003c5e821d9b07db74"}
Sep 14 12:59:57.760352 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.760298    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"24ee02b88c1e4eb836dbca3ad1a8854c6182ad7ccaa82efe540ed3fcec64eb43"}
Sep 14 12:59:57.760598 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.760466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"7f0bca03007c9954e327284424511f98b98e69cedc8a9ddc60ea0885e1aefabd"}
Sep 14 12:59:57.760598 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.760516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"a2e5f59e1743998b4d3cba1ac8e13e94344309a4f1be99f1e96f1fb2074b89fe"}
Sep 14 12:59:57.762577 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.762547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d657b5b-bkpq5" event={"ID":"b9df56fb-57a6-4cda-bc49-4282f56ebb23","Type":"ContainerStarted","Data":"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"}
Sep 14 12:59:57.765142 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.765088    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg" event={"ID":"d22d836a-a659-4f09-881f-a614c86b7e1e","Type":"ContainerStarted","Data":"285929c45d7c57b344f097683ab67666c845573a1150ec5cfe289663ba468b90"}
Sep 14 12:59:57.767444 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.767405    2566 generic.go:356] "Generic (PLEG): container finished" podID="5e8e74b6-9725-4216-9a27-156ec2506825" containerID="b1cb6b836155b3e6b7d259dbdf294260f20e91b07f3be97e6938b4aa833363b6" exitCode=0
Sep 14 12:59:57.767544 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.767474    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" event={"ID":"5e8e74b6-9725-4216-9a27-156ec2506825","Type":"ContainerDied","Data":"b1cb6b836155b3e6b7d259dbdf294260f20e91b07f3be97e6938b4aa833363b6"}
Sep 14 12:59:57.780644 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.780587    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp" podStartSLOduration=4.366831099 podStartE2EDuration="10.780567517s" totalImagesPullingTime="6.413736418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:57.777168082 +0000 UTC m=+108.091951435" watchObservedRunningTime="2026-09-14 12:59:57.780567517 +0000 UTC m=+108.095350871"
Sep 14 12:59:57.804532 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:57.804462    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8d657b5b-bkpq5" podStartSLOduration=7.382265355 podStartE2EDuration="13.804437622s" totalImagesPullingTime="6.422172267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:57.802910452 +0000 UTC m=+108.117693805" watchObservedRunningTime="2026-09-14 12:59:57.804437622 +0000 UTC m=+108.119220996"
Sep 14 12:59:58.216305 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.216271    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:58.284304 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284261    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284313    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284361    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmlc9\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284397    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284450    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284482 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284469    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284721 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284508    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.284721 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.284549    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets\") pod \"5e8e74b6-9725-4216-9a27-156ec2506825\" (UID: \"5e8e74b6-9725-4216-9a27-156ec2506825\") "
Sep 14 12:59:58.285625 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.285574    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 12:59:58.285900 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.285854    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 12:59:58.291253 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.291223    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 12:59:58.298304 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.298235    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 12:59:58.299138 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.299107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 12:59:58.299241 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.299158    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 12:59:58.299241 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.299071    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 12:59:58.301157 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.301124    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9" (OuterVolumeSpecName: "kube-api-access-cmlc9") pod "5e8e74b6-9725-4216-9a27-156ec2506825" (UID: "5e8e74b6-9725-4216-9a27-156ec2506825"). InnerVolumeSpecName "kube-api-access-cmlc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 12:59:58.385557 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385517    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-bound-sa-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385557 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385557    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-registry-certificates\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385572    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e8e74b6-9725-4216-9a27-156ec2506825-ca-trust-extracted\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385586    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-installation-pull-secrets\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385600    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e8e74b6-9725-4216-9a27-156ec2506825-image-registry-private-configuration\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385615    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-registry-tls\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385627    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmlc9\" (UniqueName: \"kubernetes.io/projected/5e8e74b6-9725-4216-9a27-156ec2506825-kube-api-access-cmlc9\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.385798 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.385641    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e8e74b6-9725-4216-9a27-156ec2506825-trusted-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 12:59:58.774077 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.774035    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq"
Sep 14 12:59:58.774524 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.774085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df5fb9bd-mgjbq" event={"ID":"5e8e74b6-9725-4216-9a27-156ec2506825","Type":"ContainerDied","Data":"1a4638680078b496d1cc67ec5f785b3ef56c2b42c4fb121629f865f80ae047bb"}
Sep 14 12:59:58.774524 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.774146    2566 scope.go:117] "RemoveContainer" containerID="b1cb6b836155b3e6b7d259dbdf294260f20e91b07f3be97e6938b4aa833363b6"
Sep 14 12:59:58.800370 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.800339    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:59:58.810134 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:58.810104    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6df5fb9bd-mgjbq"]
Sep 14 12:59:59.386811 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.386740    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 12:59:59.781276 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.781240    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"1e6f27283be5617cc9684f2a594cfd517e43287c2b2fbc7b6fa4621208ae380a"}
Sep 14 12:59:59.781799 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.781317    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"624eab1b2e03714dbece708024a8387a17b4b124de330fbaf96418ad83637eb1"}
Sep 14 12:59:59.781799 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.781359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" event={"ID":"491f93fb-bb84-4eed-85bf-4404a81f060e","Type":"ContainerStarted","Data":"26176c16c25f79e0e8628a9212d5663a150a70b15a6b65cfb43aa69ebb31d38d"}
Sep 14 12:59:59.781799 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.781397    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 12:59:59.783327 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.783297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg" event={"ID":"d22d836a-a659-4f09-881f-a614c86b7e1e","Type":"ContainerStarted","Data":"1c243b0270f65906b42975567c28bb5b96709a7275b47918e5aa28fa18879ec9"}
Sep 14 12:59:59.783429 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.783340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg" event={"ID":"d22d836a-a659-4f09-881f-a614c86b7e1e","Type":"ContainerStarted","Data":"1d9cc13408b9f267d9c3e67c075222e72a096aa1ff28399460415e1bea6e572a"}
Sep 14 12:59:59.809713 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.809665    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf" podStartSLOduration=7.86036348 podStartE2EDuration="15.809648762s" totalImagesPullingTime="7.949285282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:59.806743409 +0000 UTC m=+110.121526762" watchObservedRunningTime="2026-09-14 12:59:59.809648762 +0000 UTC m=+110.124432111"
Sep 14 12:59:59.838489 ip-10-0-129-167 kubenswrapper[2566]: I0914 12:59:59.838447    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-766cd66547-j4qcg" podStartSLOduration=3.618087433 podStartE2EDuration="11.838434258s" totalImagesPullingTime="8.220346825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:59.836917285 +0000 UTC m=+110.151700636" watchObservedRunningTime="2026-09-14 12:59:59.838434258 +0000 UTC m=+110.153217609"
Sep 14 13:00:00.188623 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.188539    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e8e74b6-9725-4216-9a27-156ec2506825" path="/var/lib/kubelet/pods/5e8e74b6-9725-4216-9a27-156ec2506825/volumes"
Sep 14 13:00:00.861748 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.861711    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:00:00.862148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.862072    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e8e74b6-9725-4216-9a27-156ec2506825" containerName="registry"
Sep 14 13:00:00.862148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.862089    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e8e74b6-9725-4216-9a27-156ec2506825" containerName="registry"
Sep 14 13:00:00.862218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.862164    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e8e74b6-9725-4216-9a27-156ec2506825" containerName="registry"
Sep 14 13:00:00.878839 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.878808    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:00:00.878996 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.878926    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.907744 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.907710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5pmm\" (UniqueName: \"kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.907893 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.907754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.907893 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.907786    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.907979 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.907881    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.908076 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.908037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.908207 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.908179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:00.908360 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:00.908342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.009639 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.009793 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009659    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.009857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.009918 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5pmm\" (UniqueName: \"kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.009984 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.010030 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.009981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.010030 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.010014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.010502 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.010480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.010602 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.010508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.010772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.010753    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.012407 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.012388    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.012540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.012519    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.022883 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.022863    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.034890 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.034869    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5pmm\" (UniqueName: \"kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm\") pod \"console-56b56f7c87-m7kmj\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") " pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.188980 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.188893    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:01.474441 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.474423    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:00:01.476638 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:00:01.476570    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a8615_210d_4ed6_9c6e_e3445774e5e8.slice/crio-61c00fd3056824226d8a13bf46258b6e8ebce7b3e7c89132d4958a01b0f17e19 WatchSource:0}: Error finding container 61c00fd3056824226d8a13bf46258b6e8ebce7b3e7c89132d4958a01b0f17e19: Status 404 returned error can't find the container with id 61c00fd3056824226d8a13bf46258b6e8ebce7b3e7c89132d4958a01b0f17e19
Sep 14 13:00:01.792158 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.792075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b56f7c87-m7kmj" event={"ID":"cc7a8615-210d-4ed6-9c6e-e3445774e5e8","Type":"ContainerStarted","Data":"dd09bec81efc535e2187d885450e711be588938aa3c2b9e3b12b5a028e7db7f5"}
Sep 14 13:00:01.792158 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:01.792131    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b56f7c87-m7kmj" event={"ID":"cc7a8615-210d-4ed6-9c6e-e3445774e5e8","Type":"ContainerStarted","Data":"61c00fd3056824226d8a13bf46258b6e8ebce7b3e7c89132d4958a01b0f17e19"}
Sep 14 13:00:04.981124 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:04.981092    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 13:00:05.792620 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:05.792589    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79757cc99d-w5swf"
Sep 14 13:00:05.819435 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:05.819385    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b56f7c87-m7kmj" podStartSLOduration=5.819370786 podStartE2EDuration="5.819370786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:00:01.827029364 +0000 UTC m=+112.141812715" watchObservedRunningTime="2026-09-14 13:00:05.819370786 +0000 UTC m=+116.134154139"
Sep 14 13:00:07.659700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:07.659664    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 13:00:07.660105 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:07.659730    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 13:00:08.048751 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:08.048695    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lk29_3ef54ff3-e3ad-4732-9a69-a52d4f5d148e/serve-healthcheck-canary/0.log"
Sep 14 13:00:08.819944 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:08.819909    2566 generic.go:356] "Generic (PLEG): container finished" podID="56243070-e9e5-4c06-878a-2b66fea26332" containerID="5dcf89708c69703c6a6111336ab2f220e181e852d542b1b102edc38d6bcb25b7" exitCode=0
Sep 14 13:00:08.820330 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:08.819980    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5" event={"ID":"56243070-e9e5-4c06-878a-2b66fea26332","Type":"ContainerDied","Data":"5dcf89708c69703c6a6111336ab2f220e181e852d542b1b102edc38d6bcb25b7"}
Sep 14 13:00:08.820330 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:08.820328    2566 scope.go:117] "RemoveContainer" containerID="5dcf89708c69703c6a6111336ab2f220e181e852d542b1b102edc38d6bcb25b7"
Sep 14 13:00:09.825617 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:09.825582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-6jxk5" event={"ID":"56243070-e9e5-4c06-878a-2b66fea26332","Type":"ContainerStarted","Data":"3ffff6b8fa4ef53b6606ed4cb48b4dda2c56b7faebdda634628e7b39d077f122"}
Sep 14 13:00:11.189646 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:11.189615    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:11.190107 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:11.189663    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:11.194380 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:11.194359    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:11.836498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:11.836463    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:00:19.970267 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:19.970223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 13:00:19.972486 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:19.972461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/594b715e-ce54-4f93-832a-32827b632a0a-metrics-certs\") pod \"network-metrics-daemon-8hn27\" (UID: \"594b715e-ce54-4f93-832a-32827b632a0a\") " pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 13:00:20.107894 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:20.107861    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5b9s\""
Sep 14 13:00:20.115252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:20.115229    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hn27"
Sep 14 13:00:20.403506 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:20.403012    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hn27"]
Sep 14 13:00:20.870920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:20.870879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hn27" event={"ID":"594b715e-ce54-4f93-832a-32827b632a0a","Type":"ContainerStarted","Data":"6ff45ae18eefee6349a9afe27ad3ecbdc5cfaa051e8b419b974bd8278772681e"}
Sep 14 13:00:21.877394 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:21.877357    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hn27" event={"ID":"594b715e-ce54-4f93-832a-32827b632a0a","Type":"ContainerStarted","Data":"82c8d0d21aaaf5eaeb4cc3c0a1c6cf9657b2cb297576dbf604f097716e84764c"}
Sep 14 13:00:21.877754 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:21.877411    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hn27" event={"ID":"594b715e-ce54-4f93-832a-32827b632a0a","Type":"ContainerStarted","Data":"7e996099780654d15a6a9b38e77c3a9681e754e81a0019c0976982745e57312f"}
Sep 14 13:00:21.898364 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:21.898298    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8hn27" podStartSLOduration=130.95911887 podStartE2EDuration="2m11.898275384s" totalImagesPullingTime="939.156514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:00:21.896600213 +0000 UTC m=+132.211383567" watchObservedRunningTime="2026-09-14 13:00:21.898275384 +0000 UTC m=+132.213058737"
Sep 14 13:00:24.802059 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:24.802006    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d8d657b5b-bkpq5" podUID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" containerName="console" containerID="cri-o://1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08" gracePeriod=15
Sep 14 13:00:24.891170 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:24.891144    2566 generic.go:356] "Generic (PLEG): container finished" podID="44f52b1b-d570-4eea-9fcd-3f9a90a5cca0" containerID="4eee09ff5e8a7c05833d8ab232a6875ea5efb5c48f4e6047b3bdeb78376548eb" exitCode=0
Sep 14 13:00:24.891273 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:24.891188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m" event={"ID":"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0","Type":"ContainerDied","Data":"4eee09ff5e8a7c05833d8ab232a6875ea5efb5c48f4e6047b3bdeb78376548eb"}
Sep 14 13:00:24.891432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:24.891420    2566 scope.go:117] "RemoveContainer" containerID="4eee09ff5e8a7c05833d8ab232a6875ea5efb5c48f4e6047b3bdeb78376548eb"
Sep 14 13:00:25.079414 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.079355    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 13:00:25.212237 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212211    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212263    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212296    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tjp9\" (UniqueName: \"kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212327    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212355    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212410    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212435    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config\") pod \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\" (UID: \"b9df56fb-57a6-4cda-bc49-4282f56ebb23\") "
Sep 14 13:00:25.212696 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212583    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:25.212745 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212695    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-oauth-serving-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.212745 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212724    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:25.212842 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212782    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config" (OuterVolumeSpecName: "console-config") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:25.212842 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.212793    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca" (OuterVolumeSpecName: "service-ca") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:25.214650 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.214624    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:25.214763 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.214652    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:25.214823 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.214753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9" (OuterVolumeSpecName: "kube-api-access-2tjp9") pod "b9df56fb-57a6-4cda-bc49-4282f56ebb23" (UID: "b9df56fb-57a6-4cda-bc49-4282f56ebb23"). InnerVolumeSpecName "kube-api-access-2tjp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:25.313535 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313509    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-trusted-ca-bundle\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.313637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313536    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tjp9\" (UniqueName: \"kubernetes.io/projected/b9df56fb-57a6-4cda-bc49-4282f56ebb23-kube-api-access-2tjp9\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.313637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313553    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.313637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313567    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9df56fb-57a6-4cda-bc49-4282f56ebb23-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.313637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313579    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-serving-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.313637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.313593    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9df56fb-57a6-4cda-bc49-4282f56ebb23-console-oauth-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:00:25.896207 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.896171    2566 generic.go:356] "Generic (PLEG): container finished" podID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" containerID="1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08" exitCode=0
Sep 14 13:00:25.896621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.896216    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d657b5b-bkpq5"
Sep 14 13:00:25.896621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.896250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d657b5b-bkpq5" event={"ID":"b9df56fb-57a6-4cda-bc49-4282f56ebb23","Type":"ContainerDied","Data":"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"}
Sep 14 13:00:25.896621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.896314    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d657b5b-bkpq5" event={"ID":"b9df56fb-57a6-4cda-bc49-4282f56ebb23","Type":"ContainerDied","Data":"acc2824b643e939242fed1a422e613e9e93a757a93c051b9fa7f77985485801d"}
Sep 14 13:00:25.896621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.896346    2566 scope.go:117] "RemoveContainer" containerID="1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"
Sep 14 13:00:25.898356 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.898330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7wx2m" event={"ID":"44f52b1b-d570-4eea-9fcd-3f9a90a5cca0","Type":"ContainerStarted","Data":"856e3a9eceec6557d0205f8d9d274133f631f7ad739622657be42e736eb83011"}
Sep 14 13:00:25.905032 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.905012    2566 scope.go:117] "RemoveContainer" containerID="1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"
Sep 14 13:00:25.905318 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:00:25.905298    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08\": container with ID starting with 1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08 not found: ID does not exist" containerID="1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"
Sep 14 13:00:25.905370 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.905325    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08"} err="failed to get container status \"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08\": rpc error: code = NotFound desc = could not find container \"1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08\": container with ID starting with 1fef0984df733dc277ad2f3f42c9c08a367cfc9056eb31c5bd2fcd023ae9eb08 not found: ID does not exist"
Sep 14 13:00:25.929212 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.929190    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 13:00:25.936277 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:25.936255    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8d657b5b-bkpq5"]
Sep 14 13:00:26.189083 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:26.189006    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" path="/var/lib/kubelet/pods/b9df56fb-57a6-4cda-bc49-4282f56ebb23/volumes"
Sep 14 13:00:27.664911 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:27.664883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 13:00:27.668682 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:00:27.668657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b44d4f56f-vx7dp"
Sep 14 13:01:15.026700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:15.026662    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:01:40.045639 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.045587    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56b56f7c87-m7kmj" podUID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" containerName="console" containerID="cri-o://dd09bec81efc535e2187d885450e711be588938aa3c2b9e3b12b5a028e7db7f5" gracePeriod=15
Sep 14 13:01:40.200446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.200410    2566 generic.go:356] "Generic (PLEG): container finished" podID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" containerID="dd09bec81efc535e2187d885450e711be588938aa3c2b9e3b12b5a028e7db7f5" exitCode=0
Sep 14 13:01:40.200618 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.200473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b56f7c87-m7kmj" event={"ID":"cc7a8615-210d-4ed6-9c6e-e3445774e5e8","Type":"ContainerDied","Data":"dd09bec81efc535e2187d885450e711be588938aa3c2b9e3b12b5a028e7db7f5"}
Sep 14 13:01:40.283458 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.283433    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:01:40.363298 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363241    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363298 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363283    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5pmm\" (UniqueName: \"kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363325    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363353    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363381    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363407    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363449    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle\") pod \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\" (UID: \"cc7a8615-210d-4ed6-9c6e-e3445774e5e8\") "
Sep 14 13:01:40.363823 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363737    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:40.363877 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363847    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:40.363936 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363857    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config" (OuterVolumeSpecName: "console-config") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:40.363936 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.363918    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:40.365524 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.365502    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:40.365624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.365521    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm" (OuterVolumeSpecName: "kube-api-access-f5pmm") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "kube-api-access-f5pmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:01:40.365624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.365565    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc7a8615-210d-4ed6-9c6e-e3445774e5e8" (UID: "cc7a8615-210d-4ed6-9c6e-e3445774e5e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:40.464456 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464420    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5pmm\" (UniqueName: \"kubernetes.io/projected/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-kube-api-access-f5pmm\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464456 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464453    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464456 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464463    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464471    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-serving-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464479    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-console-oauth-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464489    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-trusted-ca-bundle\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:40.464638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:40.464496    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a8615-210d-4ed6-9c6e-e3445774e5e8-oauth-serving-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:01:41.205919 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:41.205885    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b56f7c87-m7kmj"
Sep 14 13:01:41.205919 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:41.205905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b56f7c87-m7kmj" event={"ID":"cc7a8615-210d-4ed6-9c6e-e3445774e5e8","Type":"ContainerDied","Data":"61c00fd3056824226d8a13bf46258b6e8ebce7b3e7c89132d4958a01b0f17e19"}
Sep 14 13:01:41.206479 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:41.205976    2566 scope.go:117] "RemoveContainer" containerID="dd09bec81efc535e2187d885450e711be588938aa3c2b9e3b12b5a028e7db7f5"
Sep 14 13:01:41.227759 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:41.227734    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:01:41.230324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:41.230302    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b56f7c87-m7kmj"]
Sep 14 13:01:42.189214 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:01:42.189182    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" path="/var/lib/kubelet/pods/cc7a8615-210d-4ed6-9c6e-e3445774e5e8/volumes"
Sep 14 13:03:10.097765 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:03:10.097733    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:03:10.102238 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:03:10.102212    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:03:10.109972 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:03:10.109943    2566 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 13:04:20.004218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004139    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mlsqp"]
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004454    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" containerName="console"
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004466    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" containerName="console"
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004482    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" containerName="console"
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004488    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" containerName="console"
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004548    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a8615-210d-4ed6-9c6e-e3445774e5e8" containerName="console"
Sep 14 13:04:20.004644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.004558    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9df56fb-57a6-4cda-bc49-4282f56ebb23" containerName="console"
Sep 14 13:04:20.006510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.006489    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.009323 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.009302    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-54zqm\""
Sep 14 13:04:20.010515 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.010498    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 14 13:04:20.010628 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.010497    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 14 13:04:20.020264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.020243    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mlsqp"]
Sep 14 13:04:20.076005 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.075980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.076117 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.076006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5z5\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-kube-api-access-4m5z5\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.177372 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.177345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.177472 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.177377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5z5\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-kube-api-access-4m5z5\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.196762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.196737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5z5\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-kube-api-access-4m5z5\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.196915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.196898    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43d77cf5-3b9f-4bee-a756-511f9fa16d3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mlsqp\" (UID: \"43d77cf5-3b9f-4bee-a756-511f9fa16d3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.328280 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.328230    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:20.608962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.608938    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mlsqp"]
Sep 14 13:04:20.611501 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:04:20.611473    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43d77cf5_3b9f_4bee_a756_511f9fa16d3e.slice/crio-9f9a9199d51e571330e1b18ae4d03e8cd79cae0bd2d4a1809a0e4acbfdac2d8a WatchSource:0}: Error finding container 9f9a9199d51e571330e1b18ae4d03e8cd79cae0bd2d4a1809a0e4acbfdac2d8a: Status 404 returned error can't find the container with id 9f9a9199d51e571330e1b18ae4d03e8cd79cae0bd2d4a1809a0e4acbfdac2d8a
Sep 14 13:04:20.613359 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.613340    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:04:20.783862 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:20.783828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp" event={"ID":"43d77cf5-3b9f-4bee-a756-511f9fa16d3e","Type":"ContainerStarted","Data":"9f9a9199d51e571330e1b18ae4d03e8cd79cae0bd2d4a1809a0e4acbfdac2d8a"}
Sep 14 13:04:23.797128 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:23.797035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp" event={"ID":"43d77cf5-3b9f-4bee-a756-511f9fa16d3e","Type":"ContainerStarted","Data":"cd619103d18faf555d7bce3c5e0c722f4a220a3b6e1f20fa481f609d1d24745d"}
Sep 14 13:04:23.797455 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:23.797160    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:23.817171 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:23.817124    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp" podStartSLOduration=1.9691912089999999 podStartE2EDuration="4.817111027s" totalImagesPullingTime="2.847919818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:23.816388121 +0000 UTC m=+374.131171473" watchObservedRunningTime="2026-09-14 13:04:23.817111027 +0000 UTC m=+374.131894379"
Sep 14 13:04:29.403861 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.403828    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"]
Sep 14 13:04:29.405970 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.405951    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.409258 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.409237    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 14 13:04:29.409834 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.409809    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 14 13:04:29.409930 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.409844    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-52w9f\""
Sep 14 13:04:29.419128 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.419110    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"]
Sep 14 13:04:29.550526 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.550494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brsvd\" (UniqueName: \"kubernetes.io/projected/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-kube-api-access-brsvd\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.550674 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.550579    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.651869 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.651839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsvd\" (UniqueName: \"kubernetes.io/projected/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-kube-api-access-brsvd\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.651952 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.651902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.652225 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.652207    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.667431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.667377    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brsvd\" (UniqueName: \"kubernetes.io/projected/cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217-kube-api-access-brsvd\") pod \"openshift-lws-operator-fd8ccff4c-pjszz\" (UID: \"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.715275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.715255    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"
Sep 14 13:04:29.802700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.802677    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mlsqp"
Sep 14 13:04:29.986257 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:29.986234    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz"]
Sep 14 13:04:29.988466 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:04:29.988436    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb1eb7e5_a549_4a1d_b49a_f9f1c44d2217.slice/crio-f1fa6cafc05a9e336c6affc01cd8a7af5d5c0c6094755a4b368b301d42a44ecd WatchSource:0}: Error finding container f1fa6cafc05a9e336c6affc01cd8a7af5d5c0c6094755a4b368b301d42a44ecd: Status 404 returned error can't find the container with id f1fa6cafc05a9e336c6affc01cd8a7af5d5c0c6094755a4b368b301d42a44ecd
Sep 14 13:04:30.826082 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:30.826028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz" event={"ID":"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217","Type":"ContainerStarted","Data":"f1fa6cafc05a9e336c6affc01cd8a7af5d5c0c6094755a4b368b301d42a44ecd"}
Sep 14 13:04:32.835698 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:32.835613    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz" event={"ID":"cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217","Type":"ContainerStarted","Data":"deb061faedbe5502bc0613541116a96cf45b0be7a672c1dd3479d54b457408eb"}
Sep 14 13:04:32.854494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:32.854447    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjszz" podStartSLOduration=1.366264402 podStartE2EDuration="3.854433399s" totalImagesPullingTime="2.488168997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:32.853568355 +0000 UTC m=+383.168351719" watchObservedRunningTime="2026-09-14 13:04:32.854433399 +0000 UTC m=+383.169216751"
Sep 14 13:04:39.890791 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.890759    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c766d5bc7-658pt"]
Sep 14 13:04:39.893965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.893933    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:39.896828 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.896807    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 13:04:39.898029 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.898007    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7s58v\""
Sep 14 13:04:39.898150 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.898031    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 13:04:39.898150 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.898062    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 13:04:39.898150 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.898102    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 13:04:39.898281 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.898155    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 13:04:39.902435 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.902415    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 13:04:39.906973 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:39.906952    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c766d5bc7-658pt"]
Sep 14 13:04:40.033317 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033336    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033361    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-oauth-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-oauth-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033440    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-service-ca\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033455    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfdxx\" (UniqueName: \"kubernetes.io/projected/8554b7e2-7cd2-465a-884a-199860f0d3ee-kube-api-access-dfdxx\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.033630 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.033475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-trusted-ca-bundle\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.133805 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-service-ca\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.133805 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfdxx\" (UniqueName: \"kubernetes.io/projected/8554b7e2-7cd2-465a-884a-199860f0d3ee-kube-api-access-dfdxx\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-trusted-ca-bundle\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.133945    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-oauth-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.134005    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-oauth-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134663 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.134635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-service-ca\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.134645    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-oauth-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.134724    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.134755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.134733    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8554b7e2-7cd2-465a-884a-199860f0d3ee-trusted-ca-bundle\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.136397 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.136378    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-serving-cert\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.136468 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.136404    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8554b7e2-7cd2-465a-884a-199860f0d3ee-console-oauth-config\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.144086 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.144025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfdxx\" (UniqueName: \"kubernetes.io/projected/8554b7e2-7cd2-465a-884a-199860f0d3ee-kube-api-access-dfdxx\") pod \"console-5c766d5bc7-658pt\" (UID: \"8554b7e2-7cd2-465a-884a-199860f0d3ee\") " pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.204561 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.204539    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:40.480984 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.480956    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c766d5bc7-658pt"]
Sep 14 13:04:40.483602 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:04:40.483575    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8554b7e2_7cd2_465a_884a_199860f0d3ee.slice/crio-85cc903df20d3f98f7cc001abb0316462fbd7efc330bc5ef25783a3596edda6e WatchSource:0}: Error finding container 85cc903df20d3f98f7cc001abb0316462fbd7efc330bc5ef25783a3596edda6e: Status 404 returned error can't find the container with id 85cc903df20d3f98f7cc001abb0316462fbd7efc330bc5ef25783a3596edda6e
Sep 14 13:04:40.868469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.868375    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c766d5bc7-658pt" event={"ID":"8554b7e2-7cd2-465a-884a-199860f0d3ee","Type":"ContainerStarted","Data":"e8e06f066491469d38053374591f26075e98d85d206035ab068b6fd0c3565906"}
Sep 14 13:04:40.868469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.868435    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c766d5bc7-658pt" event={"ID":"8554b7e2-7cd2-465a-884a-199860f0d3ee","Type":"ContainerStarted","Data":"85cc903df20d3f98f7cc001abb0316462fbd7efc330bc5ef25783a3596edda6e"}
Sep 14 13:04:40.887336 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:40.887286    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c766d5bc7-658pt" podStartSLOduration=1.887268801 podStartE2EDuration="1.887268801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:40.886003514 +0000 UTC m=+391.200786868" watchObservedRunningTime="2026-09-14 13:04:40.887268801 +0000 UTC m=+391.202052150"
Sep 14 13:04:50.204741 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:50.204712    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:50.205180 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:50.204764    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:50.209568 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:50.209544    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:50.909603 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:50.909572    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c766d5bc7-658pt"
Sep 14 13:04:51.074385 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.074349    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"]
Sep 14 13:04:51.080762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.080732    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.084377 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.084358    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l77cj\""
Sep 14 13:04:51.084590 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.084573    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 13:04:51.084646 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.084612    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 13:04:51.085132 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.085117    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 13:04:51.102079 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.102058    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 13:04:51.115144 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.115114    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"]
Sep 14 13:04:51.223562 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.223526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.223923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.223591    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.223923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.223647    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.223923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.223755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7b5b\" (UniqueName: \"kubernetes.io/projected/1d989fc8-761f-44e9-9c57-f8c34eb25994-kube-api-access-q7b5b\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.223923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.223784    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325170 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7b5b\" (UniqueName: \"kubernetes.io/projected/1d989fc8-761f-44e9-9c57-f8c34eb25994-kube-api-access-q7b5b\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325294    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.325601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.325579    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.327576 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.327548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d989fc8-761f-44e9-9c57-f8c34eb25994-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.327719 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.327676    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.327846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.327825    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d989fc8-761f-44e9-9c57-f8c34eb25994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.347010 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.346984    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7b5b\" (UniqueName: \"kubernetes.io/projected/1d989fc8-761f-44e9-9c57-f8c34eb25994-kube-api-access-q7b5b\") pod \"opendatahub-operator-controller-manager-b94df8b4-vsjp2\" (UID: \"1d989fc8-761f-44e9-9c57-f8c34eb25994\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.390524 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.390498    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:51.683783 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.683759    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"]
Sep 14 13:04:51.686299 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:04:51.686272    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d989fc8_761f_44e9_9c57_f8c34eb25994.slice/crio-e427611f0399d9f120c06998b3859a57cdac058587cf0f5afb5f46268cfd8553 WatchSource:0}: Error finding container e427611f0399d9f120c06998b3859a57cdac058587cf0f5afb5f46268cfd8553: Status 404 returned error can't find the container with id e427611f0399d9f120c06998b3859a57cdac058587cf0f5afb5f46268cfd8553
Sep 14 13:04:51.910837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:51.910802    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2" event={"ID":"1d989fc8-761f-44e9-9c57-f8c34eb25994","Type":"ContainerStarted","Data":"e427611f0399d9f120c06998b3859a57cdac058587cf0f5afb5f46268cfd8553"}
Sep 14 13:04:55.936186 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:55.936154    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2" event={"ID":"1d989fc8-761f-44e9-9c57-f8c34eb25994","Type":"ContainerStarted","Data":"eeb7e0016cde2776b86b28916e79b7c7a38fb12a32aa66df7fa04b6ba26db144"}
Sep 14 13:04:56.941343 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:56.941310    2566 generic.go:356] "Generic (PLEG): container finished" podID="1d989fc8-761f-44e9-9c57-f8c34eb25994" containerID="eeb7e0016cde2776b86b28916e79b7c7a38fb12a32aa66df7fa04b6ba26db144" exitCode=0
Sep 14 13:04:56.941721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:56.941397    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2" event={"ID":"1d989fc8-761f-44e9-9c57-f8c34eb25994","Type":"ContainerDied","Data":"eeb7e0016cde2776b86b28916e79b7c7a38fb12a32aa66df7fa04b6ba26db144"}
Sep 14 13:04:57.947762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:57.947732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2" event={"ID":"1d989fc8-761f-44e9-9c57-f8c34eb25994","Type":"ContainerStarted","Data":"5d8fe0fd8dccd6d5bbf72d14cbc86bb0b210d58faea73d8383a2d68fe12093e3"}
Sep 14 13:04:57.948136 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:57.947834    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:04:57.980621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:04:57.980573    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2" podStartSLOduration=2.316752471 podStartE2EDuration="6.98055683s" totalImagesPullingTime="3.662676403s" totalInitContainerRuntime="1.001127956s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:57.978844914 +0000 UTC m=+408.293628265" watchObservedRunningTime="2026-09-14 13:04:57.98055683 +0000 UTC m=+408.295340180"
Sep 14 13:05:08.773460 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.773421    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"]
Sep 14 13:05:08.775606 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.775588    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.778623 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.778598    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jzgpz\""
Sep 14 13:05:08.779578 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.779557    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 14 13:05:08.779665 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.779625    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 14 13:05:08.779733 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.779627    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 14 13:05:08.791037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.791010    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"]
Sep 14 13:05:08.870695 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.870657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.870867 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.870724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.870867 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.870761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.870867 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.870776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ncl\" (UniqueName: \"kubernetes.io/projected/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-kube-api-access-h7ncl\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.954865 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.954840    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-vsjp2"
Sep 14 13:05:08.971216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.971181    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.971381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.971264    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.971381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.971288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.971381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.971303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ncl\" (UniqueName: \"kubernetes.io/projected/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-kube-api-access-h7ncl\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.971991 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.971969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.973837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.973811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.973965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.973867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:08.982987 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:08.982963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ncl\" (UniqueName: \"kubernetes.io/projected/ebe20a8d-cd26-46c7-8a44-0d96bb499f7e-kube-api-access-h7ncl\") pod \"lws-controller-manager-6b9c8bb87f-n6swm\" (UID: \"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:09.084699 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:09.084607    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:09.359968 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:09.359882    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"]
Sep 14 13:05:09.362157 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:05:09.362130    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe20a8d_cd26_46c7_8a44_0d96bb499f7e.slice/crio-9f65d904ffd462b4e0d52310ddfa6ae7fced89660b3a992d6e17bc3922b08cd5 WatchSource:0}: Error finding container 9f65d904ffd462b4e0d52310ddfa6ae7fced89660b3a992d6e17bc3922b08cd5: Status 404 returned error can't find the container with id 9f65d904ffd462b4e0d52310ddfa6ae7fced89660b3a992d6e17bc3922b08cd5
Sep 14 13:05:10.000721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:10.000677    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm" event={"ID":"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e","Type":"ContainerStarted","Data":"9f65d904ffd462b4e0d52310ddfa6ae7fced89660b3a992d6e17bc3922b08cd5"}
Sep 14 13:05:11.006915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:11.006871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm" event={"ID":"ebe20a8d-cd26-46c7-8a44-0d96bb499f7e","Type":"ContainerStarted","Data":"a35eafe0bbe42a19aea6abe2e8833220d79a53b7d5440ed1fddd300fe0cbfe19"}
Sep 14 13:05:11.007353 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:11.006930    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:11.069400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:11.069343    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm" podStartSLOduration=1.892664587 podStartE2EDuration="3.069324067s" totalImagesPullingTime="1.17665948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:11.048611454 +0000 UTC m=+421.363394805" watchObservedRunningTime="2026-09-14 13:05:11.069324067 +0000 UTC m=+421.384107419"
Sep 14 13:05:21.982207 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:21.982171    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vbxnz"]
Sep 14 13:05:21.984448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:21.984427    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:21.987182 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:21.987163    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 14 13:05:21.987370 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:21.987359    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fkqq8\""
Sep 14 13:05:21.997620 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:21.997600    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vbxnz"]
Sep 14 13:05:22.013957 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.013937    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-n6swm"
Sep 14 13:05:22.076976 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.076902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjwsl\" (UniqueName: \"kubernetes.io/projected/881cdc8e-58c5-4118-81d2-49688162dd4e-kube-api-access-qjwsl\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.077225 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.076986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.178081 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.178039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjwsl\" (UniqueName: \"kubernetes.io/projected/881cdc8e-58c5-4118-81d2-49688162dd4e-kube-api-access-qjwsl\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.178234 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.178102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.178234 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:05:22.178193    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 14 13:05:22.178353 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:05:22.178260    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert podName:881cdc8e-58c5-4118-81d2-49688162dd4e nodeName:}" failed. No retries permitted until 2026-09-14 13:05:22.678239277 +0000 UTC m=+432.993022620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert") pod "odh-model-controller-7998c67dc4-vbxnz" (UID: "881cdc8e-58c5-4118-81d2-49688162dd4e") : secret "odh-model-controller-webhook-cert" not found
Sep 14 13:05:22.189382 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.189357    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjwsl\" (UniqueName: \"kubernetes.io/projected/881cdc8e-58c5-4118-81d2-49688162dd4e-kube-api-access-qjwsl\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.682540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.682505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.684820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.684798    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881cdc8e-58c5-4118-81d2-49688162dd4e-cert\") pod \"odh-model-controller-7998c67dc4-vbxnz\" (UID: \"881cdc8e-58c5-4118-81d2-49688162dd4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.706266 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.706238    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j8s4d"]
Sep 14 13:05:22.708397 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.708382    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.710946 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.710925    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lbsbs\""
Sep 14 13:05:22.711153 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.711136    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 14 13:05:22.720622 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.720601    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j8s4d"]
Sep 14 13:05:22.783348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.783321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvjrk\" (UniqueName: \"kubernetes.io/projected/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-kube-api-access-mvjrk\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.783483 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.783402    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-tls-certs\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.883965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.883938    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-tls-certs\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.884123 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.883977    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvjrk\" (UniqueName: \"kubernetes.io/projected/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-kube-api-access-mvjrk\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.886311 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.886291    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-tls-certs\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:22.894162 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.894138    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:22.896645 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:22.896623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvjrk\" (UniqueName: \"kubernetes.io/projected/20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b-kube-api-access-mvjrk\") pod \"model-serving-api-54d89bd5fc-j8s4d\" (UID: \"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b\") " pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:23.018638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.018597    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:23.162232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.162204    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vbxnz"]
Sep 14 13:05:23.163952 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:05:23.163926    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881cdc8e_58c5_4118_81d2_49688162dd4e.slice/crio-6681bd0968060940cf9a08392fed91a75953e946ef30944b20046e1be3095417 WatchSource:0}: Error finding container 6681bd0968060940cf9a08392fed91a75953e946ef30944b20046e1be3095417: Status 404 returned error can't find the container with id 6681bd0968060940cf9a08392fed91a75953e946ef30944b20046e1be3095417
Sep 14 13:05:23.288366 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.288345    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j8s4d"]
Sep 14 13:05:23.290459 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:05:23.290434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bb176b_8e4e_4aa5_9315_dbb0ca4cf78b.slice/crio-a7a34b863c2bc225fb611cd1d593486fa3ddff7c94b9b96458b03e94a0e5dc4f WatchSource:0}: Error finding container a7a34b863c2bc225fb611cd1d593486fa3ddff7c94b9b96458b03e94a0e5dc4f: Status 404 returned error can't find the container with id a7a34b863c2bc225fb611cd1d593486fa3ddff7c94b9b96458b03e94a0e5dc4f
Sep 14 13:05:23.326303 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.326274    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"]
Sep 14 13:05:23.329173 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.329157    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.331927 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.331874    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 13:05:23.332059 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.331936    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 13:05:23.332059 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.332024    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 13:05:23.332174 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.332026    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-slfw7\""
Sep 14 13:05:23.343279 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.343261    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"]
Sep 14 13:05:23.388163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388143    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388287 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388204    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388287 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419d5a71-612c-471d-b29a-d6767371f78b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388337    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388367    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419d5a71-612c-471d-b29a-d6767371f78b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388419    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xddw\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-kube-api-access-6xddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.388544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.388508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.489764 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.489735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.489764 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.489768    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.489942 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.489790    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.489942 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.489914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.489984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419d5a71-612c-471d-b29a-d6767371f78b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490195 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419d5a71-612c-471d-b29a-d6767371f78b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490195 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490195 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xddw\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-kube-api-access-6xddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490532 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490454    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490523    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490680 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.490817 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.490797    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/419d5a71-612c-471d-b29a-d6767371f78b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.492102 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.492074    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/419d5a71-612c-471d-b29a-d6767371f78b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.492372 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.492353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/419d5a71-612c-471d-b29a-d6767371f78b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.498073 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.498035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.498216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.498195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xddw\" (UniqueName: \"kubernetes.io/projected/419d5a71-612c-471d-b29a-d6767371f78b-kube-api-access-6xddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c\" (UID: \"419d5a71-612c-471d-b29a-d6767371f78b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.640276 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.640226    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:23.921617 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:23.918079    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"]
Sep 14 13:05:24.064912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:24.064875    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d" event={"ID":"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b","Type":"ContainerStarted","Data":"a7a34b863c2bc225fb611cd1d593486fa3ddff7c94b9b96458b03e94a0e5dc4f"}
Sep 14 13:05:24.066417 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:24.066374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" event={"ID":"881cdc8e-58c5-4118-81d2-49688162dd4e","Type":"ContainerStarted","Data":"6681bd0968060940cf9a08392fed91a75953e946ef30944b20046e1be3095417"}
Sep 14 13:05:24.067798 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:24.067766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c" event={"ID":"419d5a71-612c-471d-b29a-d6767371f78b","Type":"ContainerStarted","Data":"db715792da27fc96415217ffab7280a0bddfbd28630bcff46a782594286f5428"}
Sep 14 13:05:28.394264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:28.394105    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:05:28.394264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:28.394170    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:05:28.394264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:28.394198    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:05:29.095353 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.095313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c" event={"ID":"419d5a71-612c-471d-b29a-d6767371f78b","Type":"ContainerStarted","Data":"a52987ea5d43bededf24450d7045e67c80678988af489331260dbb7af1b201ca"}
Sep 14 13:05:29.096850 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.096828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d" event={"ID":"20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b","Type":"ContainerStarted","Data":"36988f0c8053c2bc92a0205ea1f16f6cb8431feb0b4c11c875c44158822f25e7"}
Sep 14 13:05:29.096947 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.096878    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:05:29.098253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.098229    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" event={"ID":"881cdc8e-58c5-4118-81d2-49688162dd4e","Type":"ContainerStarted","Data":"3131e260dc5ac465efc3c7ace99cda111983a4c3aa698356e5af5984520c9b22"}
Sep 14 13:05:29.098367 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.098354    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:29.149909 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.149856    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c" podStartSLOduration=1.680214205 podStartE2EDuration="6.149841912s" totalImagesPullingTime="4.469627707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:29.145758848 +0000 UTC m=+439.460542200" watchObservedRunningTime="2026-09-14 13:05:29.149841912 +0000 UTC m=+439.464625301"
Sep 14 13:05:29.193886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.193827    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" podStartSLOduration=3.037593117 podStartE2EDuration="8.193812136s" totalImagesPullingTime="5.156219019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:29.192887081 +0000 UTC m=+439.507670434" watchObservedRunningTime="2026-09-14 13:05:29.193812136 +0000 UTC m=+439.508595487"
Sep 14 13:05:29.194451 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.194424    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d" podStartSLOduration=2.165959114 podStartE2EDuration="7.194414129s" totalImagesPullingTime="5.028455015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:29.170002012 +0000 UTC m=+439.484785364" watchObservedRunningTime="2026-09-14 13:05:29.194414129 +0000 UTC m=+439.509197481"
Sep 14 13:05:29.641436 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.641396    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:29.710442 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.710414    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:29.753307 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.753275    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"]
Sep 14 13:05:29.761239 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.761216    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.764406 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.764388    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hv4d8\""
Sep 14 13:05:29.764849 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.764836    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 14 13:05:29.764892 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.764851    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 14 13:05:29.765335 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.765321    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 14 13:05:29.773751 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.773729    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"]
Sep 14 13:05:29.852929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.852897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853087 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.852936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853087 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.853029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853172 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.853103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b69bc9-8369-47e9-be9e-a656835a851f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853172 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.853127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853172 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.853163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.853263 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.853185    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q8w7\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-kube-api-access-4q8w7\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.953824 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.953796    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.953979 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.953832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b69bc9-8369-47e9-be9e-a656835a851f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.953979 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.953849    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.954084 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.953976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.954084 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.954015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q8w7\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-kube-api-access-4q8w7\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.954169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.954081    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.954169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.954128    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.954679 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.954648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.956387 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.956367    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.956477 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.956389    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b69bc9-8369-47e9-be9e-a656835a851f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.956535 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.956518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.956634 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.956613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86b69bc9-8369-47e9-be9e-a656835a851f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.977005 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.976975    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q8w7\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-kube-api-access-4q8w7\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:29.980312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:29.980294    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b69bc9-8369-47e9-be9e-a656835a851f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4t\" (UID: \"86b69bc9-8369-47e9-be9e-a656835a851f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:30.070844 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:30.070815    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:30.103918 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:30.103889    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:30.104579 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:30.104563    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c"
Sep 14 13:05:30.345512 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:30.345490    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"]
Sep 14 13:05:30.347551 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:05:30.347525    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b69bc9_8369_47e9_be9e_a656835a851f.slice/crio-41395a39792a7979e95151eaa9997a471941a59730543e92dee0eca5c72bb4e5 WatchSource:0}: Error finding container 41395a39792a7979e95151eaa9997a471941a59730543e92dee0eca5c72bb4e5: Status 404 returned error can't find the container with id 41395a39792a7979e95151eaa9997a471941a59730543e92dee0eca5c72bb4e5
Sep 14 13:05:31.110320 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:31.110282    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t" event={"ID":"86b69bc9-8369-47e9-be9e-a656835a851f","Type":"ContainerStarted","Data":"41395a39792a7979e95151eaa9997a471941a59730543e92dee0eca5c72bb4e5"}
Sep 14 13:05:32.814202 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:32.814145    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:05:32.814498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:32.814249    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:05:33.128158 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:33.128039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t" event={"ID":"86b69bc9-8369-47e9-be9e-a656835a851f","Type":"ContainerStarted","Data":"adc4339f1cee0d738bebf2dae319482c3ed2a3d6874a409029c778f42fa58ffc"}
Sep 14 13:05:33.128315 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:33.128287    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:33.129909 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:33.129882    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fdh4t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 13:05:33.130032 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:33.129937    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t" podUID="86b69bc9-8369-47e9-be9e-a656835a851f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 13:05:33.402908 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:33.402781    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t" podStartSLOduration=1.9386160019999998 podStartE2EDuration="4.402757473s" totalImagesPullingTime="2.464141471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:33.401085877 +0000 UTC m=+443.715869229" watchObservedRunningTime="2026-09-14 13:05:33.402757473 +0000 UTC m=+443.717540826"
Sep 14 13:05:34.133167 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:34.133132    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fdh4t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 13:05:34.133520 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:34.133189    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t" podUID="86b69bc9-8369-47e9-be9e-a656835a851f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 13:05:37.134184 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:37.134157    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4t"
Sep 14 13:05:40.106201 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:40.106168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:05:40.108005 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:05:40.107984    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-j8s4d"
Sep 14 13:08:10.127369 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:08:10.127344    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:08:10.128986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:08:10.128963    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:09:02.959338 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.959303    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"]
Sep 14 13:09:02.961351 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.961336    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:02.963892 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.963872    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 14 13:09:02.964229 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.964214    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-psph7\""
Sep 14 13:09:02.975822 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.975801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"]
Sep 14 13:09:02.994358 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.994331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:02.994446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:02.994365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czc2r\" (UniqueName: \"kubernetes.io/projected/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-kube-api-access-czc2r\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.094876 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.094848    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.095028 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.094884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czc2r\" (UniqueName: \"kubernetes.io/projected/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-kube-api-access-czc2r\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.095560 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.095542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.104963 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.104945    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czc2r\" (UniqueName: \"kubernetes.io/projected/6c0639c8-d415-4af6-8284-9ff4b2d8f6c8-kube-api-access-czc2r\") pod \"payload-pre-processing-59fbc47bf8-8zrdb\" (UID: \"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.271539 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.271464    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:03.542380 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:03.542340    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"]
Sep 14 13:09:03.543576 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:09:03.543547    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0639c8_d415_4af6_8284_9ff4b2d8f6c8.slice/crio-5d9415972c99ace99e0474e07bc44c8f7066840a960bd7442de3d7d45fbf2bb9 WatchSource:0}: Error finding container 5d9415972c99ace99e0474e07bc44c8f7066840a960bd7442de3d7d45fbf2bb9: Status 404 returned error can't find the container with id 5d9415972c99ace99e0474e07bc44c8f7066840a960bd7442de3d7d45fbf2bb9
Sep 14 13:09:04.064378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:04.064340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb" event={"ID":"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8","Type":"ContainerStarted","Data":"5d9415972c99ace99e0474e07bc44c8f7066840a960bd7442de3d7d45fbf2bb9"}
Sep 14 13:09:05.071236 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:05.071195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb" event={"ID":"6c0639c8-d415-4af6-8284-9ff4b2d8f6c8","Type":"ContainerStarted","Data":"75677f15d6a9cc5b9780c81789025cddc22c9808fa258c5b6d63e3fa70d90955"}
Sep 14 13:09:05.071633 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:05.071309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:05.090824 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:05.090771    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb" podStartSLOduration=2.105220532 podStartE2EDuration="3.0907565s" totalImagesPullingTime="985.535968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:09:05.088730014 +0000 UTC m=+655.403513367" watchObservedRunningTime="2026-09-14 13:09:05.0907565 +0000 UTC m=+655.405539851"
Sep 14 13:09:16.080638 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:16.080600    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8zrdb"
Sep 14 13:09:36.373431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.373400    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"]
Sep 14 13:09:36.376618 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.376602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.379432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.379412    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 13:09:36.380497 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.380479    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 13:09:36.380575 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.380499    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 14 13:09:36.380702 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.380681    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d5kw4\""
Sep 14 13:09:36.388431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.388411    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"]
Sep 14 13:09:36.468566 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468524    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.468566 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nnc9\" (UniqueName: \"kubernetes.io/projected/9252b4a0-6d7b-4086-bfff-e9c56a83f768-kube-api-access-6nnc9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.468730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468590    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.468730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468632    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.468730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468693    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.468730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.468707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569394 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569350    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569531 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569531 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569536    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nnc9\" (UniqueName: \"kubernetes.io/projected/9252b4a0-6d7b-4086-bfff-e9c56a83f768-kube-api-access-6nnc9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569794 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569864    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.569941 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.569897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.571684 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.571666    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9252b4a0-6d7b-4086-bfff-e9c56a83f768-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.571921 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.571903    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9252b4a0-6d7b-4086-bfff-e9c56a83f768-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.578039 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.578019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nnc9\" (UniqueName: \"kubernetes.io/projected/9252b4a0-6d7b-4086-bfff-e9c56a83f768-kube-api-access-6nnc9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb\" (UID: \"9252b4a0-6d7b-4086-bfff-e9c56a83f768\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.687132 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.687074    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:36.958627 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.958599    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"]
Sep 14 13:09:36.960093 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:09:36.960069    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9252b4a0_6d7b_4086_bfff_e9c56a83f768.slice/crio-71748750b75789b2f0db9e3989de3bca5be8534911771fd0d665957b715da73e WatchSource:0}: Error finding container 71748750b75789b2f0db9e3989de3bca5be8534911771fd0d665957b715da73e: Status 404 returned error can't find the container with id 71748750b75789b2f0db9e3989de3bca5be8534911771fd0d665957b715da73e
Sep 14 13:09:36.961450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:36.961424    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:09:37.222306 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:37.222220    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb" event={"ID":"9252b4a0-6d7b-4086-bfff-e9c56a83f768","Type":"ContainerStarted","Data":"71748750b75789b2f0db9e3989de3bca5be8534911771fd0d665957b715da73e"}
Sep 14 13:09:38.227888 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:38.227853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb" event={"ID":"9252b4a0-6d7b-4086-bfff-e9c56a83f768","Type":"ContainerStarted","Data":"ec77a5277b72d0e99a5a16ab249626ce8013c455b014c52cabe96b8530ff4b13"}
Sep 14 13:09:38.246263 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:38.246215    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb" podStartSLOduration=1.27217829 podStartE2EDuration="2.246199274s" totalImagesPullingTime="974.020984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:09:38.244816786 +0000 UTC m=+688.559600138" watchObservedRunningTime="2026-09-14 13:09:38.246199274 +0000 UTC m=+688.560982626"
Sep 14 13:09:46.687524 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:46.687490    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:46.687942 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:46.687550    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:46.699671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:46.699647    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:09:47.278753 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:09:47.278723    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb"
Sep 14 13:10:03.375730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.375656    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"]
Sep 14 13:10:03.379797 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.379774    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.382289 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.382270    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 14 13:10:03.390453 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.390435    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"]
Sep 14 13:10:03.494637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.494802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494647    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfb4j\" (UniqueName: \"kubernetes.io/projected/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-kube-api-access-vfb4j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.494802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.494802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494746    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.494802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.494962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.494806    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596040 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596192 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596192 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596141    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596192 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596173    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfb4j\" (UniqueName: \"kubernetes.io/projected/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-kube-api-access-vfb4j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596341 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596341 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596537 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596507    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596640 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.596640 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.596605    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.598193 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.598173    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.598496 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.598479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.604600 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.604580    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfb4j\" (UniqueName: \"kubernetes.io/projected/6e3f064b-577e-4d5f-9844-cd1b57c4a9bd-kube-api-access-vfb4j\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v\" (UID: \"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.690475 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.690409    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:03.962990 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:03.962968    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"]
Sep 14 13:10:03.965556 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:10:03.965532    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3f064b_577e_4d5f_9844_cd1b57c4a9bd.slice/crio-a7e6156ef3e00d9b59848da98f2e3e8c4b6e8221aa94a121aa9237e255cc302b WatchSource:0}: Error finding container a7e6156ef3e00d9b59848da98f2e3e8c4b6e8221aa94a121aa9237e255cc302b: Status 404 returned error can't find the container with id a7e6156ef3e00d9b59848da98f2e3e8c4b6e8221aa94a121aa9237e255cc302b
Sep 14 13:10:04.344233 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:04.344195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v" event={"ID":"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd","Type":"ContainerStarted","Data":"973dc941412bcf885db537bb35c28380ce696916aac186aa858693dd7a65cb9d"}
Sep 14 13:10:04.344374 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:04.344259    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v" event={"ID":"6e3f064b-577e-4d5f-9844-cd1b57c4a9bd","Type":"ContainerStarted","Data":"a7e6156ef3e00d9b59848da98f2e3e8c4b6e8221aa94a121aa9237e255cc302b"}
Sep 14 13:10:04.393710 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:04.393664    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v" podStartSLOduration=1.168837272 podStartE2EDuration="1.39365027s" totalImagesPullingTime="224.812998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:10:04.391538148 +0000 UTC m=+714.706321499" watchObservedRunningTime="2026-09-14 13:10:04.39365027 +0000 UTC m=+714.708433622"
Sep 14 13:10:13.691104 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:13.691073    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:13.691500 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:13.691128    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:13.703459 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:13.703440    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:14.399923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:14.399893    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v"
Sep 14 13:10:28.092559 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.092528    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"]
Sep 14 13:10:28.096256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.096235    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.099067 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.099026    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 14 13:10:28.108990 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.108966    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"]
Sep 14 13:10:28.214176 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.214354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gql\" (UniqueName: \"kubernetes.io/projected/a988f790-22d5-4df7-a40a-aa2ac72ed874-kube-api-access-v9gql\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.214354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a988f790-22d5-4df7-a40a-aa2ac72ed874-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.214354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.214354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.214509 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.214359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.315770 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.315741    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.315912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.315778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.315912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.315802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.315912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.315824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.316085 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.315939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gql\" (UniqueName: \"kubernetes.io/projected/a988f790-22d5-4df7-a40a-aa2ac72ed874-kube-api-access-v9gql\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.316210 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.316183    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.316283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.316220    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.316283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.316239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a988f790-22d5-4df7-a40a-aa2ac72ed874-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.316389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.316324    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.318260 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.318240    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a988f790-22d5-4df7-a40a-aa2ac72ed874-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.318866 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.318850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a988f790-22d5-4df7-a40a-aa2ac72ed874-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.324415 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.324397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gql\" (UniqueName: \"kubernetes.io/projected/a988f790-22d5-4df7-a40a-aa2ac72ed874-kube-api-access-v9gql\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz\" (UID: \"a988f790-22d5-4df7-a40a-aa2ac72ed874\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.406907 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.406801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:28.676844 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:28.676812    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"]
Sep 14 13:10:28.678799 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:10:28.678775    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda988f790_22d5_4df7_a40a_aa2ac72ed874.slice/crio-ae74738107f714546e017a770deb576b67400495211bd3ec267a2b16c5a9d28b WatchSource:0}: Error finding container ae74738107f714546e017a770deb576b67400495211bd3ec267a2b16c5a9d28b: Status 404 returned error can't find the container with id ae74738107f714546e017a770deb576b67400495211bd3ec267a2b16c5a9d28b
Sep 14 13:10:29.458355 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:29.458323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz" event={"ID":"a988f790-22d5-4df7-a40a-aa2ac72ed874","Type":"ContainerStarted","Data":"ae8273b38adb8dc8e5b67ca8d97bf0e27de08dc359347fba5032f0841287f693"}
Sep 14 13:10:29.458736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:29.458374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz" event={"ID":"a988f790-22d5-4df7-a40a-aa2ac72ed874","Type":"ContainerStarted","Data":"ae74738107f714546e017a770deb576b67400495211bd3ec267a2b16c5a9d28b"}
Sep 14 13:10:29.477160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:29.477108    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz" podStartSLOduration=1.177268836 podStartE2EDuration="1.47709032s" totalImagesPullingTime="299.821484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:10:29.476192157 +0000 UTC m=+739.790975509" watchObservedRunningTime="2026-09-14 13:10:29.47709032 +0000 UTC m=+739.791873669"
Sep 14 13:10:38.407819 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:38.407787    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:38.408296 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:38.407839    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:38.420935 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:38.420907    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:10:38.510197 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:10:38.510165    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz"
Sep 14 13:12:20.352348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.352308    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:12:20.356181 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.356151    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.359379 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.359355    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-5cedb0-openshift-default-dockercfg-d8bfr\""
Sep 14 13:12:20.372111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.372064    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:12:20.442034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.441990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442213 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442213 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442213 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442184    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442213 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442363 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442234    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbn2t\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442363 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442319    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442363 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.442474 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.442449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543203 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543238    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbn2t\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543350    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543403 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543458    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543689    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543870 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543870 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543855    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.543983 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.543931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.544164 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.544133    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.546381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.546338    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.546478 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.546446    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.551800 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.551781    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbn2t\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.551890 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.551811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token\") pod \"e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") " pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.667836 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.667750    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:20.950421 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.950369    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:12:20.952783 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:20.952754    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f3d183_ddc9_4cf4_bed6_00d6f5996514.slice/crio-c4bc10c31d0a83fbaa37c5d6e5dfbefba994c346dd4666fd6806ce7026543cea WatchSource:0}: Error finding container c4bc10c31d0a83fbaa37c5d6e5dfbefba994c346dd4666fd6806ce7026543cea: Status 404 returned error can't find the container with id c4bc10c31d0a83fbaa37c5d6e5dfbefba994c346dd4666fd6806ce7026543cea
Sep 14 13:12:20.954989 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.954959    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:20.955113 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.955031    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:20.955113 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.955074    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:20.977377 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:20.977352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerStarted","Data":"c4bc10c31d0a83fbaa37c5d6e5dfbefba994c346dd4666fd6806ce7026543cea"}
Sep 14 13:12:21.983418 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:21.983378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerStarted","Data":"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"}
Sep 14 13:12:22.013216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:22.013157    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podStartSLOduration=2.013142156 podStartE2EDuration="2.013142156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:22.010398832 +0000 UTC m=+852.325182184" watchObservedRunningTime="2026-09-14 13:12:22.013142156 +0000 UTC m=+852.327925507"
Sep 14 13:12:22.667929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:22.667887    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:22.673177 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:22.673147    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:22.988435 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:22.988407    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:22.989526 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:22.989504    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:26.520228 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.520189    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:12:26.524105 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.524082    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.529800 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.529771    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-aea349\""
Sep 14 13:12:26.529800 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.529791    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-aea349-dockercfg-tgfxh\""
Sep 14 13:12:26.542163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.542134    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:12:26.602402 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.602362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.602402 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.602398    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhwwd\" (UniqueName: \"kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.703983 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.703946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.704203 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.703990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhwwd\" (UniqueName: \"kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.704713 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.704687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.737790 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.737757    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhwwd\" (UniqueName: \"kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd\") pod \"payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:26.835199 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:26.835101    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:27.116989 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.116963    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:12:27.119546 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:27.119515    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d81c843_d6f3_46dc_bf5f_cd872f5ad5c9.slice/crio-f83b524842bf4e028cfb039b17dafca57c612c0d76245626abbc33466c86b7b6 WatchSource:0}: Error finding container f83b524842bf4e028cfb039b17dafca57c612c0d76245626abbc33466c86b7b6: Status 404 returned error can't find the container with id f83b524842bf4e028cfb039b17dafca57c612c0d76245626abbc33466c86b7b6
Sep 14 13:12:27.629750 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.629709    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:12:27.634068 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.634034    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.637100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.637077    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0fcdc6-dockercfg-dvcpg\""
Sep 14 13:12:27.637461 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.637444    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0fcdc6\""
Sep 14 13:12:27.644739 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.644710    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:12:27.715463 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.715420    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxlt\" (UniqueName: \"kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.715682 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.715552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.816485 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.816443    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.816658 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.816501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knxlt\" (UniqueName: \"kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.817208 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.817186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.827639 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.827602    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxlt\" (UniqueName: \"kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt\") pod \"payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:27.946999 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:27.946907    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:28.019365 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:28.019334    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" event={"ID":"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9","Type":"ContainerStarted","Data":"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"}
Sep 14 13:12:28.019683 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:28.019664    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" event={"ID":"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9","Type":"ContainerStarted","Data":"f83b524842bf4e028cfb039b17dafca57c612c0d76245626abbc33466c86b7b6"}
Sep 14 13:12:28.019820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:28.019807    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:28.227955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:28.227746    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" podStartSLOduration=2.227721802 podStartE2EDuration="2.227721802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:28.04032591 +0000 UTC m=+858.355109263" watchObservedRunningTime="2026-09-14 13:12:28.227721802 +0000 UTC m=+858.542505155"
Sep 14 13:12:28.229235 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:28.229216    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:12:28.230838 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:28.230806    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717a9931_0f97_4eba_9c11_a21c7b496bac.slice/crio-92270f81366a9cf408dc3d9cc388741ea7c4041496c5233e279332eeea0548ac WatchSource:0}: Error finding container 92270f81366a9cf408dc3d9cc388741ea7c4041496c5233e279332eeea0548ac: Status 404 returned error can't find the container with id 92270f81366a9cf408dc3d9cc388741ea7c4041496c5233e279332eeea0548ac
Sep 14 13:12:29.026127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.026086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" event={"ID":"717a9931-0f97-4eba-9c11-a21c7b496bac","Type":"ContainerStarted","Data":"c3ccce2eb851d07d322057311f465b92fceba47af8f39b22b71e947896bf8838"}
Sep 14 13:12:29.026599 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.026150    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" event={"ID":"717a9931-0f97-4eba-9c11-a21c7b496bac","Type":"ContainerStarted","Data":"92270f81366a9cf408dc3d9cc388741ea7c4041496c5233e279332eeea0548ac"}
Sep 14 13:12:29.026599 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.026348    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:29.048381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.048337    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" podStartSLOduration=2.048320696 podStartE2EDuration="2.048320696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:29.04628232 +0000 UTC m=+859.361065694" watchObservedRunningTime="2026-09-14 13:12:29.048320696 +0000 UTC m=+859.363104047"
Sep 14 13:12:29.803200 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.803163    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:12:29.806601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.806585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:29.809552 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.809530    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-5cedb0-dockercfg-wg8xm\""
Sep 14 13:12:29.809673 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.809554    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-5cedb0\""
Sep 14 13:12:29.817882 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.817855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:12:29.849464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.849438    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:12:29.852794 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.852778    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:29.862993 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.862969    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:12:29.936820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.936753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:29.937003 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.936859    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7kn\" (UniqueName: \"kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:29.937003 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.936908    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:29.937149 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:29.937060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvcc8\" (UniqueName: \"kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.038533 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.038490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:30.038533 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.038541    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7kn\" (UniqueName: \"kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:30.039079 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.038568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.039079 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.038608    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvcc8\" (UniqueName: \"kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.039254 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.039231    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.039390 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.039370    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:30.050805 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.050782    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvcc8\" (UniqueName: \"kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8\") pod \"payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.050896 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.050859    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7kn\" (UniqueName: \"kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn\") pod \"payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:30.117947 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.117860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:30.163381 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.163080    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:30.393174 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.393138    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:12:30.395623 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:30.395587    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3672e16_c72e_413f_a47b_04741ca352f3.slice/crio-a022213b9af73e8e745c5d7384d34d85076e80b6a18bc474445555ac63426563 WatchSource:0}: Error finding container a022213b9af73e8e745c5d7384d34d85076e80b6a18bc474445555ac63426563: Status 404 returned error can't find the container with id a022213b9af73e8e745c5d7384d34d85076e80b6a18bc474445555ac63426563
Sep 14 13:12:30.455724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.455692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:12:30.456438 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:30.456408    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbeb0b6f_033d_467a_b0bd_e3c55b5e7f38.slice/crio-0049678e8ef31544aeff77b26563937255528a27c2424d2f2e82b3c1efdcbf8c WatchSource:0}: Error finding container 0049678e8ef31544aeff77b26563937255528a27c2424d2f2e82b3c1efdcbf8c: Status 404 returned error can't find the container with id 0049678e8ef31544aeff77b26563937255528a27c2424d2f2e82b3c1efdcbf8c
Sep 14 13:12:30.633884 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.633847    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:12:30.638325 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.638298    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.640929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.640893    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-f96382-openshift-default-dockercfg-wns5z\""
Sep 14 13:12:30.652834 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.652807    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:12:30.744534 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744499    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744534 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbd4\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744730    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.744773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.744753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbd4\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846424    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.846946 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846895    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.847001 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.846952    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.847324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.847138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.847439 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.847405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.847439 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.847409    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.849260 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.849238    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.849740 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.849719    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.856341 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.856316    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbd4\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.856441 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.856339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token\") pod \"e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") " pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:30.951230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:30.951142    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:31.041116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.041079    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" event={"ID":"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38","Type":"ContainerStarted","Data":"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"}
Sep 14 13:12:31.041546 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.041145    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" event={"ID":"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38","Type":"ContainerStarted","Data":"0049678e8ef31544aeff77b26563937255528a27c2424d2f2e82b3c1efdcbf8c"}
Sep 14 13:12:31.041546 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.041210    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:31.043115 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.043080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" event={"ID":"d3672e16-c72e-413f-a47b-04741ca352f3","Type":"ContainerStarted","Data":"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"}
Sep 14 13:12:31.043256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.043136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" event={"ID":"d3672e16-c72e-413f-a47b-04741ca352f3","Type":"ContainerStarted","Data":"a022213b9af73e8e745c5d7384d34d85076e80b6a18bc474445555ac63426563"}
Sep 14 13:12:31.043256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.043183    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:31.062981 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.062919    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" podStartSLOduration=2.06290176 podStartE2EDuration="2.06290176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:31.061211098 +0000 UTC m=+861.375994453" watchObservedRunningTime="2026-09-14 13:12:31.06290176 +0000 UTC m=+861.377685112"
Sep 14 13:12:31.082966 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.082904    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" podStartSLOduration=2.082879072 podStartE2EDuration="2.082879072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:31.080090353 +0000 UTC m=+861.394873706" watchObservedRunningTime="2026-09-14 13:12:31.082879072 +0000 UTC m=+861.397662425"
Sep 14 13:12:31.245030 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.245004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:12:31.246865 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:31.246833    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4564ad_fc80_48f1_8f1c_43ad380f155c.slice/crio-de1345ce3f3e9b4fe727413534eceeb8ab1cc559487f04396e7d0dee8d991133 WatchSource:0}: Error finding container de1345ce3f3e9b4fe727413534eceeb8ab1cc559487f04396e7d0dee8d991133: Status 404 returned error can't find the container with id de1345ce3f3e9b4fe727413534eceeb8ab1cc559487f04396e7d0dee8d991133
Sep 14 13:12:31.249216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.249184    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:31.249289 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.249250    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:31.249289 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:31.249277    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:32.049616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:32.049584    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerStarted","Data":"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"}
Sep 14 13:12:32.050096 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:32.049636    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerStarted","Data":"de1345ce3f3e9b4fe727413534eceeb8ab1cc559487f04396e7d0dee8d991133"}
Sep 14 13:12:32.104786 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:32.104724    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podStartSLOduration=2.104702594 podStartE2EDuration="2.104702594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:32.102545918 +0000 UTC m=+862.417329270" watchObservedRunningTime="2026-09-14 13:12:32.104702594 +0000 UTC m=+862.419485949"
Sep 14 13:12:32.951697 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:32.951658    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:32.956244 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:32.956218    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:33.054993 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:33.054964    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:33.056025 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:33.056004    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:12:39.008849 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.008782    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:12:39.012612 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.012588    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.017653 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.017626    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-809356-openshift-default-dockercfg-d2hg5\""
Sep 14 13:12:39.027876 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.027852    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:12:39.044293 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.044257    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:12:39.140576 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg2j7\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140894 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140827    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140894 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140886    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.140965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.141007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140977    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.141007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.140994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.223646 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.223609    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:12:39.227101 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.227071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.231716 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.231689    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-f96382\""
Sep 14 13:12:39.231861 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.231819    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-f96382-dockercfg-nx869\""
Sep 14 13:12:39.242016 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.241987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242166 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242166 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242109    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242166 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242332 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242169    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242332 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242204    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242332 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg2j7\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242535 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242535 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242421    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242535 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242524    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242687 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242687 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242642    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.242797 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.242754    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.243240 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.243217    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.244529 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.244509    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.244673 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.244653    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.261515 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.261443    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.275073 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.273656    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:12:39.286070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.279076    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg2j7\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7\") pod \"e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") " pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.324438 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.324397    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:39.343489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.343457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6twrw\" (UniqueName: \"kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.343624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.343498    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.444230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.444186    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6twrw\" (UniqueName: \"kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.444230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.444234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.444992 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.444970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.459975 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.459860    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6twrw\" (UniqueName: \"kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw\") pod \"payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.537780 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.537685    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:39.630962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.630937    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:12:39.633758 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:39.633727    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4dfdf90_1be1_4c25_948d_6ab03f80f1e4.slice/crio-416d3dc9636a5d3ed567828ceb47f83dbd7656633712ba480844ad20a386dcc7 WatchSource:0}: Error finding container 416d3dc9636a5d3ed567828ceb47f83dbd7656633712ba480844ad20a386dcc7: Status 404 returned error can't find the container with id 416d3dc9636a5d3ed567828ceb47f83dbd7656633712ba480844ad20a386dcc7
Sep 14 13:12:39.636243 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.636206    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:39.636350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.636290    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:39.636350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.636326    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:39.841491 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:39.841458    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:12:39.843907 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:39.843873    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc647c6dd_28c5_4970_b6e7_d0bc7b69b83c.slice/crio-c4ec0d0656e382a8b27955cbf0e77031954def6e4d0fe434acf0950ac27e94e9 WatchSource:0}: Error finding container c4ec0d0656e382a8b27955cbf0e77031954def6e4d0fe434acf0950ac27e94e9: Status 404 returned error can't find the container with id c4ec0d0656e382a8b27955cbf0e77031954def6e4d0fe434acf0950ac27e94e9
Sep 14 13:12:40.033930 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.033875    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:12:40.105837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.105740    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerStarted","Data":"80517ae8bea4d5d180af2a24e4af48a866135b099dabc239e6ca7e4acb2a9ddc"}
Sep 14 13:12:40.105837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.105813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerStarted","Data":"416d3dc9636a5d3ed567828ceb47f83dbd7656633712ba480844ad20a386dcc7"}
Sep 14 13:12:40.107839 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.107800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" event={"ID":"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c","Type":"ContainerStarted","Data":"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"}
Sep 14 13:12:40.107943 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.107852    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" event={"ID":"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c","Type":"ContainerStarted","Data":"c4ec0d0656e382a8b27955cbf0e77031954def6e4d0fe434acf0950ac27e94e9"}
Sep 14 13:12:40.107943 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.107883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:40.134479 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.134415    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podStartSLOduration=2.134397327 podStartE2EDuration="2.134397327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:40.132247121 +0000 UTC m=+870.447030485" watchObservedRunningTime="2026-09-14 13:12:40.134397327 +0000 UTC m=+870.449180679"
Sep 14 13:12:40.152987 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.152933    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" podStartSLOduration=1.152913198 podStartE2EDuration="1.152913198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:40.151549949 +0000 UTC m=+870.466333302" watchObservedRunningTime="2026-09-14 13:12:40.152913198 +0000 UTC m=+870.467696554"
Sep 14 13:12:40.324894 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.324865    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:40.330388 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:40.330363    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:41.113571 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:41.113531    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:41.114897 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:41.114872    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:12:42.052474 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.052439    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:12:42.052667 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.052632    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:12:42.121055 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.121017    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:12:42.124930 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.124910    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.127759 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.127736    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c893c447-dockercfg-n82z2\""
Sep 14 13:12:42.127965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.127941    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c893c447\""
Sep 14 13:12:42.135862 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.135836    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:12:42.272953 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.272911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.273278 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.273252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8qh\" (UniqueName: \"kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.373873 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.373788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.374077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.373873    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8qh\" (UniqueName: \"kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.374965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.374938    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.389039 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.389010    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8qh\" (UniqueName: \"kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh\") pod \"payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.439122 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.439088    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:42.741449 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:42.741335    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:12:42.743379 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:42.742765    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8f21c5_fe9c_43d8_83d8_eb59a54beabc.slice/crio-2899548d63046c3a7a9427e6911e7b21d2a4290a3a38d01be78488a1982f49bb WatchSource:0}: Error finding container 2899548d63046c3a7a9427e6911e7b21d2a4290a3a38d01be78488a1982f49bb: Status 404 returned error can't find the container with id 2899548d63046c3a7a9427e6911e7b21d2a4290a3a38d01be78488a1982f49bb
Sep 14 13:12:43.128301 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.128193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" event={"ID":"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc","Type":"ContainerStarted","Data":"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"}
Sep 14 13:12:43.128301 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.128258    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" event={"ID":"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc","Type":"ContainerStarted","Data":"2899548d63046c3a7a9427e6911e7b21d2a4290a3a38d01be78488a1982f49bb"}
Sep 14 13:12:43.128301 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.128289    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:43.129892 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.129868    2566 generic.go:356] "Generic (PLEG): container finished" podID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerID="bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175" exitCode=0
Sep 14 13:12:43.130013 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.129936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerDied","Data":"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"}
Sep 14 13:12:43.130467 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.130449    2566 scope.go:117] "RemoveContainer" containerID="bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"
Sep 14 13:12:43.131477 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.131452    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:43.131553 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.131511    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:43.131553 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.131539    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:12:43.149457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:43.149419    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" podStartSLOduration=1.14940536 podStartE2EDuration="1.14940536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:43.147734128 +0000 UTC m=+873.462517483" watchObservedRunningTime="2026-09-14 13:12:43.14940536 +0000 UTC m=+873.464188713"
Sep 14 13:12:44.137544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:44.137510    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerStarted","Data":"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"}
Sep 14 13:12:44.668860 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:44.668808    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:44.669094 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:44.668940    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 14 13:12:44.669094 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:44.668986    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 14 13:12:45.668711 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:45.668667    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 14 13:12:45.669212 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:45.668773    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 14 13:12:46.669103 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:46.669064    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 14 13:12:46.669584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:46.669148    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 14 13:12:47.671020 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:47.670984    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 14 13:12:47.671634 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:47.671604    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 14 13:12:48.668700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.668657    2566 patch_prober.go:28] interesting pod/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 14 13:12:48.668896 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.668726    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 14 13:12:48.934219 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.934141    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:12:48.937658 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.937638    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:48.940580 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.940557    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-809356\""
Sep 14 13:12:48.940679 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.940607    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-809356-dockercfg-7nl2j\""
Sep 14 13:12:48.947652 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:48.947626    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:12:49.038813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.038778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flph\" (UniqueName: \"kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.038974 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.038911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.140317 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.140284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.140481 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.140369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flph\" (UniqueName: \"kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.141242 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.141217    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.155660 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.155635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flph\" (UniqueName: \"kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph\") pod \"payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.249367 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.249339    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:49.529273 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.529250    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:12:49.531080 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:49.531034    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54484158_7807_40bf_9873_3330074048cf.slice/crio-3d3a6c36f8be9224c2730884ef136a6ce6a26c2d40dc3f601d9649b190027438 WatchSource:0}: Error finding container 3d3a6c36f8be9224c2730884ef136a6ce6a26c2d40dc3f601d9649b190027438: Status 404 returned error can't find the container with id 3d3a6c36f8be9224c2730884ef136a6ce6a26c2d40dc3f601d9649b190027438
Sep 14 13:12:49.673912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.673871    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:49.674145 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.674127    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:49.674877 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:49.674856    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:12:50.181282 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:50.181244    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" event={"ID":"54484158-7807-40bf-9873-3330074048cf","Type":"ContainerStarted","Data":"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"}
Sep 14 13:12:50.181740 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:50.181307    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" event={"ID":"54484158-7807-40bf-9873-3330074048cf","Type":"ContainerStarted","Data":"3d3a6c36f8be9224c2730884ef136a6ce6a26c2d40dc3f601d9649b190027438"}
Sep 14 13:12:50.181740 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:50.181562    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:12:50.209188 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:50.209142    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" podStartSLOduration=2.209126817 podStartE2EDuration="2.209126817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:50.206235842 +0000 UTC m=+880.521019198" watchObservedRunningTime="2026-09-14 13:12:50.209126817 +0000 UTC m=+880.523910169"
Sep 14 13:12:51.115466 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:51.115435    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:12:54.140010 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.139980    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:12:54.251653 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.251619    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"]
Sep 14 13:12:54.254431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.254415    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:54.257135 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.257113    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:12:54.257258 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.257153    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:12:54.263347 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.263322    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"]
Sep 14 13:12:54.287032 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.287005    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c893c447-9vk9f\" (UID: \"ac24413c-ce6c-4c1f-8661-f6d479d81639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:54.387938 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.387904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c893c447-9vk9f\" (UID: \"ac24413c-ce6c-4c1f-8661-f6d479d81639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:54.388584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.388562    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c893c447-9vk9f\" (UID: \"ac24413c-ce6c-4c1f-8661-f6d479d81639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:54.566341 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.566306    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:54.840991 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:54.840913    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"]
Sep 14 13:12:54.844578 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:12:54.844551    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac24413c_ce6c_4c1f_8661_f6d479d81639.slice/crio-ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976 WatchSource:0}: Error finding container ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976: Status 404 returned error can't find the container with id ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976
Sep 14 13:12:55.209879 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:55.209845    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f" event={"ID":"ac24413c-ce6c-4c1f-8661-f6d479d81639","Type":"ContainerStarted","Data":"ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976"}
Sep 14 13:12:58.229509 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:58.229476    2566 generic.go:356] "Generic (PLEG): container finished" podID="ac24413c-ce6c-4c1f-8661-f6d479d81639" containerID="35ef26ab5e0241ed9963dda7071966724f242a7494cfed89305b3ac2fe18888b" exitCode=0
Sep 14 13:12:58.229816 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:58.229554    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f" event={"ID":"ac24413c-ce6c-4c1f-8661-f6d479d81639","Type":"ContainerDied","Data":"35ef26ab5e0241ed9963dda7071966724f242a7494cfed89305b3ac2fe18888b"}
Sep 14 13:12:59.415142 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:59.415120    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:12:59.443388 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:59.443353    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca\") pod \"ac24413c-ce6c-4c1f-8661-f6d479d81639\" (UID: \"ac24413c-ce6c-4c1f-8661-f6d479d81639\") "
Sep 14 13:12:59.443679 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:59.443656    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac24413c-ce6c-4c1f-8661-f6d479d81639" (UID: "ac24413c-ce6c-4c1f-8661-f6d479d81639"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:12:59.443790 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:12:59.443775    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac24413c-ce6c-4c1f-8661-f6d479d81639-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:00.240865 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:00.240836    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"
Sep 14 13:13:00.241016 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:00.240862    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f" event={"ID":"ac24413c-ce6c-4c1f-8661-f6d479d81639","Type":"ContainerDied","Data":"ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976"}
Sep 14 13:13:00.241016 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:00.240905    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce3dc1a5fa1b2cffdaa9edfb0b1d4bc7665f1858b49331c4dea10bf73b6e7976"
Sep 14 13:13:01.190802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:01.190768    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:13:07.597848 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.597747    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:13:07.598335 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.598197    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" podUID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" containerName="payload-pre-processing" containerID="cri-o://c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452" gracePeriod=30
Sep 14 13:13:07.811561 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.811162    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"]
Sep 14 13:13:07.813838 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.813805    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c893c447-9vk9f"]
Sep 14 13:13:07.858440 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.858387    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:13:07.939927 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.939894    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume\") pod \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") "
Sep 14 13:13:07.940115 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.939939    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r8qh\" (UniqueName: \"kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh\") pod \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\" (UID: \"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc\") "
Sep 14 13:13:07.940303 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.940281    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" (UID: "6f8f21c5-fe9c-43d8-83d8-eb59a54beabc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:13:07.940426 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.940404    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:07.942468 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:07.942441    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh" (OuterVolumeSpecName: "kube-api-access-5r8qh") pod "6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" (UID: "6f8f21c5-fe9c-43d8-83d8-eb59a54beabc"). InnerVolumeSpecName "kube-api-access-5r8qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:13:08.041283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.041240    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r8qh\" (UniqueName: \"kubernetes.io/projected/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc-kube-api-access-5r8qh\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:08.191549 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.191468    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac24413c-ce6c-4c1f-8661-f6d479d81639" path="/var/lib/kubelet/pods/ac24413c-ce6c-4c1f-8661-f6d479d81639/volumes"
Sep 14 13:13:08.295568 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.295531    2566 generic.go:356] "Generic (PLEG): container finished" podID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerID="ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1" exitCode=0
Sep 14 13:13:08.295759 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.295620    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerDied","Data":"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"}
Sep 14 13:13:08.296296 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.296273    2566 scope.go:117] "RemoveContainer" containerID="ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"
Sep 14 13:13:08.297193 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297167    2566 generic.go:356] "Generic (PLEG): container finished" podID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" containerID="c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452" exitCode=0
Sep 14 13:13:08.297326 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297219    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"
Sep 14 13:13:08.297326 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297247    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" event={"ID":"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc","Type":"ContainerDied","Data":"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"}
Sep 14 13:13:08.297326 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297310    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh" event={"ID":"6f8f21c5-fe9c-43d8-83d8-eb59a54beabc","Type":"ContainerDied","Data":"2899548d63046c3a7a9427e6911e7b21d2a4290a3a38d01be78488a1982f49bb"}
Sep 14 13:13:08.297488 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297339    2566 scope.go:117] "RemoveContainer" containerID="c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"
Sep 14 13:13:08.297891 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297837    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:08.298007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297922    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:08.298007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.297964    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:08.307645 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.307628    2566 scope.go:117] "RemoveContainer" containerID="c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"
Sep 14 13:13:08.307918 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:13:08.307895    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452\": container with ID starting with c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452 not found: ID does not exist" containerID="c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"
Sep 14 13:13:08.307987 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.307934    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452"} err="failed to get container status \"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452\": rpc error: code = NotFound desc = could not find container \"c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452\": container with ID starting with c2bf0a1043ad46db785b351c87e9a407f8701f4f5f9f1d7dc70e07acfbd25452 not found: ID does not exist"
Sep 14 13:13:08.340572 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.340541    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:13:08.345482 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:08.345228    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c893c447-fb58fd578-8s6kh"]
Sep 14 13:13:09.131134 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.131102    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:09.131860 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.131837    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac24413c-ce6c-4c1f-8661-f6d479d81639" containerName="revoke-keys"
Sep 14 13:13:09.131971 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.131863    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac24413c-ce6c-4c1f-8661-f6d479d81639" containerName="revoke-keys"
Sep 14 13:13:09.131971 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.131921    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" containerName="payload-pre-processing"
Sep 14 13:13:09.131971 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.131930    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" containerName="payload-pre-processing"
Sep 14 13:13:09.132142 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.132037    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" containerName="payload-pre-processing"
Sep 14 13:13:09.132142 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.132072    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac24413c-ce6c-4c1f-8661-f6d479d81639" containerName="revoke-keys"
Sep 14 13:13:09.135928 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.135906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.140181 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.140156    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9b4657d2-gw-openshift-default-dockercfg-qwmxj\""
Sep 14 13:13:09.149374 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.149352    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:09.254280 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254290    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254340    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254681 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254681 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.254779 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.254670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddll8\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.306005 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.305972    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerStarted","Data":"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"}
Sep 14 13:13:09.356037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.355995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddll8\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356369 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356283    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356369 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356319    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356369 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356358    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356521 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356521 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356413    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356521 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356439    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356521 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356460    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.356840 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.356817    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.357157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.357134    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.357280 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.357263    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.357441 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.357425    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.359652 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.358970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.359652 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.359598    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.370070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.365947    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddll8\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.370070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.366355    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token\") pod \"e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") " pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.447706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.447617    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:09.773807 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.773763    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:09.794300 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.794244    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:09.794422 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.794338    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:09.794422 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.794385    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:09.951585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.951546    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:13:09.951870 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.951732    2566 patch_prober.go:28] interesting pod/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 14 13:13:09.951870 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:09.951777    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 14 13:13:10.195459 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.195367    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:13:10.199781 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.199752    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:13:10.201491 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.201460    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8f21c5-fe9c-43d8-83d8-eb59a54beabc" path="/var/lib/kubelet/pods/6f8f21c5-fe9c-43d8-83d8-eb59a54beabc/volumes"
Sep 14 13:13:10.313839 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.313799    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerStarted","Data":"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"}
Sep 14 13:13:10.314004 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.313859    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerStarted","Data":"2d71d284919209cb1bee3c9ea09c6e1f146742d043e0c81bbcdbb1f17bd2bf07"}
Sep 14 13:13:10.337096 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.337032    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podStartSLOduration=1.337018977 podStartE2EDuration="1.337018977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:10.334520205 +0000 UTC m=+900.649303583" watchObservedRunningTime="2026-09-14 13:13:10.337018977 +0000 UTC m=+900.651802329"
Sep 14 13:13:10.448883 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.448805    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:10.457757 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.457727    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:10.952040 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.952010    2566 patch_prober.go:28] interesting pod/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 14 13:13:10.952249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:10.952098    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 14 13:13:11.115427 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.115399    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:11.115700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.115445    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:11.320378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.320292    2566 generic.go:356] "Generic (PLEG): container finished" podID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerID="80517ae8bea4d5d180af2a24e4af48a866135b099dabc239e6ca7e4acb2a9ddc" exitCode=0
Sep 14 13:13:11.320378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.320365    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerDied","Data":"80517ae8bea4d5d180af2a24e4af48a866135b099dabc239e6ca7e4acb2a9ddc"}
Sep 14 13:13:11.320815 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.320729    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:11.320896 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.320882    2566 scope.go:117] "RemoveContainer" containerID="80517ae8bea4d5d180af2a24e4af48a866135b099dabc239e6ca7e4acb2a9ddc"
Sep 14 13:13:11.321694 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.321675    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:11.322029 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.321999    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:11.322127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.322088    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:11.322127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.322123    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:11.952352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.952318    2566 patch_prober.go:28] interesting pod/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 14 13:13:11.952498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:11.952372    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 14 13:13:12.328952 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:12.328853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerStarted","Data":"7cc8986552e8739804551ced7a7cf09407bae24698f7ccc90a60c6a86e5b9c22"}
Sep 14 13:13:12.951784 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:12.951742    2566 patch_prober.go:28] interesting pod/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 14 13:13:12.951958 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:12.951816    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 14 13:13:13.324813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:13.324780    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:13.325115 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:13.325090    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:13.325448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:13.325022    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:13:13.952359 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:13.952331    2566 patch_prober.go:28] interesting pod/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 14 13:13:13.952770 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:13.952746    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 14 13:13:14.325735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:14.325632    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:14.325735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:14.325699    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:14.955795 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:14.955761    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:13:14.956265 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:14.956067    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:13:14.956846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:14.956826    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:13:15.325161 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:15.325077    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:15.325161 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:15.325135    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:16.325180 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:16.325141    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:16.325632 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:16.325212    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:17.325540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:17.325500    2566 patch_prober.go:28] interesting pod/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 14 13:13:17.325950 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:17.325558    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 14 13:13:18.328567 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:18.328539    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:13:18.328993 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:18.328889    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:13:18.329636 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:18.329618    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:13:33.448368 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.448274    2566 generic.go:356] "Generic (PLEG): container finished" podID="31cf3c95-f262-443e-981e-159f261fe734" containerID="b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575" exitCode=0
Sep 14 13:13:33.448368 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.448321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerDied","Data":"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"}
Sep 14 13:13:33.448825 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.448799    2566 scope.go:117] "RemoveContainer" containerID="b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"
Sep 14 13:13:33.449966 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.449934    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:33.450077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.450000    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:33.450077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:33.450030    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:13:34.455325 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:34.455286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerStarted","Data":"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"}
Sep 14 13:13:35.448220 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:35.448181    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:35.448429 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:35.448407    2566 patch_prober.go:28] interesting pod/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 14 13:13:35.448513 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:35.448466    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 14 13:13:36.448669 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.448630    2566 patch_prober.go:28] interesting pod/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 14 13:13:36.449089 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.448714    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 14 13:13:36.956757 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.956725    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"]
Sep 14 13:13:36.959591 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.959575    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:36.962418 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.962394    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:13:36.962418 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.962410    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:13:36.969241 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:36.969212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"]
Sep 14 13:13:37.063730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.063698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc\" (UID: \"fd64ef63-9090-4d45-abde-aa4b739a92ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:37.164827 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.164786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc\" (UID: \"fd64ef63-9090-4d45-abde-aa4b739a92ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:37.165731 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.165704    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc\" (UID: \"fd64ef63-9090-4d45-abde-aa4b739a92ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:37.277120 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.277016    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:37.448543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.448508    2566 patch_prober.go:28] interesting pod/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 14 13:13:37.448695 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.448574    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 14 13:13:37.562245 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:13:37.562217    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd64ef63_9090_4d45_abde_aa4b739a92ed.slice/crio-fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738 WatchSource:0}: Error finding container fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738: Status 404 returned error can't find the container with id fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738
Sep 14 13:13:37.563958 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:37.563936    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"]
Sep 14 13:13:38.448023 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:38.447992    2566 patch_prober.go:28] interesting pod/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 14 13:13:38.448204 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:38.448064    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 14 13:13:38.500439 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:38.500403    2566 generic.go:356] "Generic (PLEG): container finished" podID="fd64ef63-9090-4d45-abde-aa4b739a92ed" containerID="93334ab5c4f1e75b110b1645cbcdd5c4f7470b82a1622553aa40d7ebd6231246" exitCode=0
Sep 14 13:13:38.500817 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:38.500442    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc" event={"ID":"fd64ef63-9090-4d45-abde-aa4b739a92ed","Type":"ContainerDied","Data":"93334ab5c4f1e75b110b1645cbcdd5c4f7470b82a1622553aa40d7ebd6231246"}
Sep 14 13:13:38.500817 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:38.500500    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc" event={"ID":"fd64ef63-9090-4d45-abde-aa4b739a92ed","Type":"ContainerStarted","Data":"fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738"}
Sep 14 13:13:39.448642 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.448611    2566 patch_prober.go:28] interesting pod/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 14 13:13:39.448808 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.448662    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 14 13:13:39.677511 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.677486    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:39.811014 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.810982    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca\") pod \"fd64ef63-9090-4d45-abde-aa4b739a92ed\" (UID: \"fd64ef63-9090-4d45-abde-aa4b739a92ed\") "
Sep 14 13:13:39.811398 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.811371    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd64ef63-9090-4d45-abde-aa4b739a92ed" (UID: "fd64ef63-9090-4d45-abde-aa4b739a92ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:13:39.912687 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:39.912640    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd64ef63-9090-4d45-abde-aa4b739a92ed-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:40.452799 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.452769    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:40.453114 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.453084    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:40.453830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.453813    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:40.515086 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.515038    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc" event={"ID":"fd64ef63-9090-4d45-abde-aa4b739a92ed","Type":"ContainerDied","Data":"fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738"}
Sep 14 13:13:40.515252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.515113    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb99338799e9855a8d9f519c8a2b190255ff5ce01d11b980c4e3b3d0e7282738"
Sep 14 13:13:40.515252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:40.515066    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"
Sep 14 13:13:43.578454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:43.578425    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"]
Sep 14 13:13:43.580959 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:43.580919    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9b4657d2-qqtzc"]
Sep 14 13:13:43.721581 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:43.721551    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:43.721755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:43.721732    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy" containerID="cri-o://64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f" gracePeriod=30
Sep 14 13:13:44.190553 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:44.190522    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd64ef63-9090-4d45-abde-aa4b739a92ed" path="/var/lib/kubelet/pods/fd64ef63-9090-4d45-abde-aa4b739a92ed/volumes"
Sep 14 13:13:48.973350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:48.973321    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:49.009464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009391    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009428    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddll8\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009448    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009540    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009611    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009645    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.009736 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.009681    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo\") pod \"31cf3c95-f262-443e-981e-159f261fe734\" (UID: \"31cf3c95-f262-443e-981e-159f261fe734\") "
Sep 14 13:13:49.010091 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.010041    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:13:49.010348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.010161    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:13:49.010348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.010275    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:13:49.010348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.010288    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data" (OuterVolumeSpecName: "istio-data") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:13:49.010348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.010341    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:13:49.011761 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.011735    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token" (OuterVolumeSpecName: "istio-token") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:13:49.012131 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.012094    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8" (OuterVolumeSpecName: "kube-api-access-ddll8") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "kube-api-access-ddll8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:13:49.012220 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.012138    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:13:49.012277 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.012257    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31cf3c95-f262-443e-981e-159f261fe734" (UID: "31cf3c95-f262-443e-981e-159f261fe734"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:13:49.111185 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111154    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf3c95-f262-443e-981e-159f261fe734-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111185 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111180    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111185 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111188    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111197    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111206    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111214    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf3c95-f262-443e-981e-159f261fe734-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111221    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111230    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddll8\" (UniqueName: \"kubernetes.io/projected/31cf3c95-f262-443e-981e-159f261fe734-kube-api-access-ddll8\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.111401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.111238    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf3c95-f262-443e-981e-159f261fe734-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:13:49.575146 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.575114    2566 generic.go:356] "Generic (PLEG): container finished" podID="31cf3c95-f262-443e-981e-159f261fe734" containerID="64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f" exitCode=0
Sep 14 13:13:49.575324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.575159    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"
Sep 14 13:13:49.575324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.575208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerDied","Data":"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"}
Sep 14 13:13:49.575324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.575264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb" event={"ID":"31cf3c95-f262-443e-981e-159f261fe734","Type":"ContainerDied","Data":"2d71d284919209cb1bee3c9ea09c6e1f146742d043e0c81bbcdbb1f17bd2bf07"}
Sep 14 13:13:49.575324 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.575288    2566 scope.go:117] "RemoveContainer" containerID="64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"
Sep 14 13:13:49.585312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.585292    2566 scope.go:117] "RemoveContainer" containerID="b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"
Sep 14 13:13:49.594142 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.594123    2566 scope.go:117] "RemoveContainer" containerID="64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"
Sep 14 13:13:49.594411 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:13:49.594392    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f\": container with ID starting with 64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f not found: ID does not exist" containerID="64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"
Sep 14 13:13:49.594462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.594421    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f"} err="failed to get container status \"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f\": rpc error: code = NotFound desc = could not find container \"64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f\": container with ID starting with 64e3c2dba2278412c403423ecf72863cfca1e90142b9e1222c32bb07dda4dc4f not found: ID does not exist"
Sep 14 13:13:49.594462 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.594437    2566 scope.go:117] "RemoveContainer" containerID="b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"
Sep 14 13:13:49.594681 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:13:49.594662    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575\": container with ID starting with b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575 not found: ID does not exist" containerID="b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"
Sep 14 13:13:49.594721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.594687    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575"} err="failed to get container status \"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575\": rpc error: code = NotFound desc = could not find container \"b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575\": container with ID starting with b6bb4d4491cb5c5d79fcca2bd39be895763364373bd7a4dfe0ad9f2f01379575 not found: ID does not exist"
Sep 14 13:13:49.600842 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.600823    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:49.605264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.605245    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9b4657d2-gw-openshift-default-5b5498577b-7q7bb"]
Sep 14 13:13:49.979001 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.978972    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:13:49.979537 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979517    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd64ef63-9090-4d45-abde-aa4b739a92ed" containerName="revoke-keys"
Sep 14 13:13:49.979585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979539    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd64ef63-9090-4d45-abde-aa4b739a92ed" containerName="revoke-keys"
Sep 14 13:13:49.979585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979559    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:13:49.979585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979565    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:13:49.979585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979578    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:13:49.979585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979584    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:13:49.979775 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979654    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:13:49.979775 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.979663    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd64ef63-9090-4d45-abde-aa4b739a92ed" containerName="revoke-keys"
Sep 14 13:13:49.982616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.982597    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:49.985274 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.985252    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-282dcc23\""
Sep 14 13:13:49.985388 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.985369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-282dcc23-dockercfg-bcsvk\""
Sep 14 13:13:49.993330 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:49.993305    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:13:50.020148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.020124    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.020268 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.020153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtvwc\" (UniqueName: \"kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.121158 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.121112    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.121158 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.121159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtvwc\" (UniqueName: \"kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.121778 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.121758    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.129640 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.129617    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtvwc\" (UniqueName: \"kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc\") pod \"payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.198878 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.198849    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31cf3c95-f262-443e-981e-159f261fe734" path="/var/lib/kubelet/pods/31cf3c95-f262-443e-981e-159f261fe734/volumes"
Sep 14 13:13:50.292768 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.292681    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:50.563490 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.563459    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:13:50.564985 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:13:50.564963    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0bbb28_255e_44a9_b856_5d66671cbcee.slice/crio-87d730fbcc4f96faa311fa9cfc90035e43ab9036daa81a09e0561cae148f5e5e WatchSource:0}: Error finding container 87d730fbcc4f96faa311fa9cfc90035e43ab9036daa81a09e0561cae148f5e5e: Status 404 returned error can't find the container with id 87d730fbcc4f96faa311fa9cfc90035e43ab9036daa81a09e0561cae148f5e5e
Sep 14 13:13:50.582793 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:50.582763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" event={"ID":"6b0bbb28-255e-44a9-b856-5d66671cbcee","Type":"ContainerStarted","Data":"87d730fbcc4f96faa311fa9cfc90035e43ab9036daa81a09e0561cae148f5e5e"}
Sep 14 13:13:51.590637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:51.590597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" event={"ID":"6b0bbb28-255e-44a9-b856-5d66671cbcee","Type":"ContainerStarted","Data":"7e34bc273207b9c8c436e45dbab06a945cecf879f072743d4a795f16ac97b69a"}
Sep 14 13:13:51.591039 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:51.590806    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:13:51.615820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:13:51.615777    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" podStartSLOduration=2.615763248 podStartE2EDuration="2.615763248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:51.613632599 +0000 UTC m=+941.928415950" watchObservedRunningTime="2026-09-14 13:13:51.615763248 +0000 UTC m=+941.930546600"
Sep 14 13:14:02.598076 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:02.598029    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:14:13.126628 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.126595    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"]
Sep 14 13:14:13.127126 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.127106    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31cf3c95-f262-443e-981e-159f261fe734" containerName="istio-proxy"
Sep 14 13:14:13.130091 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.130072    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:13.132853 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.132825    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:14:13.132966 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.132825    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:14:13.138892 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.138867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"]
Sep 14 13:14:13.241503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.241468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt\" (UID: \"da824940-5e8f-4266-a994-b057d5dba11d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:13.343117 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.343086    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt\" (UID: \"da824940-5e8f-4266-a994-b057d5dba11d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:13.343668 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.343648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt\" (UID: \"da824940-5e8f-4266-a994-b057d5dba11d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:13.442441 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.442370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:13.718245 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:13.718223    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"]
Sep 14 13:14:13.719862 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:14:13.719832    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda824940_5e8f_4266_a994_b057d5dba11d.slice/crio-30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff WatchSource:0}: Error finding container 30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff: Status 404 returned error can't find the container with id 30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff
Sep 14 13:14:14.720448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:14.720407    2566 generic.go:356] "Generic (PLEG): container finished" podID="da824940-5e8f-4266-a994-b057d5dba11d" containerID="925038e5593f3b351db3173c6dbee070f6eb0bab65665d10ee87df059211358b" exitCode=0
Sep 14 13:14:14.720891 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:14.720497    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt" event={"ID":"da824940-5e8f-4266-a994-b057d5dba11d","Type":"ContainerDied","Data":"925038e5593f3b351db3173c6dbee070f6eb0bab65665d10ee87df059211358b"}
Sep 14 13:14:14.720891 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:14.720543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt" event={"ID":"da824940-5e8f-4266-a994-b057d5dba11d","Type":"ContainerStarted","Data":"30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff"}
Sep 14 13:14:15.866000 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:15.865978    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:15.968628 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:15.968599    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca\") pod \"da824940-5e8f-4266-a994-b057d5dba11d\" (UID: \"da824940-5e8f-4266-a994-b057d5dba11d\") "
Sep 14 13:14:15.968931 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:15.968909    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da824940-5e8f-4266-a994-b057d5dba11d" (UID: "da824940-5e8f-4266-a994-b057d5dba11d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:14:16.069455 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:16.069392    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da824940-5e8f-4266-a994-b057d5dba11d-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:14:16.732907 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:16.732876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt" event={"ID":"da824940-5e8f-4266-a994-b057d5dba11d","Type":"ContainerDied","Data":"30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff"}
Sep 14 13:14:16.732907 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:16.732903    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"
Sep 14 13:14:16.733139 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:16.732923    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30707fdb89a71eb6c1b8812180028ad7ec859c33d9a0e5ca1a0dc1a361fa44ff"
Sep 14 13:14:19.541809 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.541775    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:14:19.542229 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.542035    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" podUID="6b0bbb28-255e-44a9-b856-5d66671cbcee" containerName="payload-pre-processing" containerID="cri-o://7e34bc273207b9c8c436e45dbab06a945cecf879f072743d4a795f16ac97b69a" gracePeriod=30
Sep 14 13:14:19.723421 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.723387    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"]
Sep 14 13:14:19.729119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.729085    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-282dcc23-bk7lt"]
Sep 14 13:14:19.761884 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.761835    2566 generic.go:356] "Generic (PLEG): container finished" podID="6b0bbb28-255e-44a9-b856-5d66671cbcee" containerID="7e34bc273207b9c8c436e45dbab06a945cecf879f072743d4a795f16ac97b69a" exitCode=0
Sep 14 13:14:19.762080 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.761983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" event={"ID":"6b0bbb28-255e-44a9-b856-5d66671cbcee","Type":"ContainerDied","Data":"7e34bc273207b9c8c436e45dbab06a945cecf879f072743d4a795f16ac97b69a"}
Sep 14 13:14:19.806850 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.806826    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:14:19.911151 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.911117    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume\") pod \"6b0bbb28-255e-44a9-b856-5d66671cbcee\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") "
Sep 14 13:14:19.911328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.911280    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtvwc\" (UniqueName: \"kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc\") pod \"6b0bbb28-255e-44a9-b856-5d66671cbcee\" (UID: \"6b0bbb28-255e-44a9-b856-5d66671cbcee\") "
Sep 14 13:14:19.911553 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.911529    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b0bbb28-255e-44a9-b856-5d66671cbcee" (UID: "6b0bbb28-255e-44a9-b856-5d66671cbcee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:14:19.911648 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.911634    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0bbb28-255e-44a9-b856-5d66671cbcee-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:14:19.913399 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:19.913374    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc" (OuterVolumeSpecName: "kube-api-access-rtvwc") pod "6b0bbb28-255e-44a9-b856-5d66671cbcee" (UID: "6b0bbb28-255e-44a9-b856-5d66671cbcee"). InnerVolumeSpecName "kube-api-access-rtvwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:14:20.012309 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.012279    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtvwc\" (UniqueName: \"kubernetes.io/projected/6b0bbb28-255e-44a9-b856-5d66671cbcee-kube-api-access-rtvwc\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:14:20.190415 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.190328    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da824940-5e8f-4266-a994-b057d5dba11d" path="/var/lib/kubelet/pods/da824940-5e8f-4266-a994-b057d5dba11d/volumes"
Sep 14 13:14:20.768394 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.768367    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"
Sep 14 13:14:20.768394 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.768381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2" event={"ID":"6b0bbb28-255e-44a9-b856-5d66671cbcee","Type":"ContainerDied","Data":"87d730fbcc4f96faa311fa9cfc90035e43ab9036daa81a09e0561cae148f5e5e"}
Sep 14 13:14:20.768827 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.768444    2566 scope.go:117] "RemoveContainer" containerID="7e34bc273207b9c8c436e45dbab06a945cecf879f072743d4a795f16ac97b69a"
Sep 14 13:14:20.787059 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.787026    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:14:20.791454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:20.791430    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-282dcc23-6cd5744c94-6mqb2"]
Sep 14 13:14:22.002196 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002161    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:14:22.002679 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002663    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da824940-5e8f-4266-a994-b057d5dba11d" containerName="revoke-keys"
Sep 14 13:14:22.002737 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002682    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da824940-5e8f-4266-a994-b057d5dba11d" containerName="revoke-keys"
Sep 14 13:14:22.002737 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002701    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b0bbb28-255e-44a9-b856-5d66671cbcee" containerName="payload-pre-processing"
Sep 14 13:14:22.002737 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002707    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0bbb28-255e-44a9-b856-5d66671cbcee" containerName="payload-pre-processing"
Sep 14 13:14:22.002899 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002781    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="da824940-5e8f-4266-a994-b057d5dba11d" containerName="revoke-keys"
Sep 14 13:14:22.002899 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.002792    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b0bbb28-255e-44a9-b856-5d66671cbcee" containerName="payload-pre-processing"
Sep 14 13:14:22.005876 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.005858    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.010650 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.010627    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3b45ef72-openshift-default-dockercfg-6gsl4\""
Sep 14 13:14:22.020253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.020229    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:14:22.031589 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031566    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031703 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhsnr\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031703 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031647    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031703 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031831 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031831 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031740    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031831 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031979 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031835    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.031979 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.031919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133398 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133594 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133412    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133594 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133594 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133594 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133573    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133771    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.133813 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.134037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133828    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.134037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.133839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhsnr\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.134166 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.134139    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.134384 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.134360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.134511 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.134426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.135882 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.135865    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.136251 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.136227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.145729 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.145704    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhsnr\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.147021 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.146996    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token\") pod \"e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") " pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.190450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.190420    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0bbb28-255e-44a9-b856-5d66671cbcee" path="/var/lib/kubelet/pods/6b0bbb28-255e-44a9-b856-5d66671cbcee/volumes"
Sep 14 13:14:22.317260 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.317187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:22.618968 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.618940    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:14:22.620564 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:14:22.620537    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda362ad3e_072c_4b47_9a49_a6b9de44a72c.slice/crio-fcf09b2e1567e49745930555ba9f36c1c9ccd2beb48edefaea1ca6bc8c2ed4e5 WatchSource:0}: Error finding container fcf09b2e1567e49745930555ba9f36c1c9ccd2beb48edefaea1ca6bc8c2ed4e5: Status 404 returned error can't find the container with id fcf09b2e1567e49745930555ba9f36c1c9ccd2beb48edefaea1ca6bc8c2ed4e5
Sep 14 13:14:22.622796 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.622765    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:22.622858 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.622831    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:22.622892 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.622859    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:22.782374 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.782332    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerStarted","Data":"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"}
Sep 14 13:14:22.782520 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.782393    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerStarted","Data":"fcf09b2e1567e49745930555ba9f36c1c9ccd2beb48edefaea1ca6bc8c2ed4e5"}
Sep 14 13:14:22.856724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:22.856663    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" podStartSLOduration=1.856642962 podStartE2EDuration="1.856642962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:14:22.85641165 +0000 UTC m=+973.171195004" watchObservedRunningTime="2026-09-14 13:14:22.856642962 +0000 UTC m=+973.171426315"
Sep 14 13:14:23.318111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:23.318070    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:23.323637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:23.323613    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:23.787624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:23.787587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:23.788445 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:23.788425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:49.369305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.369264    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"]
Sep 14 13:14:49.372987 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.372962    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:49.376439 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.376415    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:14:49.376611 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.376453    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:14:49.391376 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.391347    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"]
Sep 14 13:14:49.530350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.530315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt\" (UID: \"0ec4ad1d-f32f-47a4-908f-6966e09b5487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:49.630996 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.630894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt\" (UID: \"0ec4ad1d-f32f-47a4-908f-6966e09b5487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:49.631601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.631580    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt\" (UID: \"0ec4ad1d-f32f-47a4-908f-6966e09b5487\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:49.689871 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.689841    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:49.960980 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:49.960949    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"]
Sep 14 13:14:49.961898 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:14:49.961870    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec4ad1d_f32f_47a4_908f_6966e09b5487.slice/crio-7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00 WatchSource:0}: Error finding container 7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00: Status 404 returned error can't find the container with id 7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00
Sep 14 13:14:50.936507 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:50.936471    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ec4ad1d-f32f-47a4-908f-6966e09b5487" containerID="805d07a5c5b35343c154a85854ef32a8c6221341c44d36eaf047f229691393be" exitCode=0
Sep 14 13:14:50.936935 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:50.936558    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt" event={"ID":"0ec4ad1d-f32f-47a4-908f-6966e09b5487","Type":"ContainerDied","Data":"805d07a5c5b35343c154a85854ef32a8c6221341c44d36eaf047f229691393be"}
Sep 14 13:14:50.936935 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:50.936613    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt" event={"ID":"0ec4ad1d-f32f-47a4-908f-6966e09b5487","Type":"ContainerStarted","Data":"7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00"}
Sep 14 13:14:52.093002 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.092967    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:52.150912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.150888    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca\") pod \"0ec4ad1d-f32f-47a4-908f-6966e09b5487\" (UID: \"0ec4ad1d-f32f-47a4-908f-6966e09b5487\") "
Sep 14 13:14:52.151284 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.151258    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ec4ad1d-f32f-47a4-908f-6966e09b5487" (UID: "0ec4ad1d-f32f-47a4-908f-6966e09b5487"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:14:52.252565 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.252528    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4ad1d-f32f-47a4-908f-6966e09b5487-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:14:52.951819 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.951791    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"
Sep 14 13:14:52.951981 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.951819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt" event={"ID":"0ec4ad1d-f32f-47a4-908f-6966e09b5487","Type":"ContainerDied","Data":"7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00"}
Sep 14 13:14:52.951981 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:52.951863    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cb66fd6dfc99a30508e7bcac38cbcbb8660b50810ffa045ee038fa5994dec00"
Sep 14 13:14:53.788769 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.788732    2566 patch_prober.go:28] interesting pod/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 13:14:53.789213 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.788801    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 13:14:53.959149 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.959113    2566 generic.go:356] "Generic (PLEG): container finished" podID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerID="cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71" exitCode=0
Sep 14 13:14:53.959346 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.959188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerDied","Data":"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"}
Sep 14 13:14:53.959684 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.959665    2566 scope.go:117] "RemoveContainer" containerID="cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"
Sep 14 13:14:53.960872 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.960844    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:53.960936 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.960913    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:53.960972 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:53.960946    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:14:54.969101 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:54.969032    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerStarted","Data":"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"}
Sep 14 13:14:55.317799 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:55.317709    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:14:55.317980 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:55.317956    2566 patch_prober.go:28] interesting pod/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 13:14:55.318033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:55.318011    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 13:14:56.318139 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.318107    2566 patch_prober.go:28] interesting pod/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 14 13:14:56.318496 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.318158    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 14 13:14:56.551177 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.551139    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"]
Sep 14 13:14:56.562457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.562421    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3b45ef72-jw2tt"]
Sep 14 13:14:56.788155 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.788114    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:14:56.987128 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:56.987079    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy" containerID="cri-o://4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d" gracePeriod=30
Sep 14 13:14:58.194083 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:58.194031    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec4ad1d-f32f-47a4-908f-6966e09b5487" path="/var/lib/kubelet/pods/0ec4ad1d-f32f-47a4-908f-6966e09b5487/volumes"
Sep 14 13:14:59.258857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.258827    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"]
Sep 14 13:14:59.259292 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.259279    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec4ad1d-f32f-47a4-908f-6966e09b5487" containerName="revoke-keys"
Sep 14 13:14:59.259346 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.259294    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec4ad1d-f32f-47a4-908f-6966e09b5487" containerName="revoke-keys"
Sep 14 13:14:59.259384 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.259370    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec4ad1d-f32f-47a4-908f-6966e09b5487" containerName="revoke-keys"
Sep 14 13:14:59.262246 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.262227    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:14:59.266144 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.265707    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:14:59.266144 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.265971    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:14:59.272090 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.272068    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"]
Sep 14 13:14:59.328652 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.328618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f96382-7bqdl\" (UID: \"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:14:59.430252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.430217    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f96382-7bqdl\" (UID: \"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:14:59.430912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.430890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f96382-7bqdl\" (UID: \"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:14:59.581863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.581758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:14:59.878425 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:14:59.877507    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"]
Sep 14 13:14:59.883426 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:14:59.883365    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f47d00_40f5_41f0_bd36_10e8cb1bc8dc.slice/crio-08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701 WatchSource:0}: Error finding container 08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701: Status 404 returned error can't find the container with id 08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701
Sep 14 13:15:00.006637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.006595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl" event={"ID":"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc","Type":"ContainerStarted","Data":"08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701"}
Sep 14 13:15:00.203997 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.203960    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"]
Sep 14 13:15:00.207348 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.207319    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"
Sep 14 13:15:00.217735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.217712    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"
Sep 14 13:15:00.228412 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.228388    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"]
Sep 14 13:15:00.234157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.234107    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"
Sep 14 13:15:00.236410 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.236321    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"]
Sep 14 13:15:00.260308 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.260262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"
Sep 14 13:15:00.277233 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.277163    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"]
Sep 14 13:15:00.284089 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.283877    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"
Sep 14 13:15:00.285508 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.283776    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"]
Sep 14 13:15:00.301491 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.301467    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"
Sep 14 13:15:00.325377 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.325241    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"]
Sep 14 13:15:00.557284 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.557256    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"]
Sep 14 13:15:00.558858 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:15:00.558830    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc585ff22_787f_4dd0_b212_7fe1c109074b.slice/crio-a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347 WatchSource:0}: Error finding container a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347: Status 404 returned error can't find the container with id a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347
Sep 14 13:15:00.609533 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.609499    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"]
Sep 14 13:15:00.637256 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:15:00.637228    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2f5f05_5d29_4176_9511_02cb5659752d.slice/crio-8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049 WatchSource:0}: Error finding container 8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049: Status 404 returned error can't find the container with id 8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049
Sep 14 13:15:00.647548 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:00.647519    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"]
Sep 14 13:15:00.650252 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:15:00.650225    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50375edd_3953_4a4e_af98_dbc38e5fc3ce.slice/crio-8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1 WatchSource:0}: Error finding container 8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1: Status 404 returned error can't find the container with id 8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1
Sep 14 13:15:01.013351 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.013323    2566 generic.go:356] "Generic (PLEG): container finished" podID="04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" containerID="7fe02552477fd1b1be4ddb7828511be7cc95331c848362bf875c3c61b9af87d2" exitCode=0
Sep 14 13:15:01.013459 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.013409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl" event={"ID":"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc","Type":"ContainerDied","Data":"7fe02552477fd1b1be4ddb7828511be7cc95331c848362bf875c3c61b9af87d2"}
Sep 14 13:15:01.014964 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.014942    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s" event={"ID":"3f2f5f05-5d29-4176-9511-02cb5659752d","Type":"ContainerStarted","Data":"d8505e1373401cce8407fd95716301de9580d83b9d3a0dea69a10600f582a4ea"}
Sep 14 13:15:01.015071 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.014981    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s" event={"ID":"3f2f5f05-5d29-4176-9511-02cb5659752d","Type":"ContainerStarted","Data":"8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049"}
Sep 14 13:15:01.016431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.016409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq" event={"ID":"c585ff22-787f-4dd0-b212-7fe1c109074b","Type":"ContainerStarted","Data":"1a49393e4a7b569f962ea7054902e0d51dc21076dd128831b7c26065f66eb8f0"}
Sep 14 13:15:01.016523 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.016457    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq" event={"ID":"c585ff22-787f-4dd0-b212-7fe1c109074b","Type":"ContainerStarted","Data":"a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347"}
Sep 14 13:15:01.018080 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.018060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb" event={"ID":"50375edd-3953-4a4e-af98-dbc38e5fc3ce","Type":"ContainerStarted","Data":"49044cf36ed67da5d9c542dff11ea701b8a7a47bf19afbb03b84c30efd72c7b7"}
Sep 14 13:15:01.018169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.018097    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb" event={"ID":"50375edd-3953-4a4e-af98-dbc38e5fc3ce","Type":"ContainerStarted","Data":"8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1"}
Sep 14 13:15:01.054733 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.054689    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s" podStartSLOduration=1.054676933 podStartE2EDuration="1.054676933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:15:01.051921633 +0000 UTC m=+1011.366704986" watchObservedRunningTime="2026-09-14 13:15:01.054676933 +0000 UTC m=+1011.369460285"
Sep 14 13:15:01.074766 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.074727    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb" podStartSLOduration=1.074714088 podStartE2EDuration="1.074714088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:15:01.073586462 +0000 UTC m=+1011.388369817" watchObservedRunningTime="2026-09-14 13:15:01.074714088 +0000 UTC m=+1011.389497440"
Sep 14 13:15:01.092117 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:01.092078    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq" podStartSLOduration=1.092039952 podStartE2EDuration="1.092039952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:15:01.091415147 +0000 UTC m=+1011.406198500" watchObservedRunningTime="2026-09-14 13:15:01.092039952 +0000 UTC m=+1011.406823304"
Sep 14 13:15:02.025663 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.025568    2566 generic.go:356] "Generic (PLEG): container finished" podID="3f2f5f05-5d29-4176-9511-02cb5659752d" containerID="d8505e1373401cce8407fd95716301de9580d83b9d3a0dea69a10600f582a4ea" exitCode=0
Sep 14 13:15:02.025663 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.025649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s" event={"ID":"3f2f5f05-5d29-4176-9511-02cb5659752d","Type":"ContainerDied","Data":"d8505e1373401cce8407fd95716301de9580d83b9d3a0dea69a10600f582a4ea"}
Sep 14 13:15:02.027282 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.027254    2566 generic.go:356] "Generic (PLEG): container finished" podID="c585ff22-787f-4dd0-b212-7fe1c109074b" containerID="1a49393e4a7b569f962ea7054902e0d51dc21076dd128831b7c26065f66eb8f0" exitCode=0
Sep 14 13:15:02.027364 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.027333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq" event={"ID":"c585ff22-787f-4dd0-b212-7fe1c109074b","Type":"ContainerDied","Data":"1a49393e4a7b569f962ea7054902e0d51dc21076dd128831b7c26065f66eb8f0"}
Sep 14 13:15:02.028817 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.028793    2566 generic.go:356] "Generic (PLEG): container finished" podID="50375edd-3953-4a4e-af98-dbc38e5fc3ce" containerID="49044cf36ed67da5d9c542dff11ea701b8a7a47bf19afbb03b84c30efd72c7b7" exitCode=0
Sep 14 13:15:02.028953 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.028822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb" event={"ID":"50375edd-3953-4a4e-af98-dbc38e5fc3ce","Type":"ContainerDied","Data":"49044cf36ed67da5d9c542dff11ea701b8a7a47bf19afbb03b84c30efd72c7b7"}
Sep 14 13:15:02.176413 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.176390    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:15:02.259218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.259188    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca\") pod \"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc\" (UID: \"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc\") "
Sep 14 13:15:02.259617 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.259593    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" (UID: "04f47d00-40f5-41f0-bd36-10e8cb1bc8dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:15:02.259711 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:02.259694    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:03.035416 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.035385    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"
Sep 14 13:15:03.035416 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.035395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl" event={"ID":"04f47d00-40f5-41f0-bd36-10e8cb1bc8dc","Type":"ContainerDied","Data":"08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701"}
Sep 14 13:15:03.035953 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.035449    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08d12bcf5206867c7eb68844d33684741044d9b0108997bff62d84888e285701"
Sep 14 13:15:03.192286 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.192264    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"
Sep 14 13:15:03.241347 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.241327    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"
Sep 14 13:15:03.244492 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:03.244470    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"
Sep 14 13:15:04.050100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.050066    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"
Sep 14 13:15:04.050556 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.050068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s" event={"ID":"3f2f5f05-5d29-4176-9511-02cb5659752d","Type":"ContainerDied","Data":"8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049"}
Sep 14 13:15:04.050556 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.050212    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8483d083c8c1827539d54c7667a2bae2b9fc9c7e5250cc3d1d4bacf2bd6c9049"
Sep 14 13:15:04.051577 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.051554    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"
Sep 14 13:15:04.051711 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.051569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq" event={"ID":"c585ff22-787f-4dd0-b212-7fe1c109074b","Type":"ContainerDied","Data":"a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347"}
Sep 14 13:15:04.051711 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.051619    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1eca1e87d58b864fde36d05769ab9f2bc10507d9db971619ab44d8b94f95347"
Sep 14 13:15:04.052964 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.052944    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"
Sep 14 13:15:04.053091 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.052992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb" event={"ID":"50375edd-3953-4a4e-af98-dbc38e5fc3ce","Type":"ContainerDied","Data":"8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1"}
Sep 14 13:15:04.053091 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:04.053028    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8587b454107bac28b0493711e38e1caeb8bd330f6b32a920ee296e65122896b1"
Sep 14 13:15:05.533379 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.533357    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:15:05.593820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.593728    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.593820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.593792    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594099 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.593827    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594099 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.593936    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594099 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.593999    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594099 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594033    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594117    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594151    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594157    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594210    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594257    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:05.594328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594261    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhsnr\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr\") pod \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\" (UID: \"a362ad3e-072c-4b47-9a49-a6b9de44a72c\") "
Sep 14 13:15:05.594625 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594385    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:05.594625 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594468    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:05.594735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594687    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.594735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594700    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.594735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594708    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.594735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594718    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.594735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.594725    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.596125 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.596097    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:15:05.596232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.596197    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr" (OuterVolumeSpecName: "kube-api-access-rhsnr") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "kube-api-access-rhsnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:05.596452 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.596425    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:05.596545 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.596471    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a362ad3e-072c-4b47-9a49-a6b9de44a72c" (UID: "a362ad3e-072c-4b47-9a49-a6b9de44a72c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:05.695432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.695398    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.695432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.695426    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhsnr\" (UniqueName: \"kubernetes.io/projected/a362ad3e-072c-4b47-9a49-a6b9de44a72c-kube-api-access-rhsnr\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.695432 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.695436    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:05.695652 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:05.695445    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a362ad3e-072c-4b47-9a49-a6b9de44a72c-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:06.066928 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.066895    2566 generic.go:356] "Generic (PLEG): container finished" podID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerID="4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d" exitCode=0
Sep 14 13:15:06.067116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.066948    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"
Sep 14 13:15:06.067116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.066963    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerDied","Data":"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"}
Sep 14 13:15:06.067116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.067007    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm" event={"ID":"a362ad3e-072c-4b47-9a49-a6b9de44a72c","Type":"ContainerDied","Data":"fcf09b2e1567e49745930555ba9f36c1c9ccd2beb48edefaea1ca6bc8c2ed4e5"}
Sep 14 13:15:06.067116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.067030    2566 scope.go:117] "RemoveContainer" containerID="4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"
Sep 14 13:15:06.077391 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.077368    2566 scope.go:117] "RemoveContainer" containerID="cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"
Sep 14 13:15:06.086238 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.086217    2566 scope.go:117] "RemoveContainer" containerID="4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"
Sep 14 13:15:06.086518 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:15:06.086498    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d\": container with ID starting with 4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d not found: ID does not exist" containerID="4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"
Sep 14 13:15:06.086569 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.086528    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d"} err="failed to get container status \"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d\": rpc error: code = NotFound desc = could not find container \"4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d\": container with ID starting with 4ad33c4e7c91f92a2d964989bc9bec1a74f616aad83684459fbadc8d1c39398d not found: ID does not exist"
Sep 14 13:15:06.086569 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.086546    2566 scope.go:117] "RemoveContainer" containerID="cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"
Sep 14 13:15:06.086792 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:15:06.086773    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71\": container with ID starting with cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71 not found: ID does not exist" containerID="cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"
Sep 14 13:15:06.086839 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.086798    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71"} err="failed to get container status \"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71\": rpc error: code = NotFound desc = could not find container \"cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71\": container with ID starting with cf9b740aee0116d2673404665301cca1688b3111df8001e409ca771054127b71 not found: ID does not exist"
Sep 14 13:15:06.097985 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.097961    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:15:06.123989 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.123968    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3b45ef72-openshift-default-5fdc69956-7svmm"]
Sep 14 13:15:06.190330 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:06.190302    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" path="/var/lib/kubelet/pods/a362ad3e-072c-4b47-9a49-a6b9de44a72c/volumes"
Sep 14 13:15:10.077921 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.077881    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:15:10.078476 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.078123    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" podUID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" containerName="payload-pre-processing" containerID="cri-o://a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2" gracePeriod=30
Sep 14 13:15:10.255450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.255420    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"]
Sep 14 13:15:10.258277 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.258253    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f96382-7bqdl"]
Sep 14 13:15:10.348756 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.348732    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:15:10.440543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.440510    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume\") pod \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") "
Sep 14 13:15:10.440702 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.440603    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6twrw\" (UniqueName: \"kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw\") pod \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\" (UID: \"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c\") "
Sep 14 13:15:10.440872 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.440849    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" (UID: "c647c6dd-28c5-4970-b6e7-d0bc7b69b83c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:15:10.442663 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.442639    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw" (OuterVolumeSpecName: "kube-api-access-6twrw") pod "c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" (UID: "c647c6dd-28c5-4970-b6e7-d0bc7b69b83c"). InnerVolumeSpecName "kube-api-access-6twrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:10.541526 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.541478    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:10.541526 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:10.541520    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6twrw\" (UniqueName: \"kubernetes.io/projected/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c-kube-api-access-6twrw\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:11.100676 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.100644    2566 generic.go:356] "Generic (PLEG): container finished" podID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" containerID="a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2" exitCode=0
Sep 14 13:15:11.101140 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.100685    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"
Sep 14 13:15:11.101140 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.100729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" event={"ID":"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c","Type":"ContainerDied","Data":"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"}
Sep 14 13:15:11.101140 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.100788    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw" event={"ID":"c647c6dd-28c5-4970-b6e7-d0bc7b69b83c","Type":"ContainerDied","Data":"c4ec0d0656e382a8b27955cbf0e77031954def6e4d0fe434acf0950ac27e94e9"}
Sep 14 13:15:11.101140 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.100825    2566 scope.go:117] "RemoveContainer" containerID="a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"
Sep 14 13:15:11.109811 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.109793    2566 scope.go:117] "RemoveContainer" containerID="a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"
Sep 14 13:15:11.110110 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:15:11.110088    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2\": container with ID starting with a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2 not found: ID does not exist" containerID="a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"
Sep 14 13:15:11.110183 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.110119    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2"} err="failed to get container status \"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2\": rpc error: code = NotFound desc = could not find container \"a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2\": container with ID starting with a669222e0b1262507dede17cc82f8ee73c330a0632ba98126dacc946698d6de2 not found: ID does not exist"
Sep 14 13:15:11.123946 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.123926    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:15:11.133735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:11.133712    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f96382-5d4c9c746b-l7zgw"]
Sep 14 13:15:12.190735 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:12.190705    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" path="/var/lib/kubelet/pods/04f47d00-40f5-41f0-bd36-10e8cb1bc8dc/volumes"
Sep 14 13:15:12.191123 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:12.191089    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" path="/var/lib/kubelet/pods/c647c6dd-28c5-4970-b6e7-d0bc7b69b83c/volumes"
Sep 14 13:15:53.279632 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:53.279594    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:15:53.280073 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:53.279862    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy" containerID="cri-o://389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704" gracePeriod=30
Sep 14 13:15:58.534556 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.534532    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:15:58.699309 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699217    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699309 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699280    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699309 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699300    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdbd4\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699320    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699355    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699397    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699448    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699511    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:58.699593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699525    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy\") pod \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\" (UID: \"6b4564ad-fc80-48f1-8f1c-43ad380f155c\") "
Sep 14 13:15:58.699955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699710    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:58.699955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699726    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:58.699955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699738    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:58.699955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.699792    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:15:58.700226 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.700026    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.700226 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.700083    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.700226 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.700098    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.700226 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.700110    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.700226 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.700123    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.701906 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.701879    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:58.702012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.701912    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:58.702012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.701941    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:15:58.702012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.701968    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4" (OuterVolumeSpecName: "kube-api-access-tdbd4") pod "6b4564ad-fc80-48f1-8f1c-43ad380f155c" (UID: "6b4564ad-fc80-48f1-8f1c-43ad380f155c"). InnerVolumeSpecName "kube-api-access-tdbd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:58.801111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.801000    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdbd4\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-kube-api-access-tdbd4\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.801111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.801038    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.801111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.801073    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:58.801111 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:58.801086    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b4564ad-fc80-48f1-8f1c-43ad380f155c-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:15:59.367074 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.366807    2566 generic.go:356] "Generic (PLEG): container finished" podID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerID="389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704" exitCode=0
Sep 14 13:15:59.367074 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.366957    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerDied","Data":"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"}
Sep 14 13:15:59.368404 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.367358    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g" event={"ID":"6b4564ad-fc80-48f1-8f1c-43ad380f155c","Type":"ContainerDied","Data":"de1345ce3f3e9b4fe727413534eceeb8ab1cc559487f04396e7d0dee8d991133"}
Sep 14 13:15:59.368404 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.367425    2566 scope.go:117] "RemoveContainer" containerID="389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"
Sep 14 13:15:59.368404 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.367637    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"
Sep 14 13:15:59.377750 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.377731    2566 scope.go:117] "RemoveContainer" containerID="ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"
Sep 14 13:15:59.385710 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.385693    2566 scope.go:117] "RemoveContainer" containerID="389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"
Sep 14 13:15:59.385976 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:15:59.385959    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704\": container with ID starting with 389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704 not found: ID does not exist" containerID="389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"
Sep 14 13:15:59.386025 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.385983    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704"} err="failed to get container status \"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704\": rpc error: code = NotFound desc = could not find container \"389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704\": container with ID starting with 389675fd52d1c278858966235a43d25d64d513fbbdd201962b462785bf82e704 not found: ID does not exist"
Sep 14 13:15:59.386025 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.385997    2566 scope.go:117] "RemoveContainer" containerID="ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"
Sep 14 13:15:59.386257 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:15:59.386241    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1\": container with ID starting with ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1 not found: ID does not exist" containerID="ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"
Sep 14 13:15:59.386307 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.386260    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1"} err="failed to get container status \"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1\": rpc error: code = NotFound desc = could not find container \"ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1\": container with ID starting with ab79873264ec4c044580d340b8f2cc11cab606be69da93744012bf3ff07246b1 not found: ID does not exist"
Sep 14 13:15:59.393796 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.393773    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:15:59.396749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:15:59.396730    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-f96382-openshift-default-7ccd78fdb-w9b2g"]
Sep 14 13:16:00.190846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:00.190812    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" path="/var/lib/kubelet/pods/6b4564ad-fc80-48f1-8f1c-43ad380f155c/volumes"
Sep 14 13:16:02.249983 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.249948    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:16:02.250425 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250400    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" containerName="revoke-keys"
Sep 14 13:16:02.250425 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250419    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" containerName="revoke-keys"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250432    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" containerName="payload-pre-processing"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250438    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" containerName="payload-pre-processing"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250449    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250456    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250467    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2f5f05-5d29-4176-9511-02cb5659752d" containerName="cleanup"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250473    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2f5f05-5d29-4176-9511-02cb5659752d" containerName="cleanup"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250486    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250491    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250497    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50375edd-3953-4a4e-af98-dbc38e5fc3ce" containerName="cleanup"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250502    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50375edd-3953-4a4e-af98-dbc38e5fc3ce" containerName="cleanup"
Sep 14 13:16:02.250510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250511    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250515    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250521    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250526    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250532    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c585ff22-787f-4dd0-b212-7fe1c109074b" containerName="cleanup"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250537    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c585ff22-787f-4dd0-b212-7fe1c109074b" containerName="cleanup"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250598    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f2f5f05-5d29-4176-9511-02cb5659752d" containerName="cleanup"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250606    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250612    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a362ad3e-072c-4b47-9a49-a6b9de44a72c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250620    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="50375edd-3953-4a4e-af98-dbc38e5fc3ce" containerName="cleanup"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250627    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c647c6dd-28c5-4970-b6e7-d0bc7b69b83c" containerName="payload-pre-processing"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250632    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c585ff22-787f-4dd0-b212-7fe1c109074b" containerName="cleanup"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250638    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250643    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f47d00-40f5-41f0-bd36-10e8cb1bc8dc" containerName="revoke-keys"
Sep 14 13:16:02.250832 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.250647    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b4564ad-fc80-48f1-8f1c-43ad380f155c" containerName="istio-proxy"
Sep 14 13:16:02.254984 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.254968    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.258886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.258870    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-55cb42\""
Sep 14 13:16:02.278056 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.278013    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:16:02.314765 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.314738    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:16:02.318317 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.318301    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.322126 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.322098    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-55cb42-dockercfg-pq4dc\""
Sep 14 13:16:02.343525 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.343497    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:16:02.434781 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.434700    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.434781 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.434753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqn7t\" (UniqueName: \"kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.434965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.434867    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.434965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.434903    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5sv\" (UniqueName: \"kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.535579 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.535487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.535579 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.535532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqn7t\" (UniqueName: \"kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.535792 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.535603    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.535792 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.535639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5sv\" (UniqueName: \"kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.536419 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.536388    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.536419 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.536415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.546968 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.546940    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqn7t\" (UniqueName: \"kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t\") pod \"payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") " pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.546968 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.546962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5sv\" (UniqueName: \"kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv\") pod \"payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.565189 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.565164    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:02.629792 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.629761    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:02.839963 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.839936    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:16:02.841509 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:16:02.841457    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41143939_d8c2_466b_a665_6186ed6eb1e6.slice/crio-5955869417b202b85717b4091bcb38693161b02728ea6cb9e240124c0eb46991 WatchSource:0}: Error finding container 5955869417b202b85717b4091bcb38693161b02728ea6cb9e240124c0eb46991: Status 404 returned error can't find the container with id 5955869417b202b85717b4091bcb38693161b02728ea6cb9e240124c0eb46991
Sep 14 13:16:02.912028 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:02.911998    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:16:02.912143 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:16:02.912034    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d339336_b312_42c9_b1fb_45ff35e12e69.slice/crio-0d1c175e9f4be71f2777e06f10c71505a90e39c38819ae0a0ec05c4a32794b57 WatchSource:0}: Error finding container 0d1c175e9f4be71f2777e06f10c71505a90e39c38819ae0a0ec05c4a32794b57: Status 404 returned error can't find the container with id 0d1c175e9f4be71f2777e06f10c71505a90e39c38819ae0a0ec05c4a32794b57
Sep 14 13:16:03.392820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.392785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" event={"ID":"2d339336-b312-42c9-b1fb-45ff35e12e69","Type":"ContainerStarted","Data":"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"}
Sep 14 13:16:03.393342 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.392851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:03.393342 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.392879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" event={"ID":"2d339336-b312-42c9-b1fb-45ff35e12e69","Type":"ContainerStarted","Data":"0d1c175e9f4be71f2777e06f10c71505a90e39c38819ae0a0ec05c4a32794b57"}
Sep 14 13:16:03.394697 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.394665    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" event={"ID":"41143939-d8c2-466b-a665-6186ed6eb1e6","Type":"ContainerStarted","Data":"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"}
Sep 14 13:16:03.394844 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.394721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" event={"ID":"41143939-d8c2-466b-a665-6186ed6eb1e6","Type":"ContainerStarted","Data":"5955869417b202b85717b4091bcb38693161b02728ea6cb9e240124c0eb46991"}
Sep 14 13:16:03.394844 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.394768    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:03.468578 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.468520    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" podStartSLOduration=1.468498279 podStartE2EDuration="1.468498279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:03.443820248 +0000 UTC m=+1073.758603598" watchObservedRunningTime="2026-09-14 13:16:03.468498279 +0000 UTC m=+1073.783281633"
Sep 14 13:16:03.469986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:03.469912    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" podStartSLOduration=1.469899565 podStartE2EDuration="1.469899565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:03.46828563 +0000 UTC m=+1073.783068980" watchObservedRunningTime="2026-09-14 13:16:03.469899565 +0000 UTC m=+1073.784682917"
Sep 14 13:16:14.403857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:14.403815    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:16:14.404272 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:14.403909    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:16:37.691258 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.691220    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:16:37.695515 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.695494    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.700166 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.700146    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9aa3a5ca-openshift-default-dockercfg-r7pzj\""
Sep 14 13:16:37.709354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.709332    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:16:37.752145 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752147    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752196    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752259    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752275    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752350 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752298    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752518 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752397    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxfc\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752518 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.752518 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.752502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853459 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxfc\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853508    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853623    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853701    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853998 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853998 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.853998 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.853799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.854189 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.854102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.854249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.854226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.854358 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.854331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.854489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.854420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.854546 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.854511    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.856014 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.855991    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.856311 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.856294    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.862864 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.862838    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:37.862864 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:37.862857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxfc\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc\") pod \"e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") " pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:38.006141 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.006112    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:38.460037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.460012    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:16:38.463791 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:16:38.463755    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfaf96cf_6c3f_4015_a07c_938bcaf1a120.slice/crio-e5f2fcc23367c421796eb84a3aa69cf518ccad36a508fd69a3e7b335ddb29280 WatchSource:0}: Error finding container e5f2fcc23367c421796eb84a3aa69cf518ccad36a508fd69a3e7b335ddb29280: Status 404 returned error can't find the container with id e5f2fcc23367c421796eb84a3aa69cf518ccad36a508fd69a3e7b335ddb29280
Sep 14 13:16:38.466242 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.466208    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:16:38.466352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.466288    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:16:38.466352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.466334    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:16:38.590399 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.590364    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerStarted","Data":"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"}
Sep 14 13:16:38.590566 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.590428    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerStarted","Data":"e5f2fcc23367c421796eb84a3aa69cf518ccad36a508fd69a3e7b335ddb29280"}
Sep 14 13:16:38.790806 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:38.790689    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podStartSLOduration=1.7906635180000001 podStartE2EDuration="1.790663518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:38.788816133 +0000 UTC m=+1109.103599484" watchObservedRunningTime="2026-09-14 13:16:38.790663518 +0000 UTC m=+1109.105446870"
Sep 14 13:16:39.006558 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:39.006527    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:39.011746 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:39.011720    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:39.596220 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:39.596187    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:16:39.597115 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:16:39.597092    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:10.639251 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:10.639209    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 13:17:10.639700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:10.639283    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:17:11.789126 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.789091    2566 generic.go:356] "Generic (PLEG): container finished" podID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerID="7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de" exitCode=0
Sep 14 13:17:11.789527 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.789133    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerDied","Data":"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"}
Sep 14 13:17:11.789597 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.789580    2566 scope.go:117] "RemoveContainer" containerID="7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"
Sep 14 13:17:11.790759 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.790731    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:11.790810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.790797    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:11.790846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:11.790830    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:12.797488 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:12.797453    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerStarted","Data":"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"}
Sep 14 13:17:13.007252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:13.007209    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:13.007464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:13.007440    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 14 13:17:13.007509 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:13.007490    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 14 13:17:14.007312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:14.007272    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 14 13:17:14.007675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:14.007348    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 14 13:17:15.006847 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:15.006810    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 14 13:17:15.007025 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:15.006879    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 14 13:17:16.006467 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:16.006427    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 14 13:17:16.006822 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:16.006482    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 14 13:17:17.007409 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:17.007374    2566 patch_prober.go:28] interesting pod/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 14 13:17:17.007797 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:17.007424    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 14 13:17:18.070528 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:18.070474    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:18.070992 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:18.070871    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:18.074720 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:18.074690    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:23.978634 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:23.978599    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"]
Sep 14 13:17:23.981533 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:23.981511    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:23.984586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:23.984569    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:17:23.984677 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:23.984605    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:17:23.998706 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:23.998679    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"]
Sep 14 13:17:24.102391 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.102364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l\" (UID: \"2ece6a22-683f-4850-a67a-7b7d766e564e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:24.203442 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.203416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l\" (UID: \"2ece6a22-683f-4850-a67a-7b7d766e564e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:24.203974 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.203956    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l\" (UID: \"2ece6a22-683f-4850-a67a-7b7d766e564e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:24.291835 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.291758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:24.565290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.565260    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"]
Sep 14 13:17:24.566609 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:17:24.566587    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ece6a22_683f_4850_a67a_7b7d766e564e.slice/crio-20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7 WatchSource:0}: Error finding container 20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7: Status 404 returned error can't find the container with id 20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7
Sep 14 13:17:24.863912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:24.863828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l" event={"ID":"2ece6a22-683f-4850-a67a-7b7d766e564e","Type":"ContainerStarted","Data":"20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7"}
Sep 14 13:17:25.870548 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:25.870514    2566 generic.go:356] "Generic (PLEG): container finished" podID="2ece6a22-683f-4850-a67a-7b7d766e564e" containerID="e02e8fd7647883b7341a78b7b0e35ce584f64b209a7e58d16c795c9ab210992b" exitCode=0
Sep 14 13:17:25.870914 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:25.870581    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l" event={"ID":"2ece6a22-683f-4850-a67a-7b7d766e564e","Type":"ContainerDied","Data":"e02e8fd7647883b7341a78b7b0e35ce584f64b209a7e58d16c795c9ab210992b"}
Sep 14 13:17:27.006810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.006787    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:27.131238 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.131168    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca\") pod \"2ece6a22-683f-4850-a67a-7b7d766e564e\" (UID: \"2ece6a22-683f-4850-a67a-7b7d766e564e\") "
Sep 14 13:17:27.131491 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.131468    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ece6a22-683f-4850-a67a-7b7d766e564e" (UID: "2ece6a22-683f-4850-a67a-7b7d766e564e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:17:27.232672 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.232646    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ece6a22-683f-4850-a67a-7b7d766e564e-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:27.882976 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.882943    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l" event={"ID":"2ece6a22-683f-4850-a67a-7b7d766e564e","Type":"ContainerDied","Data":"20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7"}
Sep 14 13:17:27.882976 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.882973    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"
Sep 14 13:17:27.883208 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:27.882990    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20b867b682c9e642c2b7e5e48e84f13642022f7683c92b41aee3211c65f1a6d7"
Sep 14 13:17:35.066119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:35.066030    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"]
Sep 14 13:17:35.073133 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:35.073108    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aa3a5ca-gn46l"]
Sep 14 13:17:36.190781 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:36.190748    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ece6a22-683f-4850-a67a-7b7d766e564e" path="/var/lib/kubelet/pods/2ece6a22-683f-4850-a67a-7b7d766e564e/volumes"
Sep 14 13:17:41.974803 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:41.974772    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:17:41.975310 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:41.974999    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy" containerID="cri-o://d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23" gracePeriod=30
Sep 14 13:17:47.228220 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.228189    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:47.324584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324518    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324550    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324774 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324588    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324774 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324648    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324774 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324667    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324774 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324717    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkxfc\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.324774 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324746    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.325036 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324750    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:17:47.325036 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324822    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.325036 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324827    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:17:47.325036 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.324858    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo\") pod \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\" (UID: \"cfaf96cf-6c3f-4015-a07c-938bcaf1a120\") "
Sep 14 13:17:47.325267 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325038    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:17:47.325267 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325033    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:17:47.325382 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325268    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:17:47.325428 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325388    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.325428 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325411    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.325428 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325425    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.325550 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325438    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.325550 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.325453    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.326857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.326833    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:17:47.327075 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.327038    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc" (OuterVolumeSpecName: "kube-api-access-mkxfc") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "kube-api-access-mkxfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:17:47.327354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.327329    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:17:47.327354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.327341    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfaf96cf-6c3f-4015-a07c-938bcaf1a120" (UID: "cfaf96cf-6c3f-4015-a07c-938bcaf1a120"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:17:47.426188 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.426159    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.426188 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.426185    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkxfc\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-kube-api-access-mkxfc\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.426188 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.426194    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:47.426400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:47.426203    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfaf96cf-6c3f-4015-a07c-938bcaf1a120-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:17:48.010064 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.010012    2566 generic.go:356] "Generic (PLEG): container finished" podID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerID="d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23" exitCode=0
Sep 14 13:17:48.010232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.010088    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"
Sep 14 13:17:48.010232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.010087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerDied","Data":"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"}
Sep 14 13:17:48.010232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.010173    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6" event={"ID":"cfaf96cf-6c3f-4015-a07c-938bcaf1a120","Type":"ContainerDied","Data":"e5f2fcc23367c421796eb84a3aa69cf518ccad36a508fd69a3e7b335ddb29280"}
Sep 14 13:17:48.010232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.010197    2566 scope.go:117] "RemoveContainer" containerID="d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"
Sep 14 13:17:48.019917 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.019902    2566 scope.go:117] "RemoveContainer" containerID="7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"
Sep 14 13:17:48.028203 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.028184    2566 scope.go:117] "RemoveContainer" containerID="d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"
Sep 14 13:17:48.028449 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:17:48.028433    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23\": container with ID starting with d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23 not found: ID does not exist" containerID="d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"
Sep 14 13:17:48.028496 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.028457    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23"} err="failed to get container status \"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23\": rpc error: code = NotFound desc = could not find container \"d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23\": container with ID starting with d4b668e036f062e94ec04cd3a870ffddee1f2af8f727603c2b62b76622ea5c23 not found: ID does not exist"
Sep 14 13:17:48.028496 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.028470    2566 scope.go:117] "RemoveContainer" containerID="7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"
Sep 14 13:17:48.028672 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:17:48.028657    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de\": container with ID starting with 7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de not found: ID does not exist" containerID="7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"
Sep 14 13:17:48.028733 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.028677    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de"} err="failed to get container status \"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de\": rpc error: code = NotFound desc = could not find container \"7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de\": container with ID starting with 7a2b890dde2f9683757d92dd82000ea3315051b86f4f709682063e2ef04c80de not found: ID does not exist"
Sep 14 13:17:48.039355 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.039334    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:17:48.045452 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.045432    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9aa3a5ca-openshift-default-84f5bd7fc6-b5gq6"]
Sep 14 13:17:48.191052 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:48.191008    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" path="/var/lib/kubelet/pods/cfaf96cf-6c3f-4015-a07c-938bcaf1a120/volumes"
Sep 14 13:17:58.078573 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.078543    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:17:58.078996 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.078983    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ece6a22-683f-4850-a67a-7b7d766e564e" containerName="revoke-keys"
Sep 14 13:17:58.078996 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.078995    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ece6a22-683f-4850-a67a-7b7d766e564e" containerName="revoke-keys"
Sep 14 13:17:58.079100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079013    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079019    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079025    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079031    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079115    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079125    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfaf96cf-6c3f-4015-a07c-938bcaf1a120" containerName="istio-proxy"
Sep 14 13:17:58.079230 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.079132    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ece6a22-683f-4850-a67a-7b7d766e564e" containerName="revoke-keys"
Sep 14 13:17:58.083717 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.083699    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.086810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.086788    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-366f7d-openshift-default-dockercfg-j99wc\""
Sep 14 13:17:58.107275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.107252    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:17:58.231781 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.231933 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.231933 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.231933 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231917    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.232108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231946    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.232108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.231971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.232108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.232008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4br77\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.232206 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.232129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.232206 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.232162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333576    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4br77\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.333863 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333830    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334196 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.333879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334368 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.334345    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334443 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.334373    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334443 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.334434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334559 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.334445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.334559 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.334533    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.336012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.335990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.336249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.336232    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.348485 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.348457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.348720 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.348700    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4br77\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77\") pod \"e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") " pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.394265 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.394242    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:58.685844 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.685818    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:17:58.687916 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:17:58.687888    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9802e388_2a04_4e12_8055_999ef326de97.slice/crio-97ccbae08d4a0346c95979482cc4287399ea3fa7bb633dff02970cfaa645c8d9 WatchSource:0}: Error finding container 97ccbae08d4a0346c95979482cc4287399ea3fa7bb633dff02970cfaa645c8d9: Status 404 returned error can't find the container with id 97ccbae08d4a0346c95979482cc4287399ea3fa7bb633dff02970cfaa645c8d9
Sep 14 13:17:58.690143 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.690109    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:58.690256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.690191    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:58.690256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:58.690235    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:17:59.076025 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:59.075991    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerStarted","Data":"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"}
Sep 14 13:17:59.076249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:59.076066    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerStarted","Data":"97ccbae08d4a0346c95979482cc4287399ea3fa7bb633dff02970cfaa645c8d9"}
Sep 14 13:17:59.105762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:59.105710    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podStartSLOduration=1.105697096 podStartE2EDuration="1.105697096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:17:59.104976354 +0000 UTC m=+1189.419759707" watchObservedRunningTime="2026-09-14 13:17:59.105697096 +0000 UTC m=+1189.420480448"
Sep 14 13:17:59.394980 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:59.394895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:17:59.400981 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:17:59.400957    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:00.082221 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:00.082186    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:00.083037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:00.083011    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:10.237539 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.237506    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:18:10.240298 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.240275    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:18:10.418755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.418724    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:18:10.423442 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.423426    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.426252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.426230    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-366f7d-dockercfg-kjpqz\""
Sep 14 13:18:10.426416 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.426398    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-366f7d\""
Sep 14 13:18:10.445990 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.445969    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:18:10.548820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.548748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.548940 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.548823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gv45\" (UniqueName: \"kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.650119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.650088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.650288 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.650177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gv45\" (UniqueName: \"kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.650787 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.650769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.660563 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.660540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gv45\" (UniqueName: \"kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45\") pod \"payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:10.733915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:10.733892    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:11.027541 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:11.027517    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:18:11.028584 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:18:11.028558    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404a3444_6ee0_4bb4_871a_beea9d3a6813.slice/crio-b69470a5ddc1465d13b8c621ebb7e478b75c372231f9ac19c9b3172b794c0720 WatchSource:0}: Error finding container b69470a5ddc1465d13b8c621ebb7e478b75c372231f9ac19c9b3172b794c0720: Status 404 returned error can't find the container with id b69470a5ddc1465d13b8c621ebb7e478b75c372231f9ac19c9b3172b794c0720
Sep 14 13:18:11.147586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:11.147551    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" event={"ID":"404a3444-6ee0-4bb4-871a-beea9d3a6813","Type":"ContainerStarted","Data":"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"}
Sep 14 13:18:11.147731 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:11.147609    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" event={"ID":"404a3444-6ee0-4bb4-871a-beea9d3a6813","Type":"ContainerStarted","Data":"b69470a5ddc1465d13b8c621ebb7e478b75c372231f9ac19c9b3172b794c0720"}
Sep 14 13:18:11.147731 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:11.147649    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:11.179426 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:11.174073    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" podStartSLOduration=1.174039388 podStartE2EDuration="1.174039388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:18:11.173193529 +0000 UTC m=+1201.487976882" watchObservedRunningTime="2026-09-14 13:18:11.174039388 +0000 UTC m=+1201.488822740"
Sep 14 13:18:22.155243 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:22.155206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:18:33.035935 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.035900    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"]
Sep 14 13:18:33.039950 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.039932    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:33.043279 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.043255    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:18:33.043396 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.043378    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:18:33.052495 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.052475    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"]
Sep 14 13:18:33.155408 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.155377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc\" (UID: \"54e4b4c0-5fc1-4565-9426-adfc13ec8133\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:33.256974 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.256940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc\" (UID: \"54e4b4c0-5fc1-4565-9426-adfc13ec8133\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:33.257586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.257568    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc\" (UID: \"54e4b4c0-5fc1-4565-9426-adfc13ec8133\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:33.350763 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.350704    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:33.626036 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:33.626013    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"]
Sep 14 13:18:33.626143 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:18:33.626066    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e4b4c0_5fc1_4565_9426_adfc13ec8133.slice/crio-e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1 WatchSource:0}: Error finding container e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1: Status 404 returned error can't find the container with id e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1
Sep 14 13:18:34.281450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:34.281424    2566 generic.go:356] "Generic (PLEG): container finished" podID="54e4b4c0-5fc1-4565-9426-adfc13ec8133" containerID="a78a87e4ee3075c0d944186f24c193834691190b1295f55ca9f2380910d9d793" exitCode=0
Sep 14 13:18:34.281762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:34.281489    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc" event={"ID":"54e4b4c0-5fc1-4565-9426-adfc13ec8133","Type":"ContainerDied","Data":"a78a87e4ee3075c0d944186f24c193834691190b1295f55ca9f2380910d9d793"}
Sep 14 13:18:34.281762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:34.281524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc" event={"ID":"54e4b4c0-5fc1-4565-9426-adfc13ec8133","Type":"ContainerStarted","Data":"e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1"}
Sep 14 13:18:35.450155 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:35.450121    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:35.590593 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:35.590489    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca\") pod \"54e4b4c0-5fc1-4565-9426-adfc13ec8133\" (UID: \"54e4b4c0-5fc1-4565-9426-adfc13ec8133\") "
Sep 14 13:18:35.590810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:35.590784    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54e4b4c0-5fc1-4565-9426-adfc13ec8133" (UID: "54e4b4c0-5fc1-4565-9426-adfc13ec8133"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:18:35.590962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:35.590941    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54e4b4c0-5fc1-4565-9426-adfc13ec8133-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:18:36.296865 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:36.296838    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"
Sep 14 13:18:36.297007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:36.296844    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc" event={"ID":"54e4b4c0-5fc1-4565-9426-adfc13ec8133","Type":"ContainerDied","Data":"e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1"}
Sep 14 13:18:36.297007 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:36.296962    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0a7ff2b689ef9089f44bda39dc5f1ae00bb08ebc325c42e5ddb2a539f2114b1"
Sep 14 13:18:43.544643 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.544574    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:18:43.545070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.545030    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e4b4c0-5fc1-4565-9426-adfc13ec8133" containerName="revoke-keys"
Sep 14 13:18:43.545070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.545057    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e4b4c0-5fc1-4565-9426-adfc13ec8133" containerName="revoke-keys"
Sep 14 13:18:43.545151 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.545132    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e4b4c0-5fc1-4565-9426-adfc13ec8133" containerName="revoke-keys"
Sep 14 13:18:43.547296 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.547281    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.550021 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.550000    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7f78b4-dockercfg-w7nx6\""
Sep 14 13:18:43.550196 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.550093    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7f78b4\""
Sep 14 13:18:43.558087 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.558065    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:18:43.603357 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.603273    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:18:43.606867 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.606842    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.627792 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.627755    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:18:43.682071 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.682027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwj69\" (UniqueName: \"kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.682235 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.682214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.782815 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.782778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.782969 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.782826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwj69\" (UniqueName: \"kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.782969 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.782901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vpz4\" (UniqueName: \"kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.782969 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.782954    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.783650 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.783630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.793890 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.793852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwj69\" (UniqueName: \"kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69\") pod \"payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.858128 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.858036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:43.884444 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.884413    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.884635 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.884542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vpz4\" (UniqueName: \"kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.885161 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.885142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.893966 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.893923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vpz4\" (UniqueName: \"kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4\") pod \"payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:43.926920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:43.926874    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:44.133986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.133958    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:18:44.136236 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:18:44.136212    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79296566_2517_400c_8748_d8f0c54a9af6.slice/crio-0e58e3823e1175700369b2ade4971ccecdbb1604f7ff24ff6c436ecbee46a9d0 WatchSource:0}: Error finding container 0e58e3823e1175700369b2ade4971ccecdbb1604f7ff24ff6c436ecbee46a9d0: Status 404 returned error can't find the container with id 0e58e3823e1175700369b2ade4971ccecdbb1604f7ff24ff6c436ecbee46a9d0
Sep 14 13:18:44.210799 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.210778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:18:44.211991 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:18:44.211965    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4cf06a_8a9d_4742_91ea_42593b579563.slice/crio-1c33c1d51a6996f9bf0f661487f60bb51b34fdf5ad29796600c645f09b160cf1 WatchSource:0}: Error finding container 1c33c1d51a6996f9bf0f661487f60bb51b34fdf5ad29796600c645f09b160cf1: Status 404 returned error can't find the container with id 1c33c1d51a6996f9bf0f661487f60bb51b34fdf5ad29796600c645f09b160cf1
Sep 14 13:18:44.345327 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.345296    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" event={"ID":"3a4cf06a-8a9d-4742-91ea-42593b579563","Type":"ContainerStarted","Data":"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"}
Sep 14 13:18:44.345472 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.345343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" event={"ID":"3a4cf06a-8a9d-4742-91ea-42593b579563","Type":"ContainerStarted","Data":"1c33c1d51a6996f9bf0f661487f60bb51b34fdf5ad29796600c645f09b160cf1"}
Sep 14 13:18:44.345472 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.345397    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:18:44.347063 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.347026    2566 generic.go:356] "Generic (PLEG): container finished" podID="9802e388-2a04-4e12-8055-999ef326de97" containerID="69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e" exitCode=0
Sep 14 13:18:44.347184 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.347080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerDied","Data":"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"}
Sep 14 13:18:44.347504 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.347488    2566 scope.go:117] "RemoveContainer" containerID="69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"
Sep 14 13:18:44.348776 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348757    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" event={"ID":"79296566-2517-400c-8748-d8f0c54a9af6","Type":"ContainerStarted","Data":"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"}
Sep 14 13:18:44.348858 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348768    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:18:44.348858 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348791    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" event={"ID":"79296566-2517-400c-8748-d8f0c54a9af6","Type":"ContainerStarted","Data":"0e58e3823e1175700369b2ade4971ccecdbb1604f7ff24ff6c436ecbee46a9d0"}
Sep 14 13:18:44.348858 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348810    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:44.348858 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348836    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:18:44.349062 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.348865    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:18:44.366961 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.366923    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" podStartSLOduration=1.366909066 podStartE2EDuration="1.366909066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:18:44.365246301 +0000 UTC m=+1234.680029652" watchObservedRunningTime="2026-09-14 13:18:44.366909066 +0000 UTC m=+1234.681692418"
Sep 14 13:18:44.387128 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:44.387085    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" podStartSLOduration=1.387072679 podStartE2EDuration="1.387072679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:18:44.385482587 +0000 UTC m=+1234.700265936" watchObservedRunningTime="2026-09-14 13:18:44.387072679 +0000 UTC m=+1234.701856032"
Sep 14 13:18:45.082257 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.082203    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:45.359802 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.359715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerStarted","Data":"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"}
Sep 14 13:18:45.395223 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.395183    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:45.396580 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.396554    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 14 13:18:45.396704 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.396604    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 14 13:18:45.601415 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.601380    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:18:45.601962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.601626    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" podUID="41143939-d8c2-466b-a665-6186ed6eb1e6" containerName="payload-processing" containerID="cri-o://3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb" gracePeriod=30
Sep 14 13:18:45.617255 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.617226    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:18:45.617451 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.617428    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" podUID="2d339336-b312-42c9-b1fb-45ff35e12e69" containerName="payload-pre-processing" containerID="cri-o://8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519" gracePeriod=30
Sep 14 13:18:45.932459 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.932434    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:18:45.974958 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:45.974673    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:18:46.048389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.048359    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"]
Sep 14 13:18:46.052818 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.052792    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-55cb42-5t9gc"]
Sep 14 13:18:46.113698 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.113669    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqn7t\" (UniqueName: \"kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t\") pod \"41143939-d8c2-466b-a665-6186ed6eb1e6\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") "
Sep 14 13:18:46.114147 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.113722    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r5sv\" (UniqueName: \"kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv\") pod \"2d339336-b312-42c9-b1fb-45ff35e12e69\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") "
Sep 14 13:18:46.114147 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.113795    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume\") pod \"2d339336-b312-42c9-b1fb-45ff35e12e69\" (UID: \"2d339336-b312-42c9-b1fb-45ff35e12e69\") "
Sep 14 13:18:46.114147 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.113909    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume\") pod \"41143939-d8c2-466b-a665-6186ed6eb1e6\" (UID: \"41143939-d8c2-466b-a665-6186ed6eb1e6\") "
Sep 14 13:18:46.114336 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.114231    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d339336-b312-42c9-b1fb-45ff35e12e69" (UID: "2d339336-b312-42c9-b1fb-45ff35e12e69"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:18:46.114336 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.114287    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41143939-d8c2-466b-a665-6186ed6eb1e6" (UID: "41143939-d8c2-466b-a665-6186ed6eb1e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:18:46.114445 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.114404    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d339336-b312-42c9-b1fb-45ff35e12e69-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.114445 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.114424    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41143939-d8c2-466b-a665-6186ed6eb1e6-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.115920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.115900    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv" (OuterVolumeSpecName: "kube-api-access-6r5sv") pod "2d339336-b312-42c9-b1fb-45ff35e12e69" (UID: "2d339336-b312-42c9-b1fb-45ff35e12e69"). InnerVolumeSpecName "kube-api-access-6r5sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:18:46.116199 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.116182    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t" (OuterVolumeSpecName: "kube-api-access-gqn7t") pod "41143939-d8c2-466b-a665-6186ed6eb1e6" (UID: "41143939-d8c2-466b-a665-6186ed6eb1e6"). InnerVolumeSpecName "kube-api-access-gqn7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:18:46.195328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.195242    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54e4b4c0-5fc1-4565-9426-adfc13ec8133" path="/var/lib/kubelet/pods/54e4b4c0-5fc1-4565-9426-adfc13ec8133/volumes"
Sep 14 13:18:46.215808 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.215780    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqn7t\" (UniqueName: \"kubernetes.io/projected/41143939-d8c2-466b-a665-6186ed6eb1e6-kube-api-access-gqn7t\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.215808 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.215806    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r5sv\" (UniqueName: \"kubernetes.io/projected/2d339336-b312-42c9-b1fb-45ff35e12e69-kube-api-access-6r5sv\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.371355 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.371313    2566 generic.go:356] "Generic (PLEG): container finished" podID="41143939-d8c2-466b-a665-6186ed6eb1e6" containerID="3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb" exitCode=0
Sep 14 13:18:46.371550 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.371510    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" event={"ID":"41143939-d8c2-466b-a665-6186ed6eb1e6","Type":"ContainerDied","Data":"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"}
Sep 14 13:18:46.371615 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.371567    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8" event={"ID":"41143939-d8c2-466b-a665-6186ed6eb1e6","Type":"ContainerDied","Data":"5955869417b202b85717b4091bcb38693161b02728ea6cb9e240124c0eb46991"}
Sep 14 13:18:46.371615 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.371598    2566 scope.go:117] "RemoveContainer" containerID="3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"
Sep 14 13:18:46.371771 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.371752    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"
Sep 14 13:18:46.374387 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.374355    2566 generic.go:356] "Generic (PLEG): container finished" podID="2d339336-b312-42c9-b1fb-45ff35e12e69" containerID="8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519" exitCode=0
Sep 14 13:18:46.375492 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.375467    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"
Sep 14 13:18:46.376015 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.375978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" event={"ID":"2d339336-b312-42c9-b1fb-45ff35e12e69","Type":"ContainerDied","Data":"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"}
Sep 14 13:18:46.376119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.376066    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v" event={"ID":"2d339336-b312-42c9-b1fb-45ff35e12e69","Type":"ContainerDied","Data":"0d1c175e9f4be71f2777e06f10c71505a90e39c38819ae0a0ec05c4a32794b57"}
Sep 14 13:18:46.393101 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.393022    2566 scope.go:117] "RemoveContainer" containerID="3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"
Sep 14 13:18:46.393466 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:18:46.393423    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb\": container with ID starting with 3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb not found: ID does not exist" containerID="3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"
Sep 14 13:18:46.393544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.393476    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb"} err="failed to get container status \"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb\": rpc error: code = NotFound desc = could not find container \"3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb\": container with ID starting with 3dd673b5f038650410f015be4a856409b2f55a631e6fa4240f6a79c2b4e29adb not found: ID does not exist"
Sep 14 13:18:46.393544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.393523    2566 scope.go:117] "RemoveContainer" containerID="8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"
Sep 14 13:18:46.395185 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.395157    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 14 13:18:46.395278 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.395218    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 14 13:18:46.405719 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.405451    2566 scope.go:117] "RemoveContainer" containerID="8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"
Sep 14 13:18:46.405831 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:18:46.405800    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519\": container with ID starting with 8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519 not found: ID does not exist" containerID="8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"
Sep 14 13:18:46.405912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.405839    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519"} err="failed to get container status \"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519\": rpc error: code = NotFound desc = could not find container \"8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519\": container with ID starting with 8d6593597a6244359f64aa0f9e5d799e6ddb45f303dd1fb6a85a1ddf5b048519 not found: ID does not exist"
Sep 14 13:18:46.408515 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.408493    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:18:46.415742 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.415719    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-55cb42-6b46fd7994-msc8v"]
Sep 14 13:18:46.428731 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.428703    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:18:46.435640 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:46.435618    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-55cb42-84484b57d5-sqsp8"]
Sep 14 13:18:47.394776 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:47.394739    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 14 13:18:47.395189 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:47.394789    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 14 13:18:48.195602 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:48.195553    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d339336-b312-42c9-b1fb-45ff35e12e69" path="/var/lib/kubelet/pods/2d339336-b312-42c9-b1fb-45ff35e12e69/volumes"
Sep 14 13:18:48.196031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:48.195994    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41143939-d8c2-466b-a665-6186ed6eb1e6" path="/var/lib/kubelet/pods/41143939-d8c2-466b-a665-6186ed6eb1e6/volumes"
Sep 14 13:18:48.395419 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:48.395384    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 14 13:18:48.395791 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:48.395440    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 14 13:18:49.395239 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:49.395203    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 14 13:18:49.395448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:49.395263    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 14 13:18:50.398860 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:50.398828    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:50.399329 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:50.399099    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:50.399845 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:50.399825    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:18:55.361912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:55.361873    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:18:55.362437 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:18:55.361986    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:19:10.283771 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:10.283697    2566 scope.go:117] "RemoveContainer" containerID="35ef26ab5e0241ed9963dda7071966724f242a7494cfed89305b3ac2fe18888b"
Sep 14 13:19:26.946729 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.946691    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:19:26.947253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947163    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41143939-d8c2-466b-a665-6186ed6eb1e6" containerName="payload-processing"
Sep 14 13:19:26.947253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947188    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41143939-d8c2-466b-a665-6186ed6eb1e6" containerName="payload-processing"
Sep 14 13:19:26.947253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947212    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d339336-b312-42c9-b1fb-45ff35e12e69" containerName="payload-pre-processing"
Sep 14 13:19:26.947253 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947217    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d339336-b312-42c9-b1fb-45ff35e12e69" containerName="payload-pre-processing"
Sep 14 13:19:26.947389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947287    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d339336-b312-42c9-b1fb-45ff35e12e69" containerName="payload-pre-processing"
Sep 14 13:19:26.947389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.947296    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="41143939-d8c2-466b-a665-6186ed6eb1e6" containerName="payload-processing"
Sep 14 13:19:26.950860 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.950843    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:26.955010 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.954977    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-92d7d8db\""
Sep 14 13:19:26.955179 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.955012    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-92d7d8db-dockercfg-9687x\""
Sep 14 13:19:26.966306 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:26.966280    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:19:27.036024 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.035991    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.036214 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.036110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qq2b\" (UniqueName: \"kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.137252 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.137209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qq2b\" (UniqueName: \"kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.137445 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.137337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.138039 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.138019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.146933 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.146913    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qq2b\" (UniqueName: \"kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b\") pod \"payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.260885 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.260844    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.547765 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.547741    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:19:27.549617 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:19:27.549593    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415d0aef_b0eb_4b69_8e61_debcb054598b.slice/crio-3b5d8d38ed6c397447c407269edf6235a7b60fe789fb407b087716b4e261565a WatchSource:0}: Error finding container 3b5d8d38ed6c397447c407269edf6235a7b60fe789fb407b087716b4e261565a: Status 404 returned error can't find the container with id 3b5d8d38ed6c397447c407269edf6235a7b60fe789fb407b087716b4e261565a
Sep 14 13:19:27.621524 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.621494    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" event={"ID":"415d0aef-b0eb-4b69-8e61-debcb054598b","Type":"ContainerStarted","Data":"9c390bd08c414012e718bfc0b5152ef121e17f17da723cd608ea5fbd003dc50d"}
Sep 14 13:19:27.621655 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.621540    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" event={"ID":"415d0aef-b0eb-4b69-8e61-debcb054598b","Type":"ContainerStarted","Data":"3b5d8d38ed6c397447c407269edf6235a7b60fe789fb407b087716b4e261565a"}
Sep 14 13:19:27.621721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.621685    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:27.658103 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:27.658035    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" podStartSLOduration=1.658019292 podStartE2EDuration="1.658019292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:27.655382525 +0000 UTC m=+1277.970165877" watchObservedRunningTime="2026-09-14 13:19:27.658019292 +0000 UTC m=+1277.972802643"
Sep 14 13:19:38.629757 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:38.629718    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:19:58.497622 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.497584    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:19:58.502085 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.502063    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.506602 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.506580    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"kube-root-ca.crt\""
Sep 14 13:19:58.506602 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.506598    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"default-dockercfg-x56km\""
Sep 14 13:19:58.506789 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.506632    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"e2e-conflict-a-ed40dcb4-kserve-self-signed-certs\""
Sep 14 13:19:58.506789 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.506703    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"openshift-service-ca.crt\""
Sep 14 13:19:58.513367 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.513346    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:19:58.565109 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px6wf\" (UniqueName: \"kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.565290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565132    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.565290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.565290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565252    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.565426 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565290    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.565426 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.565333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.666795 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.666756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.667570 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px6wf\" (UniqueName: \"kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.667713 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.667713 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.667830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.667830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667745    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.668675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.667407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.668675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.668402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.668675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.668639    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.670812 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.670787    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.671001 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.670982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.684242 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.684214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px6wf\" (UniqueName: \"kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf\") pod \"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:58.812269 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:58.812190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:19:59.095371 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:59.095333    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:19:59.096670 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:19:59.096644    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod568f871a_7c01_4f5b_a034_10a59e22ae2b.slice/crio-96a1e7439977b3bebadbba5c69a9cfd8c99e4d1e0382595ccda4f9eacc13b463 WatchSource:0}: Error finding container 96a1e7439977b3bebadbba5c69a9cfd8c99e4d1e0382595ccda4f9eacc13b463: Status 404 returned error can't find the container with id 96a1e7439977b3bebadbba5c69a9cfd8c99e4d1e0382595ccda4f9eacc13b463
Sep 14 13:19:59.819552 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:59.819512    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" event={"ID":"568f871a-7c01-4f5b-a034-10a59e22ae2b","Type":"ContainerStarted","Data":"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"}
Sep 14 13:19:59.819920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:59.819560    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" event={"ID":"568f871a-7c01-4f5b-a034-10a59e22ae2b","Type":"ContainerStarted","Data":"96a1e7439977b3bebadbba5c69a9cfd8c99e4d1e0382595ccda4f9eacc13b463"}
Sep 14 13:19:59.864753 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:19:59.864702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" podStartSLOduration=1.864685743 podStartE2EDuration="1.864685743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:59.86322361 +0000 UTC m=+1310.178006963" watchObservedRunningTime="2026-09-14 13:19:59.864685743 +0000 UTC m=+1310.179469094"
Sep 14 13:20:08.812423 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:08.812381    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:20:08.812800 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:08.812454    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:20:08.825109 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:08.825084    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:20:08.883921 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:08.883895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:20:10.314549 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:10.314515    2566 scope.go:117] "RemoveContainer" containerID="93334ab5c4f1e75b110b1645cbcdd5c4f7470b82a1622553aa40d7ebd6231246"
Sep 14 13:20:24.956101 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:24.956038    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"]
Sep 14 13:20:24.959667 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:24.959649    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:24.963033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:24.963012    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:20:24.963033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:24.963013    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:20:24.971302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:24.971278    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"]
Sep 14 13:20:25.046833 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.046411    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl\" (UID: \"7ddaf620-0d04-448c-88f7-b228b732e00e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:25.147923 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.147887    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl\" (UID: \"7ddaf620-0d04-448c-88f7-b228b732e00e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:25.148548 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.148527    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl\" (UID: \"7ddaf620-0d04-448c-88f7-b228b732e00e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:25.271108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.271019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:25.552937 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.551747    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"]
Sep 14 13:20:25.554080 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:20:25.554027    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddaf620_0d04_448c_88f7_b228b732e00e.slice/crio-68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148 WatchSource:0}: Error finding container 68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148: Status 404 returned error can't find the container with id 68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148
Sep 14 13:20:25.974529 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.974482    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl" event={"ID":"7ddaf620-0d04-448c-88f7-b228b732e00e","Type":"ContainerStarted","Data":"0ca055e8c4355dc89cab8ac50123e587fce2b8822798bbc3531f4063ac1d8b24"}
Sep 14 13:20:25.974992 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.974549    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl" event={"ID":"7ddaf620-0d04-448c-88f7-b228b732e00e","Type":"ContainerStarted","Data":"68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148"}
Sep 14 13:20:25.998861 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:25.998806    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl" podStartSLOduration=1.998788159 podStartE2EDuration="1.998788159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:20:25.995512244 +0000 UTC m=+1336.310295595" watchObservedRunningTime="2026-09-14 13:20:25.998788159 +0000 UTC m=+1336.313571510"
Sep 14 13:20:26.982017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:26.981983    2566 generic.go:356] "Generic (PLEG): container finished" podID="7ddaf620-0d04-448c-88f7-b228b732e00e" containerID="0ca055e8c4355dc89cab8ac50123e587fce2b8822798bbc3531f4063ac1d8b24" exitCode=0
Sep 14 13:20:26.982480 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:26.982071    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl" event={"ID":"7ddaf620-0d04-448c-88f7-b228b732e00e","Type":"ContainerDied","Data":"0ca055e8c4355dc89cab8ac50123e587fce2b8822798bbc3531f4063ac1d8b24"}
Sep 14 13:20:28.135846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.135823    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:28.180922 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.180893    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca\") pod \"7ddaf620-0d04-448c-88f7-b228b732e00e\" (UID: \"7ddaf620-0d04-448c-88f7-b228b732e00e\") "
Sep 14 13:20:28.181339 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.181311    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ddaf620-0d04-448c-88f7-b228b732e00e" (UID: "7ddaf620-0d04-448c-88f7-b228b732e00e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:20:28.282697 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.282619    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ddaf620-0d04-448c-88f7-b228b732e00e-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:28.995429 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.995400    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"
Sep 14 13:20:28.995631 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.995404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl" event={"ID":"7ddaf620-0d04-448c-88f7-b228b732e00e","Type":"ContainerDied","Data":"68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148"}
Sep 14 13:20:28.995631 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:28.995543    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68df9b633a6d29f40b671a27870ca989df45986a4ea32c897f4459d9d8962148"
Sep 14 13:20:35.780318 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:35.780240    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"]
Sep 14 13:20:35.783864 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:35.783834    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-0fcdc6-29823195-6q2hb"]
Sep 14 13:20:35.835424 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:35.835392    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:20:35.835675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:35.835632    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" podUID="717a9931-0f97-4eba-9c11-a21c7b496bac" containerName="payload-pre-processing" containerID="cri-o://c3ccce2eb851d07d322057311f465b92fceba47af8f39b22b71e947896bf8838" gracePeriod=30
Sep 14 13:20:36.047831 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.047647    2566 generic.go:356] "Generic (PLEG): container finished" podID="717a9931-0f97-4eba-9c11-a21c7b496bac" containerID="c3ccce2eb851d07d322057311f465b92fceba47af8f39b22b71e947896bf8838" exitCode=0
Sep 14 13:20:36.047831 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.047705    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" event={"ID":"717a9931-0f97-4eba-9c11-a21c7b496bac","Type":"ContainerDied","Data":"c3ccce2eb851d07d322057311f465b92fceba47af8f39b22b71e947896bf8838"}
Sep 14 13:20:36.110580 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.110552    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:20:36.138214 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.138181    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"]
Sep 14 13:20:36.165778 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.165750    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume\") pod \"717a9931-0f97-4eba-9c11-a21c7b496bac\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") "
Sep 14 13:20:36.165978 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.165791    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knxlt\" (UniqueName: \"kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt\") pod \"717a9931-0f97-4eba-9c11-a21c7b496bac\" (UID: \"717a9931-0f97-4eba-9c11-a21c7b496bac\") "
Sep 14 13:20:36.166542 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.166513    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "717a9931-0f97-4eba-9c11-a21c7b496bac" (UID: "717a9931-0f97-4eba-9c11-a21c7b496bac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:20:36.168383 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.168348    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt" (OuterVolumeSpecName: "kube-api-access-knxlt") pod "717a9931-0f97-4eba-9c11-a21c7b496bac" (UID: "717a9931-0f97-4eba-9c11-a21c7b496bac"). InnerVolumeSpecName "kube-api-access-knxlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:20:36.169642 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.169618    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0fcdc6-gmfjl"]
Sep 14 13:20:36.193416 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.193380    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50375edd-3953-4a4e-af98-dbc38e5fc3ce" path="/var/lib/kubelet/pods/50375edd-3953-4a4e-af98-dbc38e5fc3ce/volumes"
Sep 14 13:20:36.193895 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.193861    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ddaf620-0d04-448c-88f7-b228b732e00e" path="/var/lib/kubelet/pods/7ddaf620-0d04-448c-88f7-b228b732e00e/volumes"
Sep 14 13:20:36.275157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.270401    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/717a9931-0f97-4eba-9c11-a21c7b496bac-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:36.275157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:36.270440    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knxlt\" (UniqueName: \"kubernetes.io/projected/717a9931-0f97-4eba-9c11-a21c7b496bac-kube-api-access-knxlt\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:37.054752 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:37.054724    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"
Sep 14 13:20:37.055169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:37.054761    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm" event={"ID":"717a9931-0f97-4eba-9c11-a21c7b496bac","Type":"ContainerDied","Data":"92270f81366a9cf408dc3d9cc388741ea7c4041496c5233e279332eeea0548ac"}
Sep 14 13:20:37.055169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:37.054822    2566 scope.go:117] "RemoveContainer" containerID="c3ccce2eb851d07d322057311f465b92fceba47af8f39b22b71e947896bf8838"
Sep 14 13:20:37.079586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:37.079550    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:20:37.090724 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:37.090687    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0fcdc6-5784dd7f86-pt8nm"]
Sep 14 13:20:38.191773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:38.191738    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717a9931-0f97-4eba-9c11-a21c7b496bac" path="/var/lib/kubelet/pods/717a9931-0f97-4eba-9c11-a21c7b496bac/volumes"
Sep 14 13:20:44.490532 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.490496    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"]
Sep 14 13:20:44.490981 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.490968    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717a9931-0f97-4eba-9c11-a21c7b496bac" containerName="payload-pre-processing"
Sep 14 13:20:44.491031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.490983    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="717a9931-0f97-4eba-9c11-a21c7b496bac" containerName="payload-pre-processing"
Sep 14 13:20:44.491031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.491010    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ddaf620-0d04-448c-88f7-b228b732e00e" containerName="revoke-keys"
Sep 14 13:20:44.491031 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.491016    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ddaf620-0d04-448c-88f7-b228b732e00e" containerName="revoke-keys"
Sep 14 13:20:44.491148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.491109    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ddaf620-0d04-448c-88f7-b228b732e00e" containerName="revoke-keys"
Sep 14 13:20:44.491148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.491120    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="717a9931-0f97-4eba-9c11-a21c7b496bac" containerName="payload-pre-processing"
Sep 14 13:20:44.494220 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.494204    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:44.498314 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.498292    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:20:44.498437 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.498334    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:20:44.503745 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.503720    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"]
Sep 14 13:20:44.661412 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.661374    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-809356-pvcmb\" (UID: \"b9c92e55-3866-43b3-8251-1443ffecc573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:44.762628 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.762516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-809356-pvcmb\" (UID: \"b9c92e55-3866-43b3-8251-1443ffecc573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:44.763195 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.763175    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-809356-pvcmb\" (UID: \"b9c92e55-3866-43b3-8251-1443ffecc573\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:44.806029 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:44.805994    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:45.097202 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:45.097174    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"]
Sep 14 13:20:45.099086 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:20:45.099059    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c92e55_3866_43b3_8251_1443ffecc573.slice/crio-6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316 WatchSource:0}: Error finding container 6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316: Status 404 returned error can't find the container with id 6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316
Sep 14 13:20:46.117405 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:46.117308    2566 generic.go:356] "Generic (PLEG): container finished" podID="b9c92e55-3866-43b3-8251-1443ffecc573" containerID="ccc5e218a1c9f4280ce345b91d3354fc58dde3c2201557fb0a02b0d2704c9e4e" exitCode=0
Sep 14 13:20:46.117405 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:46.117391    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb" event={"ID":"b9c92e55-3866-43b3-8251-1443ffecc573","Type":"ContainerDied","Data":"ccc5e218a1c9f4280ce345b91d3354fc58dde3c2201557fb0a02b0d2704c9e4e"}
Sep 14 13:20:46.117791 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:46.117444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb" event={"ID":"b9c92e55-3866-43b3-8251-1443ffecc573","Type":"ContainerStarted","Data":"6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316"}
Sep 14 13:20:47.266603 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:47.266579    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:47.391728 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:47.391636    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca\") pod \"b9c92e55-3866-43b3-8251-1443ffecc573\" (UID: \"b9c92e55-3866-43b3-8251-1443ffecc573\") "
Sep 14 13:20:47.391988 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:47.391964    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b9c92e55-3866-43b3-8251-1443ffecc573" (UID: "b9c92e55-3866-43b3-8251-1443ffecc573"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:20:47.493389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:47.493349    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9c92e55-3866-43b3-8251-1443ffecc573-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:48.130865 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:48.130830    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"
Sep 14 13:20:48.131063 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:48.130904    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb" event={"ID":"b9c92e55-3866-43b3-8251-1443ffecc573","Type":"ContainerDied","Data":"6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316"}
Sep 14 13:20:48.131063 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:48.130949    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d61f7a31267d2576c99216307f104b33a2fbb1d3467af5f24cd14c4596fb316"
Sep 14 13:20:55.097911 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.097866    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"]
Sep 14 13:20:55.102636 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.102606    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-809356-29823195-2fv2s"]
Sep 14 13:20:55.150626 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.150590    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:20:55.150853 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.150826    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" podUID="54484158-7807-40bf-9873-3330074048cf" containerName="payload-pre-processing" containerID="cri-o://15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd" gracePeriod=30
Sep 14 13:20:55.375198 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.375115    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"]
Sep 14 13:20:55.378469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.378442    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-809356-pvcmb"]
Sep 14 13:20:55.431738 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.431713    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:20:55.477478 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.477346    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume\") pod \"54484158-7807-40bf-9873-3330074048cf\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") "
Sep 14 13:20:55.477921 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.477779    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54484158-7807-40bf-9873-3330074048cf" (UID: "54484158-7807-40bf-9873-3330074048cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:20:55.478095 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.477975    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7flph\" (UniqueName: \"kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph\") pod \"54484158-7807-40bf-9873-3330074048cf\" (UID: \"54484158-7807-40bf-9873-3330074048cf\") "
Sep 14 13:20:55.478611 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.478586    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54484158-7807-40bf-9873-3330074048cf-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:55.480479 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.480451    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph" (OuterVolumeSpecName: "kube-api-access-7flph") pod "54484158-7807-40bf-9873-3330074048cf" (UID: "54484158-7807-40bf-9873-3330074048cf"). InnerVolumeSpecName "kube-api-access-7flph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:20:55.580034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:55.579992    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7flph\" (UniqueName: \"kubernetes.io/projected/54484158-7807-40bf-9873-3330074048cf-kube-api-access-7flph\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:20:56.183787 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.183750    2566 generic.go:356] "Generic (PLEG): container finished" podID="54484158-7807-40bf-9873-3330074048cf" containerID="15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd" exitCode=0
Sep 14 13:20:56.184322 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.183866    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"
Sep 14 13:20:56.199404 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.199375    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f2f5f05-5d29-4176-9511-02cb5659752d" path="/var/lib/kubelet/pods/3f2f5f05-5d29-4176-9511-02cb5659752d/volumes"
Sep 14 13:20:56.199878 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.199854    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c92e55-3866-43b3-8251-1443ffecc573" path="/var/lib/kubelet/pods/b9c92e55-3866-43b3-8251-1443ffecc573/volumes"
Sep 14 13:20:56.200393 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.200374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" event={"ID":"54484158-7807-40bf-9873-3330074048cf","Type":"ContainerDied","Data":"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"}
Sep 14 13:20:56.200457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.200408    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4" event={"ID":"54484158-7807-40bf-9873-3330074048cf","Type":"ContainerDied","Data":"3d3a6c36f8be9224c2730884ef136a6ce6a26c2d40dc3f601d9649b190027438"}
Sep 14 13:20:56.200457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.200430    2566 scope.go:117] "RemoveContainer" containerID="15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"
Sep 14 13:20:56.209743 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.209722    2566 scope.go:117] "RemoveContainer" containerID="15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"
Sep 14 13:20:56.210131 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:20:56.210107    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd\": container with ID starting with 15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd not found: ID does not exist" containerID="15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"
Sep 14 13:20:56.210236 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.210140    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd"} err="failed to get container status \"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd\": rpc error: code = NotFound desc = could not find container \"15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd\": container with ID starting with 15b9739fa97660d13f3dfd79e7052af8356de8ca58fc7c1cb50d24ad8182a1cd not found: ID does not exist"
Sep 14 13:20:56.214440 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.214416    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:20:56.219522 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:56.219501    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-809356-657f49d474-9b2q4"]
Sep 14 13:20:58.191138 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:20:58.191102    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54484158-7807-40bf-9873-3330074048cf" path="/var/lib/kubelet/pods/54484158-7807-40bf-9873-3330074048cf/volumes"
Sep 14 13:21:10.336149 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:10.336112    2566 scope.go:117] "RemoveContainer" containerID="925038e5593f3b351db3173c6dbee070f6eb0bab65665d10ee87df059211358b"
Sep 14 13:21:10.345142 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:10.345123    2566 scope.go:117] "RemoveContainer" containerID="49044cf36ed67da5d9c542dff11ea701b8a7a47bf19afbb03b84c30efd72c7b7"
Sep 14 13:21:10.353257 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:10.353238    2566 scope.go:117] "RemoveContainer" containerID="d8505e1373401cce8407fd95716301de9580d83b9d3a0dea69a10600f582a4ea"
Sep 14 13:21:10.361488 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:10.361467    2566 scope.go:117] "RemoveContainer" containerID="7fe02552477fd1b1be4ddb7828511be7cc95331c848362bf875c3c61b9af87d2"
Sep 14 13:21:10.369318 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:10.369299    2566 scope.go:117] "RemoveContainer" containerID="805d07a5c5b35343c154a85854ef32a8c6221341c44d36eaf047f229691393be"
Sep 14 13:21:39.319117 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:39.319083    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:21:39.319523 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:39.319321    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy" containerID="cri-o://7cc8986552e8739804551ced7a7cf09407bae24698f7ccc90a60c6a86e5b9c22" gracePeriod=30
Sep 14 13:21:44.465258 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.465224    2566 generic.go:356] "Generic (PLEG): container finished" podID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerID="7cc8986552e8739804551ced7a7cf09407bae24698f7ccc90a60c6a86e5b9c22" exitCode=0
Sep 14 13:21:44.465751 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.465297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerDied","Data":"7cc8986552e8739804551ced7a7cf09407bae24698f7ccc90a60c6a86e5b9c22"}
Sep 14 13:21:44.465751 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.465359    2566 scope.go:117] "RemoveContainer" containerID="80517ae8bea4d5d180af2a24e4af48a866135b099dabc239e6ca7e4acb2a9ddc"
Sep 14 13:21:44.561696 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.561669    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:21:44.690227 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690144    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690227 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690186    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg2j7\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690227 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690211    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690242    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690262    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690314    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690377    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690461    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690483    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data\") pod \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\" (UID: \"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4\") "
Sep 14 13:21:44.690810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690492    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:44.690810 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690786    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:44.690915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690800    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:21:44.690915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690892    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.691006 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690913    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.691006 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690928    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.691006 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.690985    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:44.691152 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.691077    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:44.692476 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.692455    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:21:44.692591 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.692543    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:44.692866 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.692845    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7" (OuterVolumeSpecName: "kube-api-access-fg2j7") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "kube-api-access-fg2j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:21:44.692965 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.692872    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" (UID: "e4dfdf90-1be1-4c25-948d-6ab03f80f1e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:21:44.791856 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791809    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.791856 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791852    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.791856 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791864    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.791856 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791872    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.792159 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791883    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg2j7\" (UniqueName: \"kubernetes.io/projected/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-kube-api-access-fg2j7\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:44.792159 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:44.791893    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:45.473912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:45.473887    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"
Sep 14 13:21:45.474331 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:45.473883    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf" event={"ID":"e4dfdf90-1be1-4c25-948d-6ab03f80f1e4","Type":"ContainerDied","Data":"416d3dc9636a5d3ed567828ceb47f83dbd7656633712ba480844ad20a386dcc7"}
Sep 14 13:21:45.474331 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:45.474012    2566 scope.go:117] "RemoveContainer" containerID="7cc8986552e8739804551ced7a7cf09407bae24698f7ccc90a60c6a86e5b9c22"
Sep 14 13:21:45.507868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:45.507833    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:21:45.518470 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:45.518443    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-809356-openshift-default-676c44bdb6-zjglf"]
Sep 14 13:21:46.191454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:46.191416    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" path="/var/lib/kubelet/pods/e4dfdf90-1be1-4c25-948d-6ab03f80f1e4/volumes"
Sep 14 13:21:50.395969 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.395928    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:21:50.396458 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396432    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54484158-7807-40bf-9873-3330074048cf" containerName="payload-pre-processing"
Sep 14 13:21:50.396458 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396448    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="54484158-7807-40bf-9873-3330074048cf" containerName="payload-pre-processing"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396467    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396473    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396490    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c92e55-3866-43b3-8251-1443ffecc573" containerName="revoke-keys"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396496    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c92e55-3866-43b3-8251-1443ffecc573" containerName="revoke-keys"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396503    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.396586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396509    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.396906 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396605    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="54484158-7807-40bf-9873-3330074048cf" containerName="payload-pre-processing"
Sep 14 13:21:50.396906 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396614    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c92e55-3866-43b3-8251-1443ffecc573" containerName="revoke-keys"
Sep 14 13:21:50.396906 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396620    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.396906 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.396628    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4dfdf90-1be1-4c25-948d-6ab03f80f1e4" containerName="istio-proxy"
Sep 14 13:21:50.401335 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.401315    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.404687 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.404664    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-771942-dockercfg-9bc4x\""
Sep 14 13:21:50.404797 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.404742    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-771942\""
Sep 14 13:21:50.414372 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.414347    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:21:50.548596 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.548568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.548779 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.548651    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpsp\" (UniqueName: \"kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.649241 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.649160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpsp\" (UniqueName: \"kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.649241 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.649227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.649918 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.649900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.658507 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.658481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpsp\" (UniqueName: \"kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp\") pod \"payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:50.711776 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:50.711745    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:51.007006 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.006981    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:21:51.008431 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:21:51.008403    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf196af74_f81c_4369_ab17_7fa254ae6448.slice/crio-d3d4efc2d865ae5b742c119ed5cd2b7f68c6c0fa49b7ef256e929c34506d0a51 WatchSource:0}: Error finding container d3d4efc2d865ae5b742c119ed5cd2b7f68c6c0fa49b7ef256e929c34506d0a51: Status 404 returned error can't find the container with id d3d4efc2d865ae5b742c119ed5cd2b7f68c6c0fa49b7ef256e929c34506d0a51
Sep 14 13:21:51.352165 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.352080    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"]
Sep 14 13:21:51.355744 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.355726    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:51.360333 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.360311    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:21:51.360464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.360320    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:21:51.375284 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.375260    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"]
Sep 14 13:21:51.459908 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.459874    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c\" (UID: \"c00c95c3-3a9a-49e9-8d16-9190f33a226d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:51.509264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.509229    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" event={"ID":"f196af74-f81c-4369-ab17-7fa254ae6448","Type":"ContainerStarted","Data":"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"}
Sep 14 13:21:51.509450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.509391    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:21:51.509450 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.509418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" event={"ID":"f196af74-f81c-4369-ab17-7fa254ae6448","Type":"ContainerStarted","Data":"d3d4efc2d865ae5b742c119ed5cd2b7f68c6c0fa49b7ef256e929c34506d0a51"}
Sep 14 13:21:51.531037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.530986    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" podStartSLOduration=1.5309706749999998 podStartE2EDuration="1.530970675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:21:51.529361537 +0000 UTC m=+1421.844144890" watchObservedRunningTime="2026-09-14 13:21:51.530970675 +0000 UTC m=+1421.845754070"
Sep 14 13:21:51.560762 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.560731    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c\" (UID: \"c00c95c3-3a9a-49e9-8d16-9190f33a226d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:51.561563 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.561539    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c\" (UID: \"c00c95c3-3a9a-49e9-8d16-9190f33a226d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:51.666518 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.666444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:51.945012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:51.944976    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"]
Sep 14 13:21:51.946087 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:21:51.946040    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00c95c3_3a9a_49e9_8d16_9190f33a226d.slice/crio-b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f WatchSource:0}: Error finding container b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f: Status 404 returned error can't find the container with id b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f
Sep 14 13:21:52.517605 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:52.517566    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c" event={"ID":"c00c95c3-3a9a-49e9-8d16-9190f33a226d","Type":"ContainerStarted","Data":"86b993ab4d5a06cc25917b027c500c07492d3e6cf0d7e769d56d7f5ef2d585f1"}
Sep 14 13:21:52.518108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:52.517632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c" event={"ID":"c00c95c3-3a9a-49e9-8d16-9190f33a226d","Type":"ContainerStarted","Data":"b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f"}
Sep 14 13:21:52.548622 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:52.548512    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c" podStartSLOduration=1.5484992979999999 podStartE2EDuration="1.548499298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:21:52.546951751 +0000 UTC m=+1422.861735107" watchObservedRunningTime="2026-09-14 13:21:52.548499298 +0000 UTC m=+1422.863282650"
Sep 14 13:21:53.524295 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:53.524260    2566 generic.go:356] "Generic (PLEG): container finished" podID="c00c95c3-3a9a-49e9-8d16-9190f33a226d" containerID="86b993ab4d5a06cc25917b027c500c07492d3e6cf0d7e769d56d7f5ef2d585f1" exitCode=0
Sep 14 13:21:53.524686 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:53.524301    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c" event={"ID":"c00c95c3-3a9a-49e9-8d16-9190f33a226d","Type":"ContainerDied","Data":"86b993ab4d5a06cc25917b027c500c07492d3e6cf0d7e769d56d7f5ef2d585f1"}
Sep 14 13:21:54.678376 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:54.678344    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:54.799336 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:54.799241    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca\") pod \"c00c95c3-3a9a-49e9-8d16-9190f33a226d\" (UID: \"c00c95c3-3a9a-49e9-8d16-9190f33a226d\") "
Sep 14 13:21:54.799624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:54.799599    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c00c95c3-3a9a-49e9-8d16-9190f33a226d" (UID: "c00c95c3-3a9a-49e9-8d16-9190f33a226d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:21:54.900286 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:54.900224    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c00c95c3-3a9a-49e9-8d16-9190f33a226d-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:21:55.536514 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:55.536484    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"
Sep 14 13:21:55.536675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:55.536534    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c" event={"ID":"c00c95c3-3a9a-49e9-8d16-9190f33a226d","Type":"ContainerDied","Data":"b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f"}
Sep 14 13:21:55.536675 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:21:55.536579    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e997d58230724e6c6c8e1ed5b3d29c8eb88b113f884a4f97dffde16964ac6f"
Sep 14 13:22:02.521216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:02.521133    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:22:11.539139 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.539104    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:22:11.539599 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.539583    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00c95c3-3a9a-49e9-8d16-9190f33a226d" containerName="revoke-keys"
Sep 14 13:22:11.539644 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.539601    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00c95c3-3a9a-49e9-8d16-9190f33a226d" containerName="revoke-keys"
Sep 14 13:22:11.539690 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.539672    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00c95c3-3a9a-49e9-8d16-9190f33a226d" containerName="revoke-keys"
Sep 14 13:22:11.543857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.543840    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.547975 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.547957    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-231820\""
Sep 14 13:22:11.556665 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.556641    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:22:11.667866 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.667829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.668066 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.667913    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwnvg\" (UniqueName: \"kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.769190 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.769157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwnvg\" (UniqueName: \"kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.769364 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.769255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.769918 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.769897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.781893 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.781852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwnvg\" (UniqueName: \"kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg\") pod \"payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:11.854591 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:11.854518    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:12.145834 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:12.145803    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:22:12.147701 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:22:12.147673    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45409ba9_c736_4941_80bc_c971bddc6cd6.slice/crio-fb384d8448d6b74e08302d7dfa2eae2211c23d76bd8b99a3f36167e21206d040 WatchSource:0}: Error finding container fb384d8448d6b74e08302d7dfa2eae2211c23d76bd8b99a3f36167e21206d040: Status 404 returned error can't find the container with id fb384d8448d6b74e08302d7dfa2eae2211c23d76bd8b99a3f36167e21206d040
Sep 14 13:22:12.633907 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:12.633854    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" event={"ID":"45409ba9-c736-4941-80bc-c971bddc6cd6","Type":"ContainerStarted","Data":"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"}
Sep 14 13:22:12.634302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:12.633928    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:22:12.634302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:12.633950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" event={"ID":"45409ba9-c736-4941-80bc-c971bddc6cd6","Type":"ContainerStarted","Data":"fb384d8448d6b74e08302d7dfa2eae2211c23d76bd8b99a3f36167e21206d040"}
Sep 14 13:22:12.686527 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:12.686473    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" podStartSLOduration=1.686459004 podStartE2EDuration="1.686459004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:22:12.681375333 +0000 UTC m=+1442.996158685" watchObservedRunningTime="2026-09-14 13:22:12.686459004 +0000 UTC m=+1443.001242388"
Sep 14 13:22:19.543039 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.542999    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:22:19.543623 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.543216    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" podUID="415d0aef-b0eb-4b69-8e61-debcb054598b" containerName="payload-pre-processing" containerID="cri-o://9c390bd08c414012e718bfc0b5152ef121e17f17da723cd608ea5fbd003dc50d" gracePeriod=30
Sep 14 13:22:19.678599 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.678565    2566 generic.go:356] "Generic (PLEG): container finished" podID="415d0aef-b0eb-4b69-8e61-debcb054598b" containerID="9c390bd08c414012e718bfc0b5152ef121e17f17da723cd608ea5fbd003dc50d" exitCode=0
Sep 14 13:22:19.678749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.678650    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" event={"ID":"415d0aef-b0eb-4b69-8e61-debcb054598b","Type":"ContainerDied","Data":"9c390bd08c414012e718bfc0b5152ef121e17f17da723cd608ea5fbd003dc50d"}
Sep 14 13:22:19.800723 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.800662    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:22:19.849243 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.849205    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume\") pod \"415d0aef-b0eb-4b69-8e61-debcb054598b\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") "
Sep 14 13:22:19.849437 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.849300    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qq2b\" (UniqueName: \"kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b\") pod \"415d0aef-b0eb-4b69-8e61-debcb054598b\" (UID: \"415d0aef-b0eb-4b69-8e61-debcb054598b\") "
Sep 14 13:22:19.849600 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.849574    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "415d0aef-b0eb-4b69-8e61-debcb054598b" (UID: "415d0aef-b0eb-4b69-8e61-debcb054598b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:22:19.849775 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.849756    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/415d0aef-b0eb-4b69-8e61-debcb054598b-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:22:19.851502 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.851478    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b" (OuterVolumeSpecName: "kube-api-access-9qq2b") pod "415d0aef-b0eb-4b69-8e61-debcb054598b" (UID: "415d0aef-b0eb-4b69-8e61-debcb054598b"). InnerVolumeSpecName "kube-api-access-9qq2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:22:19.950449 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:19.950409    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qq2b\" (UniqueName: \"kubernetes.io/projected/415d0aef-b0eb-4b69-8e61-debcb054598b-kube-api-access-9qq2b\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:22:20.210254 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.210223    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"]
Sep 14 13:22:20.216335 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.216309    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-92d7d8db-5mf2c"]
Sep 14 13:22:20.685591 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.685561    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"
Sep 14 13:22:20.686074 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.685605    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v" event={"ID":"415d0aef-b0eb-4b69-8e61-debcb054598b","Type":"ContainerDied","Data":"3b5d8d38ed6c397447c407269edf6235a7b60fe789fb407b087716b4e261565a"}
Sep 14 13:22:20.686074 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.685665    2566 scope.go:117] "RemoveContainer" containerID="9c390bd08c414012e718bfc0b5152ef121e17f17da723cd608ea5fbd003dc50d"
Sep 14 13:22:20.733134 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.733103    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:22:20.748598 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:20.748568    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-92d7d8db-854b7bfc4-jpc5v"]
Sep 14 13:22:22.197073 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:22.191986    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415d0aef-b0eb-4b69-8e61-debcb054598b" path="/var/lib/kubelet/pods/415d0aef-b0eb-4b69-8e61-debcb054598b/volumes"
Sep 14 13:22:22.197073 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:22.192603    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00c95c3-3a9a-49e9-8d16-9190f33a226d" path="/var/lib/kubelet/pods/c00c95c3-3a9a-49e9-8d16-9190f33a226d/volumes"
Sep 14 13:22:23.644667 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:22:23.644638    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:23:10.273104 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:10.273076    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:23:10.277369 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:10.277341    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:23:19.703057 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:19.703010    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:23:29.720986 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:23:29.720942    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"568f871a-7c01-4f5b-a034-10a59e22ae2b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"e2e-models-e2e-worker-w4-5cedb0\"/\"e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-4fa2f5a5-8971-4ad5-8356-5e19d1253a2c.svc:9743/pod?timeout=10s\": context deadline exceeded" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:23:34.722525 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:34.722436    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" podUID="568f871a-7c01-4f5b-a034-10a59e22ae2b" containerName="main" containerID="cri-o://fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec" gracePeriod=45
Sep 14 13:23:34.970165 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:34.970139    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:23:35.096669 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096582    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.096669 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096622    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.096868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096677    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.096868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096704    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.096868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096742    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.096868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px6wf\" (UniqueName: \"kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf\") pod \"568f871a-7c01-4f5b-a034-10a59e22ae2b\" (UID: \"568f871a-7c01-4f5b-a034-10a59e22ae2b\") "
Sep 14 13:23:35.097106 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.096963    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home" (OuterVolumeSpecName: "home") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:35.097106 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.097001    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:35.097245 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.097118    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:35.097328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.097308    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-home\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:35.097328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.097328    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-model-cache\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:35.097489 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.097342    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-tmp-dir\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:35.098938 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.098914    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm" (OuterVolumeSpecName: "dshm") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:35.099034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.098932    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:23:35.099034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.098979    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf" (OuterVolumeSpecName: "kube-api-access-px6wf") pod "568f871a-7c01-4f5b-a034-10a59e22ae2b" (UID: "568f871a-7c01-4f5b-a034-10a59e22ae2b"). InnerVolumeSpecName "kube-api-access-px6wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:23:35.107408 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.107377    2566 generic.go:356] "Generic (PLEG): container finished" podID="568f871a-7c01-4f5b-a034-10a59e22ae2b" containerID="fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec" exitCode=0
Sep 14 13:23:35.107542 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.107427    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"
Sep 14 13:23:35.107542 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.107427    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" event={"ID":"568f871a-7c01-4f5b-a034-10a59e22ae2b","Type":"ContainerDied","Data":"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"}
Sep 14 13:23:35.107658 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.107556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk" event={"ID":"568f871a-7c01-4f5b-a034-10a59e22ae2b","Type":"ContainerDied","Data":"96a1e7439977b3bebadbba5c69a9cfd8c99e4d1e0382595ccda4f9eacc13b463"}
Sep 14 13:23:35.107658 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.107582    2566 scope.go:117] "RemoveContainer" containerID="fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"
Sep 14 13:23:35.125782 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.125759    2566 scope.go:117] "RemoveContainer" containerID="fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"
Sep 14 13:23:35.126166 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:23:35.126140    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec\": container with ID starting with fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec not found: ID does not exist" containerID="fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"
Sep 14 13:23:35.126251 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.126172    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec"} err="failed to get container status \"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec\": rpc error: code = NotFound desc = could not find container \"fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec\": container with ID starting with fc36053466894a929fd82ea7e7ac22ba9ad24b1d4a9e430d2a8480ad59adfcec not found: ID does not exist"
Sep 14 13:23:35.148212 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.148186    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:23:35.159720 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.159695    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-a-ed40dcb4-kserve-5889b9b5ff-qvchk"]
Sep 14 13:23:35.198744 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.198715    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px6wf\" (UniqueName: \"kubernetes.io/projected/568f871a-7c01-4f5b-a034-10a59e22ae2b-kube-api-access-px6wf\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:35.198744 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.198744    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568f871a-7c01-4f5b-a034-10a59e22ae2b-dshm\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:35.199155 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:35.198758    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568f871a-7c01-4f5b-a034-10a59e22ae2b-tls-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:23:36.190351 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:23:36.190319    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="568f871a-7c01-4f5b-a034-10a59e22ae2b" path="/var/lib/kubelet/pods/568f871a-7c01-4f5b-a034-10a59e22ae2b/volumes"
Sep 14 13:24:10.439384 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:10.439354    2566 scope.go:117] "RemoveContainer" containerID="e02e8fd7647883b7341a78b7b0e35ce584f64b209a7e58d16c795c9ab210992b"
Sep 14 13:24:26.408480 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:26.408445    2566 generic.go:356] "Generic (PLEG): container finished" podID="881cdc8e-58c5-4118-81d2-49688162dd4e" containerID="3131e260dc5ac465efc3c7ace99cda111983a4c3aa698356e5af5984520c9b22" exitCode=1
Sep 14 13:24:26.408830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:26.408509    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" event={"ID":"881cdc8e-58c5-4118-81d2-49688162dd4e","Type":"ContainerDied","Data":"3131e260dc5ac465efc3c7ace99cda111983a4c3aa698356e5af5984520c9b22"}
Sep 14 13:24:26.408830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:26.408826    2566 scope.go:117] "RemoveContainer" containerID="3131e260dc5ac465efc3c7ace99cda111983a4c3aa698356e5af5984520c9b22"
Sep 14 13:24:26.409156 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:26.409142    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:24:27.415985 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:27.415957    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" event={"ID":"881cdc8e-58c5-4118-81d2-49688162dd4e","Type":"ContainerStarted","Data":"c7c4c9793bc58047dd4c5d291b9313c6ee1a42a6554ffe55d2f75bfa5e77f9b3"}
Sep 14 13:24:27.416385 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:27.416177    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:24:32.129634 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:24:32.129587    2566 controller.go:195] "Failed to update lease" err="Put \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-129-167.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:24:38.423175 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:38.423132    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" podUID="881cdc8e-58c5-4118-81d2-49688162dd4e" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.29:8081/readyz\": dial tcp 10.133.0.29:8081: connect: connection refused"
Sep 14 13:24:38.450316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:38.450273    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" podUID="979aa361aaf6f040c740f0c683314ad1" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Sep 14 13:24:42.895570 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:42.895527    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" podUID="881cdc8e-58c5-4118-81d2-49688162dd4e" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.29:8081/healthz\": dial tcp 10.133.0.29:8081: connect: connection refused"
Sep 14 13:24:48.422312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:48.422268    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz" podUID="881cdc8e-58c5-4118-81d2-49688162dd4e" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.29:8081/readyz\": dial tcp 10.133.0.29:8081: connect: connection refused"
Sep 14 13:24:58.422782 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:24:58.422753    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vbxnz"
Sep 14 13:25:10.463628 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:10.463553    2566 scope.go:117] "RemoveContainer" containerID="a78a87e4ee3075c0d944186f24c193834691190b1295f55ca9f2380910d9d793"
Sep 14 13:25:52.311240 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:25:52.311204    2566 webhook.go:269] Failed to make webhook authorizer request: Post "https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews": context canceled
Sep 14 13:25:52.311653 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:25:52.311243    2566 server.go:347] "Authorization error" err="Post \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/authorization.k8s.io/v1/subjectaccessreviews\": context canceled" user="system:serviceaccount:openshift-monitoring:metrics-server" verb="get" resource="nodes" subresource="metrics"
Sep 14 13:25:54.796517 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:25:54.796474    2566 controller.go:195] "Failed to update lease" err="Put \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-129-167.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:25:58.359417 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.359378    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"]
Sep 14 13:25:58.360033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360009    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415d0aef-b0eb-4b69-8e61-debcb054598b" containerName="payload-pre-processing"
Sep 14 13:25:58.360153 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360035    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="415d0aef-b0eb-4b69-8e61-debcb054598b" containerName="payload-pre-processing"
Sep 14 13:25:58.360153 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360067    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568f871a-7c01-4f5b-a034-10a59e22ae2b" containerName="main"
Sep 14 13:25:58.360153 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360076    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="568f871a-7c01-4f5b-a034-10a59e22ae2b" containerName="main"
Sep 14 13:25:58.360319 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360187    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="568f871a-7c01-4f5b-a034-10a59e22ae2b" containerName="main"
Sep 14 13:25:58.360319 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.360206    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="415d0aef-b0eb-4b69-8e61-debcb054598b" containerName="payload-pre-processing"
Sep 14 13:25:58.363603 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.363582    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:25:58.366943 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.366923    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:25:58.367168 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.367151    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:25:58.377601 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.377577    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"]
Sep 14 13:25:58.451364 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.451264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch\" (UID: \"ccc03003-a068-4f8b-b4bd-30d0a0474ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:25:58.552387 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.552355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch\" (UID: \"ccc03003-a068-4f8b-b4bd-30d0a0474ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:25:58.552948 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.552927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch\" (UID: \"ccc03003-a068-4f8b-b4bd-30d0a0474ca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:25:58.614190 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.614111    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"]
Sep 14 13:25:58.617700 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.617685    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:25:58.635953 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.635927    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"]
Sep 14 13:25:58.673497 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.673470    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:25:58.755415 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.755374    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk\" (UID: \"0d73be42-bbd4-456e-9a1e-dd87326afe2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:25:58.856179 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.856143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk\" (UID: \"0d73be42-bbd4-456e-9a1e-dd87326afe2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:25:58.856748 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.856727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk\" (UID: \"0d73be42-bbd4-456e-9a1e-dd87326afe2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:25:58.935467 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:58.935400    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:25:59.808606 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:59.808576    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"]
Sep 14 13:25:59.815217 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:25:59.815115    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc03003_a068_4f8b_b4bd_30d0a0474ca9.slice/crio-5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f WatchSource:0}: Error finding container 5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f: Status 404 returned error can't find the container with id 5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f
Sep 14 13:25:59.844570 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:59.844547    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"]
Sep 14 13:25:59.854279 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:25:59.854256    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d73be42_bbd4_456e_9a1e_dd87326afe2b.slice/crio-beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994 WatchSource:0}: Error finding container beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994: Status 404 returned error can't find the container with id beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994
Sep 14 13:25:59.925849 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:59.925822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk" event={"ID":"0d73be42-bbd4-456e-9a1e-dd87326afe2b","Type":"ContainerStarted","Data":"beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994"}
Sep 14 13:25:59.927109 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:25:59.927089    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch" event={"ID":"ccc03003-a068-4f8b-b4bd-30d0a0474ca9","Type":"ContainerStarted","Data":"5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f"}
Sep 14 13:26:00.934271 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:00.934236    2566 generic.go:356] "Generic (PLEG): container finished" podID="0d73be42-bbd4-456e-9a1e-dd87326afe2b" containerID="b6540d7fd0cf95955ae75a6b97b98f4ab9fe20d6801608c2874f491f5bb1aa38" exitCode=0
Sep 14 13:26:00.934680 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:00.934327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk" event={"ID":"0d73be42-bbd4-456e-9a1e-dd87326afe2b","Type":"ContainerDied","Data":"b6540d7fd0cf95955ae75a6b97b98f4ab9fe20d6801608c2874f491f5bb1aa38"}
Sep 14 13:26:00.935835 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:00.935813    2566 generic.go:356] "Generic (PLEG): container finished" podID="ccc03003-a068-4f8b-b4bd-30d0a0474ca9" containerID="a5ce91aba6a5b0149bf63b033ba3467a85dbc8f522078bf2ed29ceecd76dd5cc" exitCode=0
Sep 14 13:26:00.935945 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:00.935864    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch" event={"ID":"ccc03003-a068-4f8b-b4bd-30d0a0474ca9","Type":"ContainerDied","Data":"a5ce91aba6a5b0149bf63b033ba3467a85dbc8f522078bf2ed29ceecd76dd5cc"}
Sep 14 13:26:02.108423 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.108397    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:26:02.111707 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.111686    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:26:02.188845 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.188813    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca\") pod \"ccc03003-a068-4f8b-b4bd-30d0a0474ca9\" (UID: \"ccc03003-a068-4f8b-b4bd-30d0a0474ca9\") "
Sep 14 13:26:02.189297 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.189268    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ccc03003-a068-4f8b-b4bd-30d0a0474ca9" (UID: "ccc03003-a068-4f8b-b4bd-30d0a0474ca9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:26:02.290299 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.290270    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca\") pod \"0d73be42-bbd4-456e-9a1e-dd87326afe2b\" (UID: \"0d73be42-bbd4-456e-9a1e-dd87326afe2b\") "
Sep 14 13:26:02.290556 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.290544    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc03003-a068-4f8b-b4bd-30d0a0474ca9-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:02.290642 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.290617    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d73be42-bbd4-456e-9a1e-dd87326afe2b" (UID: "0d73be42-bbd4-456e-9a1e-dd87326afe2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:26:02.391234 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.391202    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d73be42-bbd4-456e-9a1e-dd87326afe2b-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:02.948691 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.948659    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"
Sep 14 13:26:02.948869 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.948698    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk" event={"ID":"0d73be42-bbd4-456e-9a1e-dd87326afe2b","Type":"ContainerDied","Data":"beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994"}
Sep 14 13:26:02.948869 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.948755    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beeb7adb8236a7068c0de5d65a6249f48fd9d59541f008908a4d88869d467994"
Sep 14 13:26:02.950171 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.950146    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"
Sep 14 13:26:02.950312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.950175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch" event={"ID":"ccc03003-a068-4f8b-b4bd-30d0a0474ca9","Type":"ContainerDied","Data":"5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f"}
Sep 14 13:26:02.950312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:02.950223    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5770b9c5a0511c97337f72adc6354a82d07d6d892448120479d07e71bfa65b2f"
Sep 14 13:26:10.015779 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.015745    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:26:10.016190 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.015947    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" podUID="f196af74-f81c-4369-ab17-7fa254ae6448" containerName="payload-processing" containerID="cri-o://5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab" gracePeriod=30
Sep 14 13:26:10.270927 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.270865    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:26:10.466299 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.466269    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume\") pod \"f196af74-f81c-4369-ab17-7fa254ae6448\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") "
Sep 14 13:26:10.466475 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.466384    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqpsp\" (UniqueName: \"kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp\") pod \"f196af74-f81c-4369-ab17-7fa254ae6448\" (UID: \"f196af74-f81c-4369-ab17-7fa254ae6448\") "
Sep 14 13:26:10.466694 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.466666    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f196af74-f81c-4369-ab17-7fa254ae6448" (UID: "f196af74-f81c-4369-ab17-7fa254ae6448"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:26:10.468482 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.468460    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp" (OuterVolumeSpecName: "kube-api-access-zqpsp") pod "f196af74-f81c-4369-ab17-7fa254ae6448" (UID: "f196af74-f81c-4369-ab17-7fa254ae6448"). InnerVolumeSpecName "kube-api-access-zqpsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:26:10.567922 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.567836    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f196af74-f81c-4369-ab17-7fa254ae6448-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:10.567922 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.567868    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqpsp\" (UniqueName: \"kubernetes.io/projected/f196af74-f81c-4369-ab17-7fa254ae6448-kube-api-access-zqpsp\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:10.999964 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.999931    2566 generic.go:356] "Generic (PLEG): container finished" podID="f196af74-f81c-4369-ab17-7fa254ae6448" containerID="5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab" exitCode=0
Sep 14 13:26:11.000160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:10.999977    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"
Sep 14 13:26:11.000160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.000017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" event={"ID":"f196af74-f81c-4369-ab17-7fa254ae6448","Type":"ContainerDied","Data":"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"}
Sep 14 13:26:11.000160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.000098    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn" event={"ID":"f196af74-f81c-4369-ab17-7fa254ae6448","Type":"ContainerDied","Data":"d3d4efc2d865ae5b742c119ed5cd2b7f68c6c0fa49b7ef256e929c34506d0a51"}
Sep 14 13:26:11.000160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.000131    2566 scope.go:117] "RemoveContainer" containerID="5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"
Sep 14 13:26:11.009149 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.009128    2566 scope.go:117] "RemoveContainer" containerID="5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"
Sep 14 13:26:11.009389 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:26:11.009371    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab\": container with ID starting with 5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab not found: ID does not exist" containerID="5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"
Sep 14 13:26:11.009461 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.009401    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab"} err="failed to get container status \"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab\": rpc error: code = NotFound desc = could not find container \"5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab\": container with ID starting with 5affc76fd2a135b1fad4eedefd959dc32ed0c092a61b5758069ab1254a0b36ab not found: ID does not exist"
Sep 14 13:26:11.145133 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.145099    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:26:11.179574 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.179540    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-771942-5f6f6b7d59-tvpnn"]
Sep 14 13:26:11.649846 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.649809    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"]
Sep 14 13:26:11.678347 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:11.678305    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-771942-9sxzk"]
Sep 14 13:26:12.191167 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:12.191135    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d73be42-bbd4-456e-9a1e-dd87326afe2b" path="/var/lib/kubelet/pods/0d73be42-bbd4-456e-9a1e-dd87326afe2b/volumes"
Sep 14 13:26:12.191522 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:12.191508    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f196af74-f81c-4369-ab17-7fa254ae6448" path="/var/lib/kubelet/pods/f196af74-f81c-4369-ab17-7fa254ae6448/volumes"
Sep 14 13:26:53.606645 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.606612    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"]
Sep 14 13:26:53.611806 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.611782    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5cedb0-29823195-5kchq"]
Sep 14 13:26:53.656434 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.656403    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:26:53.656686 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.656629    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" podUID="d3672e16-c72e-413f-a47b-04741ca352f3" containerName="payload-processing" containerID="cri-o://e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218" gracePeriod=30
Sep 14 13:26:53.671163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.671110    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:26:53.671387 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.671336    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" podUID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" containerName="payload-pre-processing" containerID="cri-o://db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6" gracePeriod=30
Sep 14 13:26:53.950014 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.949991    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:26:53.952749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:53.952731    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:26:54.060900 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.060870    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvcc8\" (UniqueName: \"kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8\") pod \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") "
Sep 14 13:26:54.061119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.060927    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume\") pod \"d3672e16-c72e-413f-a47b-04741ca352f3\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") "
Sep 14 13:26:54.061119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.061009    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n7kn\" (UniqueName: \"kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn\") pod \"d3672e16-c72e-413f-a47b-04741ca352f3\" (UID: \"d3672e16-c72e-413f-a47b-04741ca352f3\") "
Sep 14 13:26:54.061119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.061032    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume\") pod \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\" (UID: \"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38\") "
Sep 14 13:26:54.061448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.061416    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3672e16-c72e-413f-a47b-04741ca352f3" (UID: "d3672e16-c72e-413f-a47b-04741ca352f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:26:54.061584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.061421    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" (UID: "fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:26:54.063648 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.063626    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn" (OuterVolumeSpecName: "kube-api-access-2n7kn") pod "d3672e16-c72e-413f-a47b-04741ca352f3" (UID: "d3672e16-c72e-413f-a47b-04741ca352f3"). InnerVolumeSpecName "kube-api-access-2n7kn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:26:54.063764 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.063657    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8" (OuterVolumeSpecName: "kube-api-access-qvcc8") pod "fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" (UID: "fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38"). InnerVolumeSpecName "kube-api-access-qvcc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:26:54.139494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.139401    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"]
Sep 14 13:26:54.142544 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.142520    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5cedb0-v2lch"]
Sep 14 13:26:54.162798 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.162768    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n7kn\" (UniqueName: \"kubernetes.io/projected/d3672e16-c72e-413f-a47b-04741ca352f3-kube-api-access-2n7kn\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:54.162798 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.162794    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:54.162934 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.162804    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvcc8\" (UniqueName: \"kubernetes.io/projected/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38-kube-api-access-qvcc8\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:54.162934 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.162813    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3672e16-c72e-413f-a47b-04741ca352f3-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:26:54.192424 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.192393    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c585ff22-787f-4dd0-b212-7fe1c109074b" path="/var/lib/kubelet/pods/c585ff22-787f-4dd0-b212-7fe1c109074b/volumes"
Sep 14 13:26:54.192717 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.192702    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc03003-a068-4f8b-b4bd-30d0a0474ca9" path="/var/lib/kubelet/pods/ccc03003-a068-4f8b-b4bd-30d0a0474ca9/volumes"
Sep 14 13:26:54.241915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.241878    2566 generic.go:356] "Generic (PLEG): container finished" podID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" containerID="db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6" exitCode=0
Sep 14 13:26:54.242056 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.241927    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"
Sep 14 13:26:54.242056 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.241983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" event={"ID":"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38","Type":"ContainerDied","Data":"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"}
Sep 14 13:26:54.242157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.242063    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw" event={"ID":"fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38","Type":"ContainerDied","Data":"0049678e8ef31544aeff77b26563937255528a27c2424d2f2e82b3c1efdcbf8c"}
Sep 14 13:26:54.242157 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.242100    2566 scope.go:117] "RemoveContainer" containerID="db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"
Sep 14 13:26:54.243361 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.243335    2566 generic.go:356] "Generic (PLEG): container finished" podID="d3672e16-c72e-413f-a47b-04741ca352f3" containerID="e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218" exitCode=0
Sep 14 13:26:54.243446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.243384    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"
Sep 14 13:26:54.243446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.243406    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" event={"ID":"d3672e16-c72e-413f-a47b-04741ca352f3","Type":"ContainerDied","Data":"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"}
Sep 14 13:26:54.243446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.243438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6" event={"ID":"d3672e16-c72e-413f-a47b-04741ca352f3","Type":"ContainerDied","Data":"a022213b9af73e8e745c5d7384d34d85076e80b6a18bc474445555ac63426563"}
Sep 14 13:26:54.251515 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.251501    2566 scope.go:117] "RemoveContainer" containerID="db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"
Sep 14 13:26:54.252090 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:26:54.251896    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6\": container with ID starting with db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6 not found: ID does not exist" containerID="db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"
Sep 14 13:26:54.252090 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.251936    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6"} err="failed to get container status \"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6\": rpc error: code = NotFound desc = could not find container \"db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6\": container with ID starting with db3332c4b597a608c231ae0c2bcb2c0eab12a673f3ff944c09bcce84a0414eb6 not found: ID does not exist"
Sep 14 13:26:54.252090 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.251959    2566 scope.go:117] "RemoveContainer" containerID="e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"
Sep 14 13:26:54.262301 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.262285    2566 scope.go:117] "RemoveContainer" containerID="e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"
Sep 14 13:26:54.262554 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:26:54.262536    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218\": container with ID starting with e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218 not found: ID does not exist" containerID="e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"
Sep 14 13:26:54.262613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.262567    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218"} err="failed to get container status \"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218\": rpc error: code = NotFound desc = could not find container \"e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218\": container with ID starting with e2746b4ff85439334a128938de75c79eeb2d23f859785bc7866d9fe770e64218 not found: ID does not exist"
Sep 14 13:26:54.307932 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.307884    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:26:54.315720 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.315606    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5cedb0-5f988f8bb-8xhrw"]
Sep 14 13:26:54.375768 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.375729    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:26:54.387476 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.387446    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5cedb0-59d6f689d5-rngw6"]
Sep 14 13:26:54.580559 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.580525    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:26:54.581005 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.580989    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" containerName="payload-pre-processing"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581006    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" containerName="payload-pre-processing"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581016    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f196af74-f81c-4369-ab17-7fa254ae6448" containerName="payload-processing"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581022    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f196af74-f81c-4369-ab17-7fa254ae6448" containerName="payload-processing"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581031    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc03003-a068-4f8b-b4bd-30d0a0474ca9" containerName="revoke-keys"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581038    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc03003-a068-4f8b-b4bd-30d0a0474ca9" containerName="revoke-keys"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581058    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3672e16-c72e-413f-a47b-04741ca352f3" containerName="payload-processing"
Sep 14 13:26:54.581065 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581065    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3672e16-c72e-413f-a47b-04741ca352f3" containerName="payload-processing"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581082    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d73be42-bbd4-456e-9a1e-dd87326afe2b" containerName="revoke-keys"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581087    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d73be42-bbd4-456e-9a1e-dd87326afe2b" containerName="revoke-keys"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581150    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc03003-a068-4f8b-b4bd-30d0a0474ca9" containerName="revoke-keys"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581159    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" containerName="payload-pre-processing"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581165    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f196af74-f81c-4369-ab17-7fa254ae6448" containerName="payload-processing"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581172    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3672e16-c72e-413f-a47b-04741ca352f3" containerName="payload-processing"
Sep 14 13:26:54.581305 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.581180    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d73be42-bbd4-456e-9a1e-dd87326afe2b" containerName="revoke-keys"
Sep 14 13:26:54.585748 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.585731    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.589150 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.589129    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f21e59-openshift-default-dockercfg-wdfnw\""
Sep 14 13:26:54.634008 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.633969    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:26:54.668088 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668216 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668345 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668244    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668345 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668422 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668375    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbc9z\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668471 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668421    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.668471 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.668451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770016 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.769982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770016 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770021    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770109    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbc9z\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770654 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770595    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770654 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770634    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770726 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770658    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770824 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770803    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.770883 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.770868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.772721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.772698    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.772920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.772902    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.789461 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.789436    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbc9z\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.791206 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.791186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token\") pod \"e2e-api-a-f21e59-openshift-default-8577698884-9xz8k\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") " pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:54.895726 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:54.895664    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:55.204105 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:55.204077    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:26:55.205980 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:26:55.205949    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb31503e_13f4_4540_9014_18583594aa1e.slice/crio-db89a4272fcf693aa603352a3641a5ae28a3ea0ab9768b1b6c4a8b1868974055 WatchSource:0}: Error finding container db89a4272fcf693aa603352a3641a5ae28a3ea0ab9768b1b6c4a8b1868974055: Status 404 returned error can't find the container with id db89a4272fcf693aa603352a3641a5ae28a3ea0ab9768b1b6c4a8b1868974055
Sep 14 13:26:55.208262 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:55.208231    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:26:55.208334 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:55.208297    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:26:55.208334 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:55.208325    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:26:55.257956 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:55.257920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerStarted","Data":"db89a4272fcf693aa603352a3641a5ae28a3ea0ab9768b1b6c4a8b1868974055"}
Sep 14 13:26:56.190963 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.190926    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3672e16-c72e-413f-a47b-04741ca352f3" path="/var/lib/kubelet/pods/d3672e16-c72e-413f-a47b-04741ca352f3/volumes"
Sep 14 13:26:56.191339 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.191310    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38" path="/var/lib/kubelet/pods/fbeb0b6f-033d-467a-b0bd-e3c55b5e7f38/volumes"
Sep 14 13:26:56.268498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.268466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerStarted","Data":"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"}
Sep 14 13:26:56.896606 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.896572    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:56.901897 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.901865    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:56.949014 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:56.948966    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podStartSLOduration=2.948951304 podStartE2EDuration="2.948951304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:26:56.320804049 +0000 UTC m=+1726.635587401" watchObservedRunningTime="2026-09-14 13:26:56.948951304 +0000 UTC m=+1727.263734655"
Sep 14 13:26:57.274314 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:57.274287    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:26:57.275152 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:26:57.275133    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:27:05.684554 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.684521    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:27:05.689353 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.689331    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.692968 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.692944    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f21e59\""
Sep 14 13:27:05.693086 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.693011    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f21e59-dockercfg-977q8\""
Sep 14 13:27:05.719103 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.719074    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:27:05.781347 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.781302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6dvf\" (UniqueName: \"kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.781790 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.781758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.883225 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.883191    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6dvf\" (UniqueName: \"kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.883399 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.883318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.884009 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.883989    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.898154 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.898128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6dvf\" (UniqueName: \"kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf\") pod \"payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") " pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:05.999713 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:05.999672    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:06.304681 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:06.304485    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:27:06.307767 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:27:06.307744    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2002b1_c18a_4952_8f17_8f7831016b2c.slice/crio-ead13d63918b69eb83ce12db3049e0e25897b3a76bc275a03226a963ae00be39 WatchSource:0}: Error finding container ead13d63918b69eb83ce12db3049e0e25897b3a76bc275a03226a963ae00be39: Status 404 returned error can't find the container with id ead13d63918b69eb83ce12db3049e0e25897b3a76bc275a03226a963ae00be39
Sep 14 13:27:06.325119 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:06.325094    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" event={"ID":"eb2002b1-c18a-4952-8f17-8f7831016b2c","Type":"ContainerStarted","Data":"ead13d63918b69eb83ce12db3049e0e25897b3a76bc275a03226a963ae00be39"}
Sep 14 13:27:07.053738 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:07.053705    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:27:07.054163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:07.053931    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy" containerID="cri-o://c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c" gracePeriod=30
Sep 14 13:27:07.332494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:07.332405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" event={"ID":"eb2002b1-c18a-4952-8f17-8f7831016b2c","Type":"ContainerStarted","Data":"cb4e718a3e23f0007aa0038daecf25e1ac82c45d8f10019885138d5837a1dabf"}
Sep 14 13:27:07.332494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:07.332465    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:07.452898 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:07.452847    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" podStartSLOduration=2.452833815 podStartE2EDuration="2.452833815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:27:07.443356556 +0000 UTC m=+1737.758139907" watchObservedRunningTime="2026-09-14 13:27:07.452833815 +0000 UTC m=+1737.767617167"
Sep 14 13:27:09.699561 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.699528    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"]
Sep 14 13:27:09.703116 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.703098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:09.707656 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.707636    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:27:09.708160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.708138    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:27:09.723407 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.723386    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"]
Sep 14 13:27:09.723793 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.723769    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z\" (UID: \"48c6f2d7-9028-484c-880e-c1751490f3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:09.825457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.825424    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z\" (UID: \"48c6f2d7-9028-484c-880e-c1751490f3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:09.826035 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:09.826017    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z\" (UID: \"48c6f2d7-9028-484c-880e-c1751490f3f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:10.013804 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.013770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:10.311415 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.311380    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"]
Sep 14 13:27:10.312936 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:27:10.312909    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c6f2d7_9028_484c_880e_c1751490f3f6.slice/crio-fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d WatchSource:0}: Error finding container fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d: Status 404 returned error can't find the container with id fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d
Sep 14 13:27:10.350127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.350093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z" event={"ID":"48c6f2d7-9028-484c-880e-c1751490f3f6","Type":"ContainerStarted","Data":"fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d"}
Sep 14 13:27:10.492245 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.492216    2566 scope.go:117] "RemoveContainer" containerID="1a49393e4a7b569f962ea7054902e0d51dc21076dd128831b7c26065f66eb8f0"
Sep 14 13:27:10.501160 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.501118    2566 scope.go:117] "RemoveContainer" containerID="ccc5e218a1c9f4280ce345b91d3354fc58dde3c2201557fb0a02b0d2704c9e4e"
Sep 14 13:27:10.509289 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:10.509267    2566 scope.go:117] "RemoveContainer" containerID="0ca055e8c4355dc89cab8ac50123e587fce2b8822798bbc3531f4063ac1d8b24"
Sep 14 13:27:11.358186 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:11.358154    2566 generic.go:356] "Generic (PLEG): container finished" podID="48c6f2d7-9028-484c-880e-c1751490f3f6" containerID="60554763345e7e2cd7ef87c723fdfc0e5886e52975ab6d21dd2859a4de36b737" exitCode=0
Sep 14 13:27:11.358571 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:11.358238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z" event={"ID":"48c6f2d7-9028-484c-880e-c1751490f3f6","Type":"ContainerDied","Data":"60554763345e7e2cd7ef87c723fdfc0e5886e52975ab6d21dd2859a4de36b737"}
Sep 14 13:27:12.314990 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.314936    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:27:12.349034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349009    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349194 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349071    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349194 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349103    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349194 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349132    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349359 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349257    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349359 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349315    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbn2t\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349363    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349378    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:27:12.349469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349406    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349469 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349465    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data\") pod \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\" (UID: \"46f3d183-ddc9-4cf4-bed6-00d6f5996514\") "
Sep 14 13:27:12.349678 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349565    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349771    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349937    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349956    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349970    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349968    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data" (OuterVolumeSpecName: "istio-data") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:12.350017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.349985    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:12.351452 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.351427    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:12.351452 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.351433    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:27:12.351666 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.351646    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token" (OuterVolumeSpecName: "istio-token") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:27:12.351788 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.351772    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t" (OuterVolumeSpecName: "kube-api-access-jbn2t") pod "46f3d183-ddc9-4cf4-bed6-00d6f5996514" (UID: "46f3d183-ddc9-4cf4-bed6-00d6f5996514"). InnerVolumeSpecName "kube-api-access-jbn2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:27:12.366306 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.366279    2566 generic.go:356] "Generic (PLEG): container finished" podID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerID="c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c" exitCode=0
Sep 14 13:27:12.366672 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.366334    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"
Sep 14 13:27:12.366672 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.366366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerDied","Data":"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"}
Sep 14 13:27:12.366672 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.366438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck" event={"ID":"46f3d183-ddc9-4cf4-bed6-00d6f5996514","Type":"ContainerDied","Data":"c4bc10c31d0a83fbaa37c5d6e5dfbefba994c346dd4666fd6806ce7026543cea"}
Sep 14 13:27:12.366672 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.366472    2566 scope.go:117] "RemoveContainer" containerID="c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"
Sep 14 13:27:12.380761 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.380736    2566 scope.go:117] "RemoveContainer" containerID="bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"
Sep 14 13:27:12.390143 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.390125    2566 scope.go:117] "RemoveContainer" containerID="c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"
Sep 14 13:27:12.390439 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:27:12.390410    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c\": container with ID starting with c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c not found: ID does not exist" containerID="c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"
Sep 14 13:27:12.390527 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.390447    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c"} err="failed to get container status \"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c\": rpc error: code = NotFound desc = could not find container \"c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c\": container with ID starting with c7d7c086e0cfdd5adda541f93e1bea6dbbc41767eca2d91408cc587a6f8a554c not found: ID does not exist"
Sep 14 13:27:12.390527 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.390472    2566 scope.go:117] "RemoveContainer" containerID="bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"
Sep 14 13:27:12.390805 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:27:12.390781    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175\": container with ID starting with bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175 not found: ID does not exist" containerID="bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"
Sep 14 13:27:12.390887 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.390808    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175"} err="failed to get container status \"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175\": rpc error: code = NotFound desc = could not find container \"bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175\": container with ID starting with bdffe701261e0fd87ebd9bf0936479813e69c46593a953827b2c350686224175 not found: ID does not exist"
Sep 14 13:27:12.423349 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.423009    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:27:12.438037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.438013    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5cedb0-openshift-default-7c4dbd545d-wjrck"]
Sep 14 13:27:12.450960 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450937    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbn2t\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-kube-api-access-jbn2t\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.450960 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450960    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.451127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450971    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.451127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450979    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.451127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450986    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.451127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.450994    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f3d183-ddc9-4cf4-bed6-00d6f5996514-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:12.486766 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.486748    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:12.551573 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.551545    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca\") pod \"48c6f2d7-9028-484c-880e-c1751490f3f6\" (UID: \"48c6f2d7-9028-484c-880e-c1751490f3f6\") "
Sep 14 13:27:12.551877 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.551856    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "48c6f2d7-9028-484c-880e-c1751490f3f6" (UID: "48c6f2d7-9028-484c-880e-c1751490f3f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:27:12.652882 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:12.652800    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48c6f2d7-9028-484c-880e-c1751490f3f6-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:13.373655 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:13.373579    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"
Sep 14 13:27:13.373655 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:13.373600    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z" event={"ID":"48c6f2d7-9028-484c-880e-c1751490f3f6","Type":"ContainerDied","Data":"fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d"}
Sep 14 13:27:13.373655 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:13.373643    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb02cfa78a34ab3ecfb18e23ff04ec94deed607669be301d66223863ecefdf9d"
Sep 14 13:27:14.190580 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:14.190542    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" path="/var/lib/kubelet/pods/46f3d183-ddc9-4cf4-bed6-00d6f5996514/volumes"
Sep 14 13:27:18.339970 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:18.339942    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:27:22.316585 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.316552    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:27:22.317033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.316828    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" podUID="45409ba9-c736-4941-80bc-c971bddc6cd6" containerName="payload-pre-processing" containerID="cri-o://d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37" gracePeriod=30
Sep 14 13:27:22.617308 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.617286    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:27:22.752082 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.752027    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume\") pod \"45409ba9-c736-4941-80bc-c971bddc6cd6\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") "
Sep 14 13:27:22.752240 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.752124    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwnvg\" (UniqueName: \"kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg\") pod \"45409ba9-c736-4941-80bc-c971bddc6cd6\" (UID: \"45409ba9-c736-4941-80bc-c971bddc6cd6\") "
Sep 14 13:27:22.752399 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.752375    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45409ba9-c736-4941-80bc-c971bddc6cd6" (UID: "45409ba9-c736-4941-80bc-c971bddc6cd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:27:22.752506 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.752492    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45409ba9-c736-4941-80bc-c971bddc6cd6-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:22.754190 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.754166    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg" (OuterVolumeSpecName: "kube-api-access-zwnvg") pod "45409ba9-c736-4941-80bc-c971bddc6cd6" (UID: "45409ba9-c736-4941-80bc-c971bddc6cd6"). InnerVolumeSpecName "kube-api-access-zwnvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:27:22.853668 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.853598    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwnvg\" (UniqueName: \"kubernetes.io/projected/45409ba9-c736-4941-80bc-c971bddc6cd6-kube-api-access-zwnvg\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:27:22.998627 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:22.998575    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"]
Sep 14 13:27:23.010078 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.010028    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-231820-vmg7z"]
Sep 14 13:27:23.427569 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.427533    2566 generic.go:356] "Generic (PLEG): container finished" podID="45409ba9-c736-4941-80bc-c971bddc6cd6" containerID="d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37" exitCode=0
Sep 14 13:27:23.427945 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.427580    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"
Sep 14 13:27:23.427945 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.427621    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" event={"ID":"45409ba9-c736-4941-80bc-c971bddc6cd6","Type":"ContainerDied","Data":"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"}
Sep 14 13:27:23.427945 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.427676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd" event={"ID":"45409ba9-c736-4941-80bc-c971bddc6cd6","Type":"ContainerDied","Data":"fb384d8448d6b74e08302d7dfa2eae2211c23d76bd8b99a3f36167e21206d040"}
Sep 14 13:27:23.427945 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.427699    2566 scope.go:117] "RemoveContainer" containerID="d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"
Sep 14 13:27:23.437268 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.437251    2566 scope.go:117] "RemoveContainer" containerID="d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"
Sep 14 13:27:23.437560 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:27:23.437543    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37\": container with ID starting with d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37 not found: ID does not exist" containerID="d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"
Sep 14 13:27:23.437608 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.437574    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37"} err="failed to get container status \"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37\": rpc error: code = NotFound desc = could not find container \"d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37\": container with ID starting with d0fbb751e2e165a9449e4f2cbbfd114aecf39b5757fce880aa678ba1b84adc37 not found: ID does not exist"
Sep 14 13:27:23.476086 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.476032    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:27:23.488828 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:23.488790    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-231820-849f766486-csdjd"]
Sep 14 13:27:24.194332 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:24.194287    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45409ba9-c736-4941-80bc-c971bddc6cd6" path="/var/lib/kubelet/pods/45409ba9-c736-4941-80bc-c971bddc6cd6/volumes"
Sep 14 13:27:24.194857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:24.194831    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c6f2d7-9028-484c-880e-c1751490f3f6" path="/var/lib/kubelet/pods/48c6f2d7-9028-484c-880e-c1751490f3f6/volumes"
Sep 14 13:27:28.316198 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:28.316161    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 13:27:28.316637 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:28.316227    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:27:30.474958 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.474926    2566 generic.go:356] "Generic (PLEG): container finished" podID="bb31503e-13f4-4540-9014-18583594aa1e" containerID="609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a" exitCode=0
Sep 14 13:27:30.475411 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.474996    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerDied","Data":"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"}
Sep 14 13:27:30.475457 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.475429    2566 scope.go:117] "RemoveContainer" containerID="609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"
Sep 14 13:27:30.476525 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.476496    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:27:30.476613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.476562    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:27:30.476613 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:30.476594    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 13:27:31.484588 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:31.484554    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerStarted","Data":"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"}
Sep 14 13:27:31.896431 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:31.896326    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:27:31.896608 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:31.896581    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:31.896683 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:31.896640    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:32.896888 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:32.896839    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:32.897380 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:32.896906    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:33.509824 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.509790    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:27:33.510229 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510216    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:27:33.510283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510232    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:27:33.510283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510247    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45409ba9-c736-4941-80bc-c971bddc6cd6" containerName="payload-pre-processing"
Sep 14 13:27:33.510283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510254    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45409ba9-c736-4941-80bc-c971bddc6cd6" containerName="payload-pre-processing"
Sep 14 13:27:33.510283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510267    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c6f2d7-9028-484c-880e-c1751490f3f6" containerName="revoke-keys"
Sep 14 13:27:33.510283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510272    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c6f2d7-9028-484c-880e-c1751490f3f6" containerName="revoke-keys"
Sep 14 13:27:33.510448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510341    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45409ba9-c736-4941-80bc-c971bddc6cd6" containerName="payload-pre-processing"
Sep 14 13:27:33.510448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510352    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:27:33.510448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.510360    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c6f2d7-9028-484c-880e-c1751490f3f6" containerName="revoke-keys"
Sep 14 13:27:33.512484 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.512469    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.515458 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.515432    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-8e0d7a-dockercfg-ss8z8\""
Sep 14 13:27:33.515574 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.515484    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-8e0d7a\""
Sep 14 13:27:33.539235 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.539208    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:27:33.694097 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.694032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.694292 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.694208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcjn\" (UniqueName: \"kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.795739 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.795648    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcjn\" (UniqueName: \"kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.795739 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.795732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.796421 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.796401    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.807115 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.807094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcjn\" (UniqueName: \"kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn\") pod \"payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.822583 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.822566    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:33.896425 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.896377    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:33.896586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:33.896466    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:34.159630 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.159592    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:27:34.162360 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:27:34.161663    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b2f716_8040_496d_9111_f9c05633914f.slice/crio-d11b0fbfe58b6ce8789c160f7f11c3c02105363c02f87abba081493078d842c4 WatchSource:0}: Error finding container d11b0fbfe58b6ce8789c160f7f11c3c02105363c02f87abba081493078d842c4: Status 404 returned error can't find the container with id d11b0fbfe58b6ce8789c160f7f11c3c02105363c02f87abba081493078d842c4
Sep 14 13:27:34.514502 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.514459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" event={"ID":"90b2f716-8040-496d-9111-f9c05633914f","Type":"ContainerStarted","Data":"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"}
Sep 14 13:27:34.514710 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.514524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" event={"ID":"90b2f716-8040-496d-9111-f9c05633914f","Type":"ContainerStarted","Data":"d11b0fbfe58b6ce8789c160f7f11c3c02105363c02f87abba081493078d842c4"}
Sep 14 13:27:34.514710 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.514550    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:27:34.557850 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.557793    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" podStartSLOduration=1.557773375 podStartE2EDuration="1.557773375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:27:34.557035384 +0000 UTC m=+1764.871818736" watchObservedRunningTime="2026-09-14 13:27:34.557773375 +0000 UTC m=+1764.872556728"
Sep 14 13:27:34.896772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.896678    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:34.897034 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:34.897002    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:35.896933 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:35.896889    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:35.897391 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:35.896957    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:36.896038 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:36.896003    2566 patch_prober.go:28] interesting pod/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 14 13:27:36.896364 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:36.896096    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 14 13:27:37.899605 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:37.899577    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:27:37.899977 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:37.899958    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:27:37.900564 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:37.900542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:27:45.523069 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:27:45.523009    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:28:01.149322 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.149285    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"]
Sep 14 13:28:01.149740 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.149727    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:28:01.149740 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.149741    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:28:01.149820 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.149811    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f3d183-ddc9-4cf4-bed6-00d6f5996514" containerName="istio-proxy"
Sep 14 13:28:01.153161 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.153146    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:01.158763 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.158743    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:28:01.159006 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.158990    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:28:01.172710 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.172640    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"]
Sep 14 13:28:01.258725 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.258699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f21e59-m82fk\" (UID: \"6566027f-0120-4a8b-8cb2-0357c1891d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:01.359989 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.359960    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f21e59-m82fk\" (UID: \"6566027f-0120-4a8b-8cb2-0357c1891d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:01.360673 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.360655    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f21e59-m82fk\" (UID: \"6566027f-0120-4a8b-8cb2-0357c1891d46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:01.463090 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.463067    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:01.743108 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:01.741881    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"]
Sep 14 13:28:01.743886 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:28:01.743852    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6566027f_0120_4a8b_8cb2_0357c1891d46.slice/crio-6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36 WatchSource:0}: Error finding container 6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36: Status 404 returned error can't find the container with id 6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36
Sep 14 13:28:02.677623 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:02.677578    2566 generic.go:356] "Generic (PLEG): container finished" podID="6566027f-0120-4a8b-8cb2-0357c1891d46" containerID="1d358d41ae2aac4a95c5b3368c7fdf8edef4f1f7098d219dde7dac5c79bb9799" exitCode=0
Sep 14 13:28:02.678146 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:02.677659    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk" event={"ID":"6566027f-0120-4a8b-8cb2-0357c1891d46","Type":"ContainerDied","Data":"1d358d41ae2aac4a95c5b3368c7fdf8edef4f1f7098d219dde7dac5c79bb9799"}
Sep 14 13:28:02.678146 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:02.677700    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk" event={"ID":"6566027f-0120-4a8b-8cb2-0357c1891d46","Type":"ContainerStarted","Data":"6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36"}
Sep 14 13:28:03.809451 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:03.809425    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:03.988912 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:03.988879    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca\") pod \"6566027f-0120-4a8b-8cb2-0357c1891d46\" (UID: \"6566027f-0120-4a8b-8cb2-0357c1891d46\") "
Sep 14 13:28:03.989247 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:03.989224    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6566027f-0120-4a8b-8cb2-0357c1891d46" (UID: "6566027f-0120-4a8b-8cb2-0357c1891d46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:04.090165 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:04.090128    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6566027f-0120-4a8b-8cb2-0357c1891d46-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:04.693260 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:04.693220    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk" event={"ID":"6566027f-0120-4a8b-8cb2-0357c1891d46","Type":"ContainerDied","Data":"6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36"}
Sep 14 13:28:04.693444 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:04.693279    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b37fbe566458a5aedcde979b8ca5c29940873fbb7818669ffeb2ca64fcaab36"
Sep 14 13:28:04.693444 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:04.693239    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"
Sep 14 13:28:10.309365 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:10.309338    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:28:10.321630 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:10.321607    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:28:10.553217 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:10.553188    2566 scope.go:117] "RemoveContainer" containerID="86b993ab4d5a06cc25917b027c500c07492d3e6cf0d7e769d56d7f5ef2d585f1"
Sep 14 13:28:17.542773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.542260    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:28:17.543648 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.542591    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" podUID="eb2002b1-c18a-4952-8f17-8f7831016b2c" containerName="payload-processing" containerID="cri-o://cb4e718a3e23f0007aa0038daecf25e1ac82c45d8f10019885138d5837a1dabf" gracePeriod=30
Sep 14 13:28:17.737126 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.737097    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"]
Sep 14 13:28:17.737542 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.737529    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6566027f-0120-4a8b-8cb2-0357c1891d46" containerName="revoke-keys"
Sep 14 13:28:17.737590 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.737543    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6566027f-0120-4a8b-8cb2-0357c1891d46" containerName="revoke-keys"
Sep 14 13:28:17.737630 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.737607    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6566027f-0120-4a8b-8cb2-0357c1891d46" containerName="revoke-keys"
Sep 14 13:28:17.741027 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.741007    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:17.744330 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.744307    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:28:17.744452 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.744355    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:28:17.763064 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.763018    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"]
Sep 14 13:28:17.771504 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.771477    2566 generic.go:356] "Generic (PLEG): container finished" podID="eb2002b1-c18a-4952-8f17-8f7831016b2c" containerID="cb4e718a3e23f0007aa0038daecf25e1ac82c45d8f10019885138d5837a1dabf" exitCode=0
Sep 14 13:28:17.771614 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.771553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" event={"ID":"eb2002b1-c18a-4952-8f17-8f7831016b2c","Type":"ContainerDied","Data":"cb4e718a3e23f0007aa0038daecf25e1ac82c45d8f10019885138d5837a1dabf"}
Sep 14 13:28:17.792229 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.792208    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:28:17.832041 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.831981    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6dvf\" (UniqueName: \"kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf\") pod \"eb2002b1-c18a-4952-8f17-8f7831016b2c\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") "
Sep 14 13:28:17.832169 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.832155    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume\") pod \"eb2002b1-c18a-4952-8f17-8f7831016b2c\" (UID: \"eb2002b1-c18a-4952-8f17-8f7831016b2c\") "
Sep 14 13:28:17.832340 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.832321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp\" (UID: \"b4d4fd78-0c3d-4161-bfd0-637cc910787e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:17.832514 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.832492    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb2002b1-c18a-4952-8f17-8f7831016b2c" (UID: "eb2002b1-c18a-4952-8f17-8f7831016b2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:17.834017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.833991    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf" (OuterVolumeSpecName: "kube-api-access-t6dvf") pod "eb2002b1-c18a-4952-8f17-8f7831016b2c" (UID: "eb2002b1-c18a-4952-8f17-8f7831016b2c"). InnerVolumeSpecName "kube-api-access-t6dvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:17.933676 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.933627    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp\" (UID: \"b4d4fd78-0c3d-4161-bfd0-637cc910787e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:17.933882 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.933699    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2002b1-c18a-4952-8f17-8f7831016b2c-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:17.933882 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.933710    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6dvf\" (UniqueName: \"kubernetes.io/projected/eb2002b1-c18a-4952-8f17-8f7831016b2c-kube-api-access-t6dvf\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:17.934337 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:17.934315    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp\" (UID: \"b4d4fd78-0c3d-4161-bfd0-637cc910787e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:18.053625 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.053590    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:18.363567 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.363534    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"]
Sep 14 13:28:18.365210 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:28:18.365174    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d4fd78_0c3d_4161_bfd0_637cc910787e.slice/crio-d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae WatchSource:0}: Error finding container d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae: Status 404 returned error can't find the container with id d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae
Sep 14 13:28:18.444707 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.444680    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"]
Sep 14 13:28:18.453311 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.453285    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f21e59-m82fk"]
Sep 14 13:28:18.778149 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.778107    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp" event={"ID":"b4d4fd78-0c3d-4161-bfd0-637cc910787e","Type":"ContainerStarted","Data":"219704329a6b075a8799b8c2f2e8b26b6eafffd533da44566871ee444fd55029"}
Sep 14 13:28:18.778543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.778206    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp" event={"ID":"b4d4fd78-0c3d-4161-bfd0-637cc910787e","Type":"ContainerStarted","Data":"d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae"}
Sep 14 13:28:18.779564 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.779544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr" event={"ID":"eb2002b1-c18a-4952-8f17-8f7831016b2c","Type":"ContainerDied","Data":"ead13d63918b69eb83ce12db3049e0e25897b3a76bc275a03226a963ae00be39"}
Sep 14 13:28:18.779629 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.779570    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"
Sep 14 13:28:18.779629 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.779590    2566 scope.go:117] "RemoveContainer" containerID="cb4e718a3e23f0007aa0038daecf25e1ac82c45d8f10019885138d5837a1dabf"
Sep 14 13:28:18.843250 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.843203    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp" podStartSLOduration=1.843177092 podStartE2EDuration="1.843177092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:28:18.840477864 +0000 UTC m=+1809.155261230" watchObservedRunningTime="2026-09-14 13:28:18.843177092 +0000 UTC m=+1809.157960445"
Sep 14 13:28:18.872017 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.871990    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:28:18.889325 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:18.889297    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f21e59-685b9ffdd7-npknr"]
Sep 14 13:28:19.786794 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:19.786758    2566 generic.go:356] "Generic (PLEG): container finished" podID="b4d4fd78-0c3d-4161-bfd0-637cc910787e" containerID="219704329a6b075a8799b8c2f2e8b26b6eafffd533da44566871ee444fd55029" exitCode=0
Sep 14 13:28:19.787257 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:19.786845    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp" event={"ID":"b4d4fd78-0c3d-4161-bfd0-637cc910787e","Type":"ContainerDied","Data":"219704329a6b075a8799b8c2f2e8b26b6eafffd533da44566871ee444fd55029"}
Sep 14 13:28:20.191609 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:20.191529    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6566027f-0120-4a8b-8cb2-0357c1891d46" path="/var/lib/kubelet/pods/6566027f-0120-4a8b-8cb2-0357c1891d46/volumes"
Sep 14 13:28:20.191903 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:20.191890    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb2002b1-c18a-4952-8f17-8f7831016b2c" path="/var/lib/kubelet/pods/eb2002b1-c18a-4952-8f17-8f7831016b2c/volumes"
Sep 14 13:28:20.931795 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:20.931772    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:21.062886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.062782    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca\") pod \"b4d4fd78-0c3d-4161-bfd0-637cc910787e\" (UID: \"b4d4fd78-0c3d-4161-bfd0-637cc910787e\") "
Sep 14 13:28:21.063286 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.063258    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4d4fd78-0c3d-4161-bfd0-637cc910787e" (UID: "b4d4fd78-0c3d-4161-bfd0-637cc910787e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:21.163952 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.163921    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d4fd78-0c3d-4161-bfd0-637cc910787e-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:21.799565 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.799531    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp" event={"ID":"b4d4fd78-0c3d-4161-bfd0-637cc910787e","Type":"ContainerDied","Data":"d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae"}
Sep 14 13:28:21.799734 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.799576    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7ab6883f547b9f47c3c9360de35f39db9c3183bbe5e983e17ee7b27006a19ae"
Sep 14 13:28:21.799734 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:21.799575    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"
Sep 14 13:28:29.345185 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.345142    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:28:29.345620 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.345403    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy" containerID="cri-o://32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0" gracePeriod=30
Sep 14 13:28:29.745181 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745148    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"]
Sep 14 13:28:29.745703 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745684    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb2002b1-c18a-4952-8f17-8f7831016b2c" containerName="payload-processing"
Sep 14 13:28:29.745756 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745705    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb2002b1-c18a-4952-8f17-8f7831016b2c" containerName="payload-processing"
Sep 14 13:28:29.745756 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745716    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d4fd78-0c3d-4161-bfd0-637cc910787e" containerName="revoke-keys"
Sep 14 13:28:29.745756 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745721    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d4fd78-0c3d-4161-bfd0-637cc910787e" containerName="revoke-keys"
Sep 14 13:28:29.745852 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745789    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb2002b1-c18a-4952-8f17-8f7831016b2c" containerName="payload-processing"
Sep 14 13:28:29.745852 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.745799    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d4fd78-0c3d-4161-bfd0-637cc910787e" containerName="revoke-keys"
Sep 14 13:28:29.749037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.749010    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:29.754299 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.754280    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:28:29.764190 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.764170    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"]
Sep 14 13:28:29.765642 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.765622    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:28:29.850188 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.850163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh\" (UID: \"e8365197-9f39-4c27-87d4-3aa8a82d059d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:29.951378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.951345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh\" (UID: \"e8365197-9f39-4c27-87d4-3aa8a82d059d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:29.951941 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:29.951920    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh\" (UID: \"e8365197-9f39-4c27-87d4-3aa8a82d059d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:30.059379 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:30.059301    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:30.358198 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:30.357951    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"]
Sep 14 13:28:30.361092 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:28:30.361067    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8365197_9f39_4c27_87d4_3aa8a82d059d.slice/crio-fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837 WatchSource:0}: Error finding container fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837: Status 404 returned error can't find the container with id fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837
Sep 14 13:28:30.849591 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:30.849556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh" event={"ID":"e8365197-9f39-4c27-87d4-3aa8a82d059d","Type":"ContainerStarted","Data":"372204b3f91df7b957c283f8da29f728c60c4528c01ab922c0da5f9a62af9f45"}
Sep 14 13:28:30.849753 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:30.849612    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh" event={"ID":"e8365197-9f39-4c27-87d4-3aa8a82d059d","Type":"ContainerStarted","Data":"fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837"}
Sep 14 13:28:30.882584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:30.882537    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh" podStartSLOduration=1.882524066 podStartE2EDuration="1.882524066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:28:30.880953545 +0000 UTC m=+1821.195736896" watchObservedRunningTime="2026-09-14 13:28:30.882524066 +0000 UTC m=+1821.197307418"
Sep 14 13:28:31.856441 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:31.856405    2566 generic.go:356] "Generic (PLEG): container finished" podID="e8365197-9f39-4c27-87d4-3aa8a82d059d" containerID="372204b3f91df7b957c283f8da29f728c60c4528c01ab922c0da5f9a62af9f45" exitCode=0
Sep 14 13:28:31.856828 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:31.856487    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh" event={"ID":"e8365197-9f39-4c27-87d4-3aa8a82d059d","Type":"ContainerDied","Data":"372204b3f91df7b957c283f8da29f728c60c4528c01ab922c0da5f9a62af9f45"}
Sep 14 13:28:32.999793 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:32.999766    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:33.083293 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.083263    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca\") pod \"e8365197-9f39-4c27-87d4-3aa8a82d059d\" (UID: \"e8365197-9f39-4c27-87d4-3aa8a82d059d\") "
Sep 14 13:28:33.083580 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.083561    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8365197-9f39-4c27-87d4-3aa8a82d059d" (UID: "e8365197-9f39-4c27-87d4-3aa8a82d059d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:33.184880 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.184798    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8365197-9f39-4c27-87d4-3aa8a82d059d-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:33.868374 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.868344    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"
Sep 14 13:28:33.868543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.868381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh" event={"ID":"e8365197-9f39-4c27-87d4-3aa8a82d059d","Type":"ContainerDied","Data":"fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837"}
Sep 14 13:28:33.868543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:33.868427    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc7421626a4adc4acf8c74bb206f5c16e345ad2c0ef7fc776d11d6faebe43837"
Sep 14 13:28:34.596402 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.596377    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:28:34.701400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701302    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701362    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701380    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701400 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701709 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701446    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701709 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701467    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701709 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701485    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbc9z\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701709 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701589    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701709 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701615    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert\") pod \"bb31503e-13f4-4540-9014-18583594aa1e\" (UID: \"bb31503e-13f4-4540-9014-18583594aa1e\") "
Sep 14 13:28:34.701958 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701795    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:34.702037 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702022    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:34.702105 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702033    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:34.702105 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.701805    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:34.702218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702138    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.702218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702160    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.702218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702175    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.702218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702177    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:34.702218 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.702189    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.703766 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.703735    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:34.703877 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.703764    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z" (OuterVolumeSpecName: "kube-api-access-zbc9z") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "kube-api-access-zbc9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:34.704033 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.704002    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:28:34.704146 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.704002    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb31503e-13f4-4540-9014-18583594aa1e" (UID: "bb31503e-13f4-4540-9014-18583594aa1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:34.803307 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.803278    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb31503e-13f4-4540-9014-18583594aa1e-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.803307 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.803303    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb31503e-13f4-4540-9014-18583594aa1e-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.803307 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.803312    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.803543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.803321    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbc9z\" (UniqueName: \"kubernetes.io/projected/bb31503e-13f4-4540-9014-18583594aa1e-kube-api-access-zbc9z\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.803543 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.803329    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb31503e-13f4-4540-9014-18583594aa1e-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:34.897899 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.897860    2566 generic.go:356] "Generic (PLEG): container finished" podID="bb31503e-13f4-4540-9014-18583594aa1e" containerID="32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0" exitCode=0
Sep 14 13:28:34.898148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.897912    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"
Sep 14 13:28:34.898148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.897954    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerDied","Data":"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"}
Sep 14 13:28:34.898148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.898027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k" event={"ID":"bb31503e-13f4-4540-9014-18583594aa1e","Type":"ContainerDied","Data":"db89a4272fcf693aa603352a3641a5ae28a3ea0ab9768b1b6c4a8b1868974055"}
Sep 14 13:28:34.898148 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.898081    2566 scope.go:117] "RemoveContainer" containerID="32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"
Sep 14 13:28:34.908308 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.908288    2566 scope.go:117] "RemoveContainer" containerID="609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"
Sep 14 13:28:34.916791 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.916766    2566 scope.go:117] "RemoveContainer" containerID="32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"
Sep 14 13:28:34.917116 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:28:34.917095    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0\": container with ID starting with 32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0 not found: ID does not exist" containerID="32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"
Sep 14 13:28:34.917184 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.917127    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0"} err="failed to get container status \"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0\": rpc error: code = NotFound desc = could not find container \"32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0\": container with ID starting with 32e63c7b784e19b8680f87901afe56b2e14436dfcf993aafd52eeeeeb8bf08c0 not found: ID does not exist"
Sep 14 13:28:34.917184 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.917149    2566 scope.go:117] "RemoveContainer" containerID="609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"
Sep 14 13:28:34.917422 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:28:34.917400    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a\": container with ID starting with 609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a not found: ID does not exist" containerID="609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"
Sep 14 13:28:34.917455 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.917430    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a"} err="failed to get container status \"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a\": rpc error: code = NotFound desc = could not find container \"609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a\": container with ID starting with 609b637fc83630f633f0e973bca545dca56da134551d838a802728af741f1b5a not found: ID does not exist"
Sep 14 13:28:34.965895 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.965855    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:28:34.970295 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:34.970267    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f21e59-openshift-default-8577698884-9xz8k"]
Sep 14 13:28:35.052235 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.052195    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:28:35.052439 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.052408    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" podUID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" containerName="payload-processing" containerID="cri-o://d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db" gracePeriod=30
Sep 14 13:28:35.301465 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.301440    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:28:35.409278 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.409239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhwwd\" (UniqueName: \"kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd\") pod \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") "
Sep 14 13:28:35.409443 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.409294    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume\") pod \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\" (UID: \"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9\") "
Sep 14 13:28:35.409653 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.409630    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" (UID: "8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:35.411461 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.411432    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd" (OuterVolumeSpecName: "kube-api-access-mhwwd") pod "8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" (UID: "8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9"). InnerVolumeSpecName "kube-api-access-mhwwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:35.510540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.510458    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhwwd\" (UniqueName: \"kubernetes.io/projected/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-kube-api-access-mhwwd\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:35.510540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.510490    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:35.718390 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.718355    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"]
Sep 14 13:28:35.727951 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.727915    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-aea349-mqsnp"]
Sep 14 13:28:35.906070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.905928    2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" containerID="d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db" exitCode=0
Sep 14 13:28:35.906070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.906001    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"
Sep 14 13:28:35.906070 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.906017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" event={"ID":"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9","Type":"ContainerDied","Data":"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"}
Sep 14 13:28:35.906304 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.906119    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls" event={"ID":"8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9","Type":"ContainerDied","Data":"f83b524842bf4e028cfb039b17dafca57c612c0d76245626abbc33466c86b7b6"}
Sep 14 13:28:35.906304 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.906152    2566 scope.go:117] "RemoveContainer" containerID="d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"
Sep 14 13:28:35.915299 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.915280    2566 scope.go:117] "RemoveContainer" containerID="d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"
Sep 14 13:28:35.915552 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:28:35.915534    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db\": container with ID starting with d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db not found: ID does not exist" containerID="d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"
Sep 14 13:28:35.915620 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.915557    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db"} err="failed to get container status \"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db\": rpc error: code = NotFound desc = could not find container \"d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db\": container with ID starting with d3b6510793c676b3511657e2535418eb9e73f6ee9f1b7bb0e65696c6daaeb3db not found: ID does not exist"
Sep 14 13:28:35.961886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.961855    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:28:35.987714 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:35.987683    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-aea349-67dbf76df-776ls"]
Sep 14 13:28:36.192274 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:36.192199    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" path="/var/lib/kubelet/pods/8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9/volumes"
Sep 14 13:28:36.192624 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:36.192607    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d4fd78-0c3d-4161-bfd0-637cc910787e" path="/var/lib/kubelet/pods/b4d4fd78-0c3d-4161-bfd0-637cc910787e/volumes"
Sep 14 13:28:36.193055 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:36.193029    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb31503e-13f4-4540-9014-18583594aa1e" path="/var/lib/kubelet/pods/bb31503e-13f4-4540-9014-18583594aa1e/volumes"
Sep 14 13:28:47.620524 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.620491    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:28:47.620929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.620705    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" podUID="90b2f716-8040-496d-9111-f9c05633914f" containerName="payload-pre-processing" containerID="cri-o://6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938" gracePeriod=30
Sep 14 13:28:47.877754 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.877730    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:28:47.914210 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.914175    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckcjn\" (UniqueName: \"kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn\") pod \"90b2f716-8040-496d-9111-f9c05633914f\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") "
Sep 14 13:28:47.914392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.914316    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume\") pod \"90b2f716-8040-496d-9111-f9c05633914f\" (UID: \"90b2f716-8040-496d-9111-f9c05633914f\") "
Sep 14 13:28:47.914715 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.914688    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90b2f716-8040-496d-9111-f9c05633914f" (UID: "90b2f716-8040-496d-9111-f9c05633914f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:28:47.916256 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.916234    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn" (OuterVolumeSpecName: "kube-api-access-ckcjn") pod "90b2f716-8040-496d-9111-f9c05633914f" (UID: "90b2f716-8040-496d-9111-f9c05633914f"). InnerVolumeSpecName "kube-api-access-ckcjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:47.975772 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.975737    2566 generic.go:356] "Generic (PLEG): container finished" podID="90b2f716-8040-496d-9111-f9c05633914f" containerID="6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938" exitCode=0
Sep 14 13:28:47.975920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.975779    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"
Sep 14 13:28:47.975920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.975818    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" event={"ID":"90b2f716-8040-496d-9111-f9c05633914f","Type":"ContainerDied","Data":"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"}
Sep 14 13:28:47.975920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.975874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t" event={"ID":"90b2f716-8040-496d-9111-f9c05633914f","Type":"ContainerDied","Data":"d11b0fbfe58b6ce8789c160f7f11c3c02105363c02f87abba081493078d842c4"}
Sep 14 13:28:47.975920 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.975897    2566 scope.go:117] "RemoveContainer" containerID="6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"
Sep 14 13:28:47.984943 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.984926    2566 scope.go:117] "RemoveContainer" containerID="6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"
Sep 14 13:28:47.985220 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:28:47.985203    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938\": container with ID starting with 6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938 not found: ID does not exist" containerID="6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"
Sep 14 13:28:47.985290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:47.985231    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938"} err="failed to get container status \"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938\": rpc error: code = NotFound desc = could not find container \"6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938\": container with ID starting with 6881a831814f1a622f4705918b5bed94aab5ed28ad31fcfd813b6dd4d0790938 not found: ID does not exist"
Sep 14 13:28:48.015249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.015226    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90b2f716-8040-496d-9111-f9c05633914f-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:48.015249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.015248    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckcjn\" (UniqueName: \"kubernetes.io/projected/90b2f716-8040-496d-9111-f9c05633914f-kube-api-access-ckcjn\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:28:48.044934 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.044910    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:28:48.053993 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.053951    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-8e0d7a-c8bcbf5cd-c2b2t"]
Sep 14 13:28:48.191114 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.191013    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b2f716-8040-496d-9111-f9c05633914f" path="/var/lib/kubelet/pods/90b2f716-8040-496d-9111-f9c05633914f/volumes"
Sep 14 13:28:48.503430 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.503398    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"]
Sep 14 13:28:48.527769 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:48.527738    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8e0d7a-lvxxh"]
Sep 14 13:28:50.190869 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:50.190837    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8365197-9f39-4c27-87d4-3aa8a82d059d" path="/var/lib/kubelet/pods/e8365197-9f39-4c27-87d4-3aa8a82d059d/volumes"
Sep 14 13:28:57.163289 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163257    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"]
Sep 14 13:28:57.163702 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163688    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" containerName="payload-processing"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163703    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" containerName="payload-processing"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163712    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163717    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163726    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b2f716-8040-496d-9111-f9c05633914f" containerName="payload-pre-processing"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163732    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b2f716-8040-496d-9111-f9c05633914f" containerName="payload-pre-processing"
Sep 14 13:28:57.163749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163747    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163756    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163764    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8365197-9f39-4c27-87d4-3aa8a82d059d" containerName="revoke-keys"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163769    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8365197-9f39-4c27-87d4-3aa8a82d059d" containerName="revoke-keys"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163834    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163842    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81c843-d6f3-46dc-bf5f-cd872f5ad5c9" containerName="payload-processing"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163848    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b2f716-8040-496d-9111-f9c05633914f" containerName="payload-pre-processing"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163853    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb31503e-13f4-4540-9014-18583594aa1e" containerName="istio-proxy"
Sep 14 13:28:57.163929 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.163860    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8365197-9f39-4c27-87d4-3aa8a82d059d" containerName="revoke-keys"
Sep 14 13:28:57.168126 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.168110    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:28:57.184127 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.184106    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:28:57.184258 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.184174    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:28:57.198621 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.198595    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj\" (UID: \"1e369571-d5cc-4cf9-a03e-6426f122c3c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:28:57.299399 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.299376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj\" (UID: \"1e369571-d5cc-4cf9-a03e-6426f122c3c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:28:57.299955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.299937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj\" (UID: \"1e369571-d5cc-4cf9-a03e-6426f122c3c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:28:57.309836 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.309801    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"]
Sep 14 13:28:57.477443 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.477418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:28:57.782791 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:57.782765    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"]
Sep 14 13:28:57.785468 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:28:57.785440    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e369571_d5cc_4cf9_a03e_6426f122c3c6.slice/crio-4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc WatchSource:0}: Error finding container 4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc: Status 404 returned error can't find the container with id 4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc
Sep 14 13:28:58.035461 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:58.035398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj" event={"ID":"1e369571-d5cc-4cf9-a03e-6426f122c3c6","Type":"ContainerStarted","Data":"4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc"}
Sep 14 13:28:59.042651 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:59.042616    2566 generic.go:356] "Generic (PLEG): container finished" podID="1e369571-d5cc-4cf9-a03e-6426f122c3c6" containerID="423327d89d7122345edcf559abd64e5315aa75a2fac20024df8efcc543d95c50" exitCode=0
Sep 14 13:28:59.043061 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:28:59.042708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj" event={"ID":"1e369571-d5cc-4cf9-a03e-6426f122c3c6","Type":"ContainerDied","Data":"423327d89d7122345edcf559abd64e5315aa75a2fac20024df8efcc543d95c50"}
Sep 14 13:29:00.177573 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:00.177547    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:29:00.227949 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:00.227920    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca\") pod \"1e369571-d5cc-4cf9-a03e-6426f122c3c6\" (UID: \"1e369571-d5cc-4cf9-a03e-6426f122c3c6\") "
Sep 14 13:29:00.228485 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:00.228289    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e369571-d5cc-4cf9-a03e-6426f122c3c6" (UID: "1e369571-d5cc-4cf9-a03e-6426f122c3c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:00.228485 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:00.228391    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e369571-d5cc-4cf9-a03e-6426f122c3c6-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:01.054671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:01.054646    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"
Sep 14 13:29:01.054837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:01.054645    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj" event={"ID":"1e369571-d5cc-4cf9-a03e-6426f122c3c6","Type":"ContainerDied","Data":"4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc"}
Sep 14 13:29:01.054837 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:01.054765    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d7fd54bd21c7a2dc9b3fd6998b72ef227340f6da6b4f225080cb13bb37f11fc"
Sep 14 13:29:08.143808 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.143779    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:29:08.144290 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.143959    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" podUID="404a3444-6ee0-4bb4-871a-beea9d3a6813" containerName="payload-processing" containerID="cri-o://b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2" gracePeriod=30
Sep 14 13:29:08.393654 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.393623    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:29:08.500316 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.500284    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume\") pod \"404a3444-6ee0-4bb4-871a-beea9d3a6813\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") "
Sep 14 13:29:08.500488 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.500413    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gv45\" (UniqueName: \"kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45\") pod \"404a3444-6ee0-4bb4-871a-beea9d3a6813\" (UID: \"404a3444-6ee0-4bb4-871a-beea9d3a6813\") "
Sep 14 13:29:08.500755 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.500726    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "404a3444-6ee0-4bb4-871a-beea9d3a6813" (UID: "404a3444-6ee0-4bb4-871a-beea9d3a6813"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:08.502503 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.502469    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45" (OuterVolumeSpecName: "kube-api-access-9gv45") pod "404a3444-6ee0-4bb4-871a-beea9d3a6813" (UID: "404a3444-6ee0-4bb4-871a-beea9d3a6813"). InnerVolumeSpecName "kube-api-access-9gv45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:08.601463 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.601432    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gv45\" (UniqueName: \"kubernetes.io/projected/404a3444-6ee0-4bb4-871a-beea9d3a6813-kube-api-access-9gv45\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:08.601463 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.601460    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/404a3444-6ee0-4bb4-871a-beea9d3a6813-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:08.629003 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.628969    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"]
Sep 14 13:29:08.642334 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:08.642296    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-366f7d-d7ktj"]
Sep 14 13:29:09.097204 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.097170    2566 generic.go:356] "Generic (PLEG): container finished" podID="404a3444-6ee0-4bb4-871a-beea9d3a6813" containerID="b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2" exitCode=0
Sep 14 13:29:09.097378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.097226    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"
Sep 14 13:29:09.097378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.097240    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" event={"ID":"404a3444-6ee0-4bb4-871a-beea9d3a6813","Type":"ContainerDied","Data":"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"}
Sep 14 13:29:09.097378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.097304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr" event={"ID":"404a3444-6ee0-4bb4-871a-beea9d3a6813","Type":"ContainerDied","Data":"b69470a5ddc1465d13b8c621ebb7e478b75c372231f9ac19c9b3172b794c0720"}
Sep 14 13:29:09.097378 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.097327    2566 scope.go:117] "RemoveContainer" containerID="b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"
Sep 14 13:29:09.106721 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.106702    2566 scope.go:117] "RemoveContainer" containerID="b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"
Sep 14 13:29:09.106987 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:29:09.106965    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2\": container with ID starting with b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2 not found: ID does not exist" containerID="b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"
Sep 14 13:29:09.107109 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.106992    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2"} err="failed to get container status \"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2\": rpc error: code = NotFound desc = could not find container \"b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2\": container with ID starting with b956a35f6eea15698c04d8f229c13f81f2b8d755d5e2cf7ecdff85d788d8a9d2 not found: ID does not exist"
Sep 14 13:29:09.160232 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.160189    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:29:09.162001 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:09.161960    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-366f7d-6ffbd97597-bcmzr"]
Sep 14 13:29:10.189730 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:10.189693    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e369571-d5cc-4cf9-a03e-6426f122c3c6" path="/var/lib/kubelet/pods/1e369571-d5cc-4cf9-a03e-6426f122c3c6/volumes"
Sep 14 13:29:10.190121 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:10.190097    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404a3444-6ee0-4bb4-871a-beea9d3a6813" path="/var/lib/kubelet/pods/404a3444-6ee0-4bb4-871a-beea9d3a6813/volumes"
Sep 14 13:29:16.595358 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.595321    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:29:16.595733 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.595513    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" containerID="cri-o://70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1" gracePeriod=30
Sep 14 13:29:16.921728 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.921654    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"]
Sep 14 13:29:16.922121 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922107    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404a3444-6ee0-4bb4-871a-beea9d3a6813" containerName="payload-processing"
Sep 14 13:29:16.922177 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922123    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="404a3444-6ee0-4bb4-871a-beea9d3a6813" containerName="payload-processing"
Sep 14 13:29:16.922177 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922147    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e369571-d5cc-4cf9-a03e-6426f122c3c6" containerName="revoke-keys"
Sep 14 13:29:16.922177 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922153    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e369571-d5cc-4cf9-a03e-6426f122c3c6" containerName="revoke-keys"
Sep 14 13:29:16.922270 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922220    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="404a3444-6ee0-4bb4-871a-beea9d3a6813" containerName="payload-processing"
Sep 14 13:29:16.922270 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.922230    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e369571-d5cc-4cf9-a03e-6426f122c3c6" containerName="revoke-keys"
Sep 14 13:29:16.925310 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.925295    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:16.929366 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.929343    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:29:16.929498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.929347    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:29:16.952529 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:16.952505    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"]
Sep 14 13:29:17.076653 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:17.076616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw\" (UID: \"730a1fec-8ab2-414a-ad0c-d27492497546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:17.178163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:17.178069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw\" (UID: \"730a1fec-8ab2-414a-ad0c-d27492497546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:17.178732 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:17.178712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw\" (UID: \"730a1fec-8ab2-414a-ad0c-d27492497546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:17.235296 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:17.235183    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:17.525916 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:17.525891    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"]
Sep 14 13:29:17.527688 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:29:17.527666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730a1fec_8ab2_414a_ad0c_d27492497546.slice/crio-6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053 WatchSource:0}: Error finding container 6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053: Status 404 returned error can't find the container with id 6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053
Sep 14 13:29:18.143614 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:18.143530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw" event={"ID":"730a1fec-8ab2-414a-ad0c-d27492497546","Type":"ContainerStarted","Data":"56c4e9c1ec86bad7f2d75523bd0711cf532c9ba2466a299c804da6b050997133"}
Sep 14 13:29:18.143614 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:18.143580    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw" event={"ID":"730a1fec-8ab2-414a-ad0c-d27492497546","Type":"ContainerStarted","Data":"6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053"}
Sep 14 13:29:18.173095 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:18.173020    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw" podStartSLOduration=2.173003414 podStartE2EDuration="2.173003414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:29:18.170703277 +0000 UTC m=+1868.485486628" watchObservedRunningTime="2026-09-14 13:29:18.173003414 +0000 UTC m=+1868.487786810"
Sep 14 13:29:19.152660 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:19.152626    2566 generic.go:356] "Generic (PLEG): container finished" podID="730a1fec-8ab2-414a-ad0c-d27492497546" containerID="56c4e9c1ec86bad7f2d75523bd0711cf532c9ba2466a299c804da6b050997133" exitCode=0
Sep 14 13:29:19.153136 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:19.152708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw" event={"ID":"730a1fec-8ab2-414a-ad0c-d27492497546","Type":"ContainerDied","Data":"56c4e9c1ec86bad7f2d75523bd0711cf532c9ba2466a299c804da6b050997133"}
Sep 14 13:29:20.299147 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.299111    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:20.401061 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.401015    2566 patch_prober.go:28] interesting pod/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 13:29:20.401240 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.401085    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 13:29:20.408391 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.408364    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca\") pod \"730a1fec-8ab2-414a-ad0c-d27492497546\" (UID: \"730a1fec-8ab2-414a-ad0c-d27492497546\") "
Sep 14 13:29:20.408669 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.408648    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "730a1fec-8ab2-414a-ad0c-d27492497546" (UID: "730a1fec-8ab2-414a-ad0c-d27492497546"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:20.509657 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:20.509633    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/730a1fec-8ab2-414a-ad0c-d27492497546-maas-api-service-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:21.165325 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:21.165295    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"
Sep 14 13:29:21.165490 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:21.165294    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw" event={"ID":"730a1fec-8ab2-414a-ad0c-d27492497546","Type":"ContainerDied","Data":"6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053"}
Sep 14 13:29:21.165490 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:21.165418    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6df72db8d8d4c099cde0bafdbd8ed900b8aeddad869943db8a8a3c1bb5f1a053"
Sep 14 13:29:21.854103 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:21.854078    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:29:22.025514 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025490    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4br77\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025521    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025545    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025581    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025622    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025649    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.025671 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025672    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.026011 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025706    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.026011 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token\") pod \"9802e388-2a04-4e12-8055-999ef326de97\" (UID: \"9802e388-2a04-4e12-8055-999ef326de97\") "
Sep 14 13:29:22.026011 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025780    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:29:22.026011 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025935    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data" (OuterVolumeSpecName: "istio-data") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:29:22.026011 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.025958    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026112    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026134    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026203    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026221    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-workload-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026236    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-credential-socket\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.026302 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.026251    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-data\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.027955 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.027930    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:29:22.028102 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.027961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token" (OuterVolumeSpecName: "istio-token") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:22.028260 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.028239    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 13:29:22.028331 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.028282    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77" (OuterVolumeSpecName: "kube-api-access-4br77") pod "9802e388-2a04-4e12-8055-999ef326de97" (UID: "9802e388-2a04-4e12-8055-999ef326de97"). InnerVolumeSpecName "kube-api-access-4br77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:22.127165 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.127131    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4br77\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-kube-api-access-4br77\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.127165 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.127164    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9802e388-2a04-4e12-8055-999ef326de97-istiod-ca-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.127338 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.127179    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9802e388-2a04-4e12-8055-999ef326de97-istio-podinfo\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.127338 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.127203    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9802e388-2a04-4e12-8055-999ef326de97-istio-envoy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.127338 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.127215    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9802e388-2a04-4e12-8055-999ef326de97-istio-token\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:22.173089 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.173053    2566 generic.go:356] "Generic (PLEG): container finished" podID="9802e388-2a04-4e12-8055-999ef326de97" containerID="70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1" exitCode=0
Sep 14 13:29:22.173249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.173114    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"
Sep 14 13:29:22.173249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.173131    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerDied","Data":"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"}
Sep 14 13:29:22.173249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.173193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv" event={"ID":"9802e388-2a04-4e12-8055-999ef326de97","Type":"ContainerDied","Data":"97ccbae08d4a0346c95979482cc4287399ea3fa7bb633dff02970cfaa645c8d9"}
Sep 14 13:29:22.173249 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.173211    2566 scope.go:117] "RemoveContainer" containerID="70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"
Sep 14 13:29:22.182485 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.182463    2566 scope.go:117] "RemoveContainer" containerID="69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"
Sep 14 13:29:22.191179 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.191161    2566 scope.go:117] "RemoveContainer" containerID="70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"
Sep 14 13:29:22.191442 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:29:22.191423    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1\": container with ID starting with 70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1 not found: ID does not exist" containerID="70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"
Sep 14 13:29:22.191494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.191451    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1"} err="failed to get container status \"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1\": rpc error: code = NotFound desc = could not find container \"70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1\": container with ID starting with 70f622f05ea7b058748fffac5a890fad4cf53eb9b0ef1705893afa1e342b43c1 not found: ID does not exist"
Sep 14 13:29:22.191494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.191467    2566 scope.go:117] "RemoveContainer" containerID="69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"
Sep 14 13:29:22.191700 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:29:22.191683    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e\": container with ID starting with 69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e not found: ID does not exist" containerID="69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"
Sep 14 13:29:22.191751 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.191708    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e"} err="failed to get container status \"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e\": rpc error: code = NotFound desc = could not find container \"69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e\": container with ID starting with 69abe4175ae7333a8588495a36c441292739ebcb9f759060a3b54d73d771a29e not found: ID does not exist"
Sep 14 13:29:22.202082 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.202017    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:29:22.205962 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:22.205931    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-366f7d-openshift-default-676b48cfb6-9mbhv"]
Sep 14 13:29:24.190133 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:24.190099    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9802e388-2a04-4e12-8055-999ef326de97" path="/var/lib/kubelet/pods/9802e388-2a04-4e12-8055-999ef326de97/volumes"
Sep 14 13:29:27.696243 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.696212    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:29:27.696578 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.696410    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" podUID="3a4cf06a-8a9d-4742-91ea-42593b579563" containerName="payload-processing" containerID="cri-o://439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd" gracePeriod=30
Sep 14 13:29:27.708446 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.708416    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:29:27.708668 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.708627    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" podUID="79296566-2517-400c-8748-d8f0c54a9af6" containerName="payload-pre-processing" containerID="cri-o://d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb" gracePeriod=30
Sep 14 13:29:27.990404 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.990368    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:29:27.992629 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.992605    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:29:27.993800 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.993773    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"]
Sep 14 13:29:27.996221 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:27.996202    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7f78b4-j9bjw"]
Sep 14 13:29:28.078054 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.078012    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume\") pod \"3a4cf06a-8a9d-4742-91ea-42593b579563\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") "
Sep 14 13:29:28.078054 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.078058    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vpz4\" (UniqueName: \"kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4\") pod \"3a4cf06a-8a9d-4742-91ea-42593b579563\" (UID: \"3a4cf06a-8a9d-4742-91ea-42593b579563\") "
Sep 14 13:29:28.078483 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.078457    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a4cf06a-8a9d-4742-91ea-42593b579563" (UID: "3a4cf06a-8a9d-4742-91ea-42593b579563"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:28.080129 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.080107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4" (OuterVolumeSpecName: "kube-api-access-2vpz4") pod "3a4cf06a-8a9d-4742-91ea-42593b579563" (UID: "3a4cf06a-8a9d-4742-91ea-42593b579563"). InnerVolumeSpecName "kube-api-access-2vpz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:28.178998 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.178964    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwj69\" (UniqueName: \"kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69\") pod \"79296566-2517-400c-8748-d8f0c54a9af6\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") "
Sep 14 13:29:28.179205 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.179084    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume\") pod \"79296566-2517-400c-8748-d8f0c54a9af6\" (UID: \"79296566-2517-400c-8748-d8f0c54a9af6\") "
Sep 14 13:29:28.179401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.179384    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a4cf06a-8a9d-4742-91ea-42593b579563-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.179454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.179408    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vpz4\" (UniqueName: \"kubernetes.io/projected/3a4cf06a-8a9d-4742-91ea-42593b579563-kube-api-access-2vpz4\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.179454 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.179425    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79296566-2517-400c-8748-d8f0c54a9af6" (UID: "79296566-2517-400c-8748-d8f0c54a9af6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:28.181362 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.181337    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69" (OuterVolumeSpecName: "kube-api-access-fwj69") pod "79296566-2517-400c-8748-d8f0c54a9af6" (UID: "79296566-2517-400c-8748-d8f0c54a9af6"). InnerVolumeSpecName "kube-api-access-fwj69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:28.190961 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.190935    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="730a1fec-8ab2-414a-ad0c-d27492497546" path="/var/lib/kubelet/pods/730a1fec-8ab2-414a-ad0c-d27492497546/volumes"
Sep 14 13:29:28.207022 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.206997    2566 generic.go:356] "Generic (PLEG): container finished" podID="3a4cf06a-8a9d-4742-91ea-42593b579563" containerID="439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd" exitCode=0
Sep 14 13:29:28.207134 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.207073    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" event={"ID":"3a4cf06a-8a9d-4742-91ea-42593b579563","Type":"ContainerDied","Data":"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"}
Sep 14 13:29:28.207134 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.207103    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"
Sep 14 13:29:28.207134 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.207125    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x" event={"ID":"3a4cf06a-8a9d-4742-91ea-42593b579563","Type":"ContainerDied","Data":"1c33c1d51a6996f9bf0f661487f60bb51b34fdf5ad29796600c645f09b160cf1"}
Sep 14 13:29:28.207275 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.207149    2566 scope.go:117] "RemoveContainer" containerID="439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"
Sep 14 13:29:28.208397 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.208376    2566 generic.go:356] "Generic (PLEG): container finished" podID="79296566-2517-400c-8748-d8f0c54a9af6" containerID="d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb" exitCode=0
Sep 14 13:29:28.208494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.208405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" event={"ID":"79296566-2517-400c-8748-d8f0c54a9af6","Type":"ContainerDied","Data":"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"}
Sep 14 13:29:28.208494 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.208423    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"
Sep 14 13:29:28.208597 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.208431    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5" event={"ID":"79296566-2517-400c-8748-d8f0c54a9af6","Type":"ContainerDied","Data":"0e58e3823e1175700369b2ade4971ccecdbb1604f7ff24ff6c436ecbee46a9d0"}
Sep 14 13:29:28.216100 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.216060    2566 scope.go:117] "RemoveContainer" containerID="439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"
Sep 14 13:29:28.216308 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:29:28.216291    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd\": container with ID starting with 439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd not found: ID does not exist" containerID="439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"
Sep 14 13:29:28.216373 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.216319    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd"} err="failed to get container status \"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd\": rpc error: code = NotFound desc = could not find container \"439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd\": container with ID starting with 439a196ed9cc2b86968cf24d1b373bdcd5f910dc6fdd2b4606d19fd1d6cee7cd not found: ID does not exist"
Sep 14 13:29:28.216373 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.216341    2566 scope.go:117] "RemoveContainer" containerID="d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"
Sep 14 13:29:28.224080 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.224064    2566 scope.go:117] "RemoveContainer" containerID="d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"
Sep 14 13:29:28.224322 ip-10-0-129-167 kubenswrapper[2566]: E0914 13:29:28.224300    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb\": container with ID starting with d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb not found: ID does not exist" containerID="d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"
Sep 14 13:29:28.224476 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.224329    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb"} err="failed to get container status \"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb\": rpc error: code = NotFound desc = could not find container \"d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb\": container with ID starting with d9cc44478f0cc78df38757113a825f108980ecaa81f54daca69fe62295da5acb not found: ID does not exist"
Sep 14 13:29:28.227004 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.226982    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:29:28.235354 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.235334    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f78b4-79c9cf795d-xjgl5"]
Sep 14 13:29:28.251072 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.250945    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:29:28.265413 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.265390    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7f78b4-5d7bb48fc5-hw94x"]
Sep 14 13:29:28.280000 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.279982    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79296566-2517-400c-8748-d8f0c54a9af6-plugins-config-volume\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.280104 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:28.280003    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwj69\" (UniqueName: \"kubernetes.io/projected/79296566-2517-400c-8748-d8f0c54a9af6-kube-api-access-fwj69\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
Sep 14 13:29:30.189848 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:30.189811    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a4cf06a-8a9d-4742-91ea-42593b579563" path="/var/lib/kubelet/pods/3a4cf06a-8a9d-4742-91ea-42593b579563/volumes"
Sep 14 13:29:30.190413 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:29:30.190390    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79296566-2517-400c-8748-d8f0c54a9af6" path="/var/lib/kubelet/pods/79296566-2517-400c-8748-d8f0c54a9af6/volumes"
Sep 14 13:30:00.164327 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164291    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"]
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164683    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4cf06a-8a9d-4742-91ea-42593b579563" containerName="payload-processing"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164695    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4cf06a-8a9d-4742-91ea-42593b579563" containerName="payload-processing"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164707    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164713    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164724    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79296566-2517-400c-8748-d8f0c54a9af6" containerName="payload-pre-processing"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164730    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="79296566-2517-400c-8748-d8f0c54a9af6" containerName="payload-pre-processing"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164737    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="730a1fec-8ab2-414a-ad0c-d27492497546" containerName="revoke-keys"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164743    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="730a1fec-8ab2-414a-ad0c-d27492497546" containerName="revoke-keys"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164797    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a4cf06a-8a9d-4742-91ea-42593b579563" containerName="payload-processing"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164804    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164811    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="730a1fec-8ab2-414a-ad0c-d27492497546" containerName="revoke-keys"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164818    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:30:00.165012 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.164824    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="79296566-2517-400c-8748-d8f0c54a9af6" containerName="payload-pre-processing"
Sep 14 13:30:00.167986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.167970    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"
Sep 14 13:30:00.171606 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.171585    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:30:00.177385 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.177367    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"
Sep 14 13:30:00.181069 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.180551    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"]
Sep 14 13:30:00.456976 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:00.456912    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"]
Sep 14 13:30:00.459195 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:30:00.459169    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645849fe_4f82_4789_a29a_73430573ed56.slice/crio-aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6 WatchSource:0}: Error finding container aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6: Status 404 returned error can't find the container with id aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6
Sep 14 13:30:01.386970 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:01.386939    2566 generic.go:356] "Generic (PLEG): container finished" podID="645849fe-4f82-4789-a29a-73430573ed56" containerID="5e72fd455b1f8c1ea177efcae6c8f1c80a869c5519b3f70dd3c95981d5bb6ad6" exitCode=0
Sep 14 13:30:01.387311 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:01.387019    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5" event={"ID":"645849fe-4f82-4789-a29a-73430573ed56","Type":"ContainerDied","Data":"5e72fd455b1f8c1ea177efcae6c8f1c80a869c5519b3f70dd3c95981d5bb6ad6"}
Sep 14 13:30:01.387311 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:01.387080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5" event={"ID":"645849fe-4f82-4789-a29a-73430573ed56","Type":"ContainerStarted","Data":"aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6"}
Sep 14 13:30:02.520477 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:02.520456    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"
Sep 14 13:30:03.398269 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:03.398237    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5" event={"ID":"645849fe-4f82-4789-a29a-73430573ed56","Type":"ContainerDied","Data":"aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6"}
Sep 14 13:30:03.398435 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:03.398285    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aac3bb308b4fba4c066596d3f4857504949e822561804e6db6be89a61ab624d6"
Sep 14 13:30:03.398435 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:30:03.398256    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823210-7b4t5"
Sep 14 13:32:10.646189 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:32:10.646157    2566 scope.go:117] "RemoveContainer" containerID="b6540d7fd0cf95955ae75a6b97b98f4ab9fe20d6801608c2874f491f5bb1aa38"
Sep 14 13:32:10.654747 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:32:10.654727    2566 scope.go:117] "RemoveContainer" containerID="a5ce91aba6a5b0149bf63b033ba3467a85dbc8f522078bf2ed29ceecd76dd5cc"
Sep 14 13:33:10.346767 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:33:10.346739    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:33:10.354889 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:33:10.354861    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:33:10.676969 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:33:10.676889    2566 scope.go:117] "RemoveContainer" containerID="60554763345e7e2cd7ef87c723fdfc0e5886e52975ab6d21dd2859a4de36b737"
Sep 14 13:34:10.697091 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:34:10.697006    2566 scope.go:117] "RemoveContainer" containerID="1d358d41ae2aac4a95c5b3368c7fdf8edef4f1f7098d219dde7dac5c79bb9799"
Sep 14 13:35:07.395526 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:07.395496    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j8s4d_20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b/server/0.log"
Sep 14 13:35:07.508616 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:07.508588    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vbxnz_881cdc8e-58c5-4118-81d2-49688162dd4e/manager/1.log"
Sep 14 13:35:07.884664 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:07.884636    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-vsjp2_1d989fc8-761f-44e9-9c57-f8c34eb25994/copy-manifests/0.log"
Sep 14 13:35:07.901389 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:07.901365    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-vsjp2_1d989fc8-761f-44e9-9c57-f8c34eb25994/manager/0.log"
Sep 14 13:35:08.561586 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:08.561560    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29823210-7b4t5_645849fe-4f82-4789-a29a-73430573ed56/cleanup/0.log"
Sep 14 13:35:10.506097 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:10.506064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c_419d5a71-612c-471d-b29a-d6767371f78b/istio-proxy/0.log"
Sep 14 13:35:10.618508 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:10.618482    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4t_86b69bc9-8369-47e9-be9e-a656835a851f/discovery/0.log"
Sep 14 13:35:10.715908 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:10.715883    2566 scope.go:117] "RemoveContainer" containerID="423327d89d7122345edcf559abd64e5315aa75a2fac20024df8efcc543d95c50"
Sep 14 13:35:10.724019 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:10.723998    2566 scope.go:117] "RemoveContainer" containerID="219704329a6b075a8799b8c2f2e8b26b6eafffd533da44566871ee444fd55029"
Sep 14 13:35:10.731173 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:10.731153    2566 scope.go:117] "RemoveContainer" containerID="372204b3f91df7b957c283f8da29f728c60c4528c01ab922c0da5f9a62af9f45"
Sep 14 13:35:11.077331 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:11.077294    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8zrdb_6c0639c8-d415-4af6-8284-9ff4b2d8f6c8/payload-pre-processing/0.log"
Sep 14 13:35:11.655936 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:11.655906    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pm2zb_9252b4a0-6d7b-4086-bfff-e9c56a83f768/main/0.log"
Sep 14 13:35:11.894264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:11.894229    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-9ps5v_6e3f064b-577e-4d5f-9844-cd1b57c4a9bd/main/0.log"
Sep 14 13:35:12.116440 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:12.116409    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkc2nz_a988f790-22d5-4df7-a40a-aa2ac72ed874/main/0.log"
Sep 14 13:35:21.057729 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:21.057698    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fgdpr_344fac89-2ec6-49c3-b18b-49a097126d98/global-pull-secret-syncer/0.log"
Sep 14 13:35:21.200410 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:21.200387    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z9mwf_550b8152-985e-4e0c-b8e1-3fdb4c8dd016/konnectivity-agent/0.log"
Sep 14 13:35:21.223372 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:21.223349    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-167.ec2.internal_979aa361aaf6f040c740f0c683314ad1/haproxy/0.log"
Sep 14 13:35:27.234868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:27.234836    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-rrv2n_cea1970c-d05b-4fa9-b1db-6c042cecd6bc/cluster-monitoring-operator/0.log"
Sep 14 13:35:27.343540 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:27.343512    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b44d4f56f-vx7dp_f2ec605b-a16f-42b9-9c39-859b933d447b/metrics-server/0.log"
Sep 14 13:35:27.565227 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:27.565154    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gg9ln_560c336b-52be-441e-be37-4d3c679955d0/node-exporter/0.log"
Sep 14 13:35:27.590857 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:27.590832    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gg9ln_560c336b-52be-441e-be37-4d3c679955d0/kube-rbac-proxy/0.log"
Sep 14 13:35:27.613359 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:27.613335    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gg9ln_560c336b-52be-441e-be37-4d3c679955d0/init-textfile/0.log"
Sep 14 13:35:28.120573 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.120551    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cd66547-j4qcg_d22d836a-a659-4f09-881f-a614c86b7e1e/telemeter-client/0.log"
Sep 14 13:35:28.149584 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.149563    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cd66547-j4qcg_d22d836a-a659-4f09-881f-a614c86b7e1e/reload/0.log"
Sep 14 13:35:28.178510 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.178454    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-766cd66547-j4qcg_d22d836a-a659-4f09-881f-a614c86b7e1e/kube-rbac-proxy/0.log"
Sep 14 13:35:28.214915 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.214899    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/thanos-query/0.log"
Sep 14 13:35:28.242597 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.242574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/kube-rbac-proxy-web/0.log"
Sep 14 13:35:28.271338 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.271319    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/kube-rbac-proxy/0.log"
Sep 14 13:35:28.298077 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.298035    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/prom-label-proxy/0.log"
Sep 14 13:35:28.326426 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.326408    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/kube-rbac-proxy-rules/0.log"
Sep 14 13:35:28.353184 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:28.353164    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79757cc99d-w5swf_491f93fb-bb84-4eed-85bf-4404a81f060e/kube-rbac-proxy-metrics/0.log"
Sep 14 13:35:29.903835 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:29.903803    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-5g8hg_7de1dbd8-b83d-48b6-9f09-2e5228f039af/networking-console-plugin/0.log"
Sep 14 13:35:30.604413 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:30.604387    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/1.log"
Sep 14 13:35:30.611401 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:30.611381    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-9x266_a6b23f5d-9f0a-4c78-8aa9-c3e05eaeadac/console-operator/2.log"
Sep 14 13:35:31.224642 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.224612    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c766d5bc7-658pt_8554b7e2-7cd2-465a-884a-199860f0d3ee/console/0.log"
Sep 14 13:35:31.260250 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.260226    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-c2dqr_9dfb058b-046b-41a4-a3a7-f544609b1a43/download-server/0.log"
Sep 14 13:35:31.359588 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.359559    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"]
Sep 14 13:35:31.359943 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.359930    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645849fe-4f82-4789-a29a-73430573ed56" containerName="cleanup"
Sep 14 13:35:31.359986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.359944    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="645849fe-4f82-4789-a29a-73430573ed56" containerName="cleanup"
Sep 14 13:35:31.359986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.359957    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:35:31.359986 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.359963    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9802e388-2a04-4e12-8055-999ef326de97" containerName="istio-proxy"
Sep 14 13:35:31.360135 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.360016    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="645849fe-4f82-4789-a29a-73430573ed56" containerName="cleanup"
Sep 14 13:35:31.363460 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.363441    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.366019 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.365999    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv987\"/\"kube-root-ca.crt\""
Sep 14 13:35:31.366106 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.365999    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv987\"/\"openshift-service-ca.crt\""
Sep 14 13:35:31.367140 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.367120    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rv987\"/\"default-dockercfg-rvpnh\""
Sep 14 13:35:31.371449 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.371427    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"]
Sep 14 13:35:31.445476 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.445452    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttk8m\" (UniqueName: \"kubernetes.io/projected/addaec62-ae1e-4a82-a285-dcb5213e953c-kube-api-access-ttk8m\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.445576 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.445502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-sys\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.445576 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.445552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-lib-modules\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.445648 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.445586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-podres\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.445648 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.445622    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-proc\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-sys\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546233    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-lib-modules\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546264 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-podres\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-proc\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-sys\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttk8m\" (UniqueName: \"kubernetes.io/projected/addaec62-ae1e-4a82-a285-dcb5213e953c-kube-api-access-ttk8m\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546391    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-proc\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546419    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-lib-modules\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.546448 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.546420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/addaec62-ae1e-4a82-a285-dcb5213e953c-podres\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.556534 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.555618    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttk8m\" (UniqueName: \"kubernetes.io/projected/addaec62-ae1e-4a82-a285-dcb5213e953c-kube-api-access-ttk8m\") pod \"perf-node-gather-daemonset-hqvq8\" (UID: \"addaec62-ae1e-4a82-a285-dcb5213e953c\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.673618 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.673592    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:31.941660 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:31.941583    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"]
Sep 14 13:35:31.944763 ip-10-0-129-167 kubenswrapper[2566]: W0914 13:35:31.944739    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaddaec62_ae1e_4a82_a285_dcb5213e953c.slice/crio-df7c9a3c05d8dcdadc7becbaf549bf214d67cafd71ac4ea93fb5d141fa9c78b3 WatchSource:0}: Error finding container df7c9a3c05d8dcdadc7becbaf549bf214d67cafd71ac4ea93fb5d141fa9c78b3: Status 404 returned error can't find the container with id df7c9a3c05d8dcdadc7becbaf549bf214d67cafd71ac4ea93fb5d141fa9c78b3
Sep 14 13:35:32.018830 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:32.018807    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-gtjwz_318e5a38-b52f-4d57-97c9-b791e298e8c0/volume-data-source-validator/0.log"
Sep 14 13:35:32.072493 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:32.072470    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8" event={"ID":"addaec62-ae1e-4a82-a285-dcb5213e953c","Type":"ContainerStarted","Data":"df7c9a3c05d8dcdadc7becbaf549bf214d67cafd71ac4ea93fb5d141fa9c78b3"}
Sep 14 13:35:33.079206 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.079116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8" event={"ID":"addaec62-ae1e-4a82-a285-dcb5213e953c","Type":"ContainerStarted","Data":"13353c1e8b56bca45b8c33cb51a7b3e368540b4d2bb5533086cd8f975183bf2d"}
Sep 14 13:35:33.079552 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.079320    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:33.096312 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.096263    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8" podStartSLOduration=2.096247751 podStartE2EDuration="2.096247751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 13:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:35:33.094649671 +0000 UTC m=+2243.409433023" watchObservedRunningTime="2026-09-14 13:35:33.096247751 +0000 UTC m=+2243.411031102"
Sep 14 13:35:33.241262 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.241238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-952cx_a224ad8e-2683-439a-8c5f-2ec635336022/dns/0.log"
Sep 14 13:35:33.266061 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.266030    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-952cx_a224ad8e-2683-439a-8c5f-2ec635336022/kube-rbac-proxy/0.log"
Sep 14 13:35:33.431836 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:33.431770    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mm2w_4e843a4f-6502-4288-96e1-3b69e00bab7a/dns-node-resolver/0.log"
Sep 14 13:35:34.040328 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:34.040305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-798fc9666d-hg2ld_c6041af6-ebac-461b-8145-e9671e71a59a/registry/0.log"
Sep 14 13:35:34.094828 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:34.094800    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn8s8_aec0bc69-308d-40bd-9f6b-7644f7494ded/node-ca/0.log"
Sep 14 13:35:35.177392 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:35.177360    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c_419d5a71-612c-471d-b29a-d6767371f78b/istio-proxy/0.log"
Sep 14 13:35:35.533498 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:35.533461    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4t_86b69bc9-8369-47e9-be9e-a656835a851f/discovery/0.log"
Sep 14 13:35:35.652156 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:35.652134    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8zrdb_6c0639c8-d415-4af6-8284-9ff4b2d8f6c8/payload-pre-processing/0.log"
Sep 14 13:35:36.595737 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:36.595697    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lk29_3ef54ff3-e3ad-4732-9a69-a52d4f5d148e/serve-healthcheck-canary/0.log"
Sep 14 13:35:37.343464 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:37.343426    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcdzj_0e1b8628-2ee7-4d56-a20d-7d46697df8b6/kube-rbac-proxy/0.log"
Sep 14 13:35:37.385291 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:37.385266    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcdzj_0e1b8628-2ee7-4d56-a20d-7d46697df8b6/exporter/0.log"
Sep 14 13:35:37.414129 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:37.414105    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcdzj_0e1b8628-2ee7-4d56-a20d-7d46697df8b6/extractor/0.log"
Sep 14 13:35:39.093868 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:39.093835    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-hqvq8"
Sep 14 13:35:40.136225 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:40.136200    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j8s4d_20bb176b-8e4e-4aa5-9315-dbb0ca4cf78b/server/0.log"
Sep 14 13:35:40.188886 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:40.188856    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vbxnz_881cdc8e-58c5-4118-81d2-49688162dd4e/manager/1.log"
Sep 14 13:35:40.220632 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:40.220606    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vbxnz_881cdc8e-58c5-4118-81d2-49688162dd4e/manager/0.log"
Sep 14 13:35:40.475300 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:40.475271    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-vsjp2_1d989fc8-761f-44e9-9c57-f8c34eb25994/manager/0.log"
Sep 14 13:35:40.494163 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:40.494145    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-vsjp2_1d989fc8-761f-44e9-9c57-f8c34eb25994/copy-manifests/0.log"
Sep 14 13:35:41.880967 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:41.880939    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b9c8bb87f-n6swm_ebe20a8d-cd26-46c7-8a44-0d96bb499f7e/manager/0.log"
Sep 14 13:35:41.933352 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:41.933325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pjszz_cb1eb7e5-a549-4a1d-b49a-f9f1c44d2217/openshift-lws-operator/0.log"
Sep 14 13:35:42.059558 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:42.059526    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c_419d5a71-612c-471d-b29a-d6767371f78b/istio-proxy/0.log"
Sep 14 13:35:42.419959 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:42.419925    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4t_86b69bc9-8369-47e9-be9e-a656835a851f/discovery/0.log"
Sep 14 13:35:42.500822 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:42.500797    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8zrdb_6c0639c8-d415-4af6-8284-9ff4b2d8f6c8/payload-pre-processing/0.log"
Sep 14 13:35:44.049814 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:44.049787    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7mp6c_419d5a71-612c-471d-b29a-d6767371f78b/istio-proxy/0.log"
Sep 14 13:35:44.409689 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:44.409623    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4t_86b69bc9-8369-47e9-be9e-a656835a851f/discovery/0.log"
Sep 14 13:35:44.503098 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:44.503070    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8zrdb_6c0639c8-d415-4af6-8284-9ff4b2d8f6c8/payload-pre-processing/0.log"
Sep 14 13:35:47.591726 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:47.591662    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7wx2m_44f52b1b-d570-4eea-9fcd-3f9a90a5cca0/kube-storage-version-migrator-operator/1.log"
Sep 14 13:35:47.592409 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:47.592389    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7wx2m_44f52b1b-d570-4eea-9fcd-3f9a90a5cca0/kube-storage-version-migrator-operator/0.log"
Sep 14 13:35:48.654231 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.654201    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/kube-multus-additional-cni-plugins/0.log"
Sep 14 13:35:48.678953 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.678927    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/egress-router-binary-copy/0.log"
Sep 14 13:35:48.703283 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.703262    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/cni-plugins/0.log"
Sep 14 13:35:48.733749 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.733732    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/bond-cni-plugin/0.log"
Sep 14 13:35:48.762085 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.762067    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/routeoverride-cni/0.log"
Sep 14 13:35:48.788773 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.788748    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/whereabouts-cni-bincopy/0.log"
Sep 14 13:35:48.827558 ip-10-0-129-167 kubenswrapper[2566]: I0914 13:35:48.827538    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5nfw_31dcd600-0e7e-4728-bd69-3a893ef77db5/whereabouts-cni/0.log"